2024-04-28T01:30:16.268932068Z ............. 2024-04-28T01:30:17.099896964Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-28T01:30:18.917313055Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-28T01:30:53.828179525Z 2024-04-28T01:30:59.440241764Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-28T01:31:03.161860794Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-28T01:31:14.590254770Z ____________ _____________ 2024-04-28T01:31:14.590272141Z ____ |__( )_________ __/__ /________ __ 2024-04-28T01:31:14.590275606Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-28T01:31:14.590278634Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-28T01:31:14.590281559Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-28T01:31:14.590285829Z [2024-04-28T01:31:14.589+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-28T01:31:14.592146482Z [2024-04-28T01:31:14.591+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-28T01:31:14.943773551Z [2024-04-28T01:31:14.943+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-28T01:31:14.959423914Z [2024-04-28T01:31:14.953+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 27 2024-04-28T01:31:14.961572434Z [2024-04-28T01:31:14.960+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T01:31:14.986275357Z [2024-04-28T01:31:14.977+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-28T01:31:14.993465727Z [2024-04-28T01:31:14.993+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-28T01:31:35.821865360Z [2024-04-28T01:31:35.821+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:31:35.942854888Z [2024-04-28T01:31:35.942+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:31:35.942883209Z 2024-04-28T01:31:35.944229816Z [2024-04-28T01:31:35.943+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:31:35.945463635Z [2024-04-28T01:31:35.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:31:35.945475389Z 2024-04-28T01:31:35.952441598Z [2024-04-28T01:31:35.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:31:35.953092151Z [2024-04-28T01:31:35.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:31:36.463522993Z [2024-04-28T01:31:36.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:28:00+00:00 exited with status queued for try_number 1 2024-04-28T01:31:36.475095259Z [2024-04-28T01:31:36.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13570d32-4986-41c6-8929-7b50e46115a5 2024-04-28T01:31:38.959643250Z [2024-04-28T01:31:38.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:28:00+00:00 exited with status success for try_number 1 2024-04-28T01:31:38.967288245Z [2024-04-28T01:31:38.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:28:00+00:00, map_index=-1, run_start_date=2024-04-28 01:31:37.597220+00:00, run_end_date=2024-04-28 01:31:38.247354+00:00, run_duration=0.650134, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:31:35.946915+00:00, queued_by_job_id=1, pid=49 2024-04-28T01:31:49.022280939Z [2024-04-28T01:31:49.021+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:31:49.022293998Z 2024-04-28T01:31:49.022671297Z [2024-04-28T01:31:49.022+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:31:49.024062682Z [2024-04-28T01:31:49.023+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:31:49.024074182Z 2024-04-28T01:31:49.027451442Z [2024-04-28T01:31:49.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:31:49.028263175Z [2024-04-28T01:31:49.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:31:49.143241398Z [2024-04-28T01:31:49.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:28:00+00:00 exited with status queued for try_number 2 2024-04-28T01:31:49.148692285Z [2024-04-28T01:31:49.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81256f9b-48cc-479c-b891-1703ff14612f 2024-04-28T01:31:51.485498305Z [2024-04-28T01:31:51.484+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:31:51.486288662Z [2024-04-28T01:31:51.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:28:00+00:00, run_id=scheduled__2024-04-28T01:28:00+00:00, run_start_date=2024-04-28 01:31:35.850969+00:00, run_end_date=2024-04-28 01:31:51.485898+00:00, run_duration=15.634929, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:28:00+00:00, data_interval_end=2024-04-28 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:31:51.497504269Z [2024-04-28T01:31:51.497+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:30:00+00:00, run_after=2024-04-28T01:32:00+00:00 2024-04-28T01:31:51.531937954Z [2024-04-28T01:31:51.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:28:00+00:00 exited with status success for try_number 2 2024-04-28T01:31:51.541713198Z [2024-04-28T01:31:51.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:28:00+00:00, map_index=-1, run_start_date=2024-04-28 01:31:49.961286+00:00, run_end_date=2024-04-28 01:31:50.664505+00:00, run_duration=0.703219, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:31:49.025133+00:00, queued_by_job_id=1, pid=60 2024-04-28T01:32:00.227350285Z [2024-04-28T01:32:00.225+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:32:00.359037082Z [2024-04-28T01:32:00.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:32:00.359061315Z 2024-04-28T01:32:00.361515096Z [2024-04-28T01:32:00.357+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:32:00.362300132Z [2024-04-28T01:32:00.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:32:00.362311897Z 2024-04-28T01:32:00.371680185Z [2024-04-28T01:32:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:32:00.371696121Z [2024-04-28T01:32:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:32:00.740901426Z [2024-04-28T01:32:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:32:00.777097685Z [2024-04-28T01:32:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c95dbf9-73a2-496b-a824-7be2e595a6c8 2024-04-28T01:32:03.514979383Z [2024-04-28T01:32:03.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:32:03.522319370Z [2024-04-28T01:32:03.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:32:01.791604+00:00, run_end_date=2024-04-28 01:32:02.530636+00:00, run_duration=0.739032, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:32:00.362893+00:00, queued_by_job_id=1, pid=73 2024-04-28T01:32:12.583516121Z [2024-04-28T01:32:12.579+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:32:12.583534689Z 2024-04-28T01:32:12.583538604Z [2024-04-28T01:32:12.579+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:32:12.583541761Z [2024-04-28T01:32:12.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:32:12.583544790Z 2024-04-28T01:32:12.583549413Z [2024-04-28T01:32:12.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:32:12.583563624Z [2024-04-28T01:32:12.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:32:12.669444041Z [2024-04-28T01:32:12.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 2 2024-04-28T01:32:12.672598440Z [2024-04-28T01:32:12.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84270afd-dc7c-4505-bc7b-df920010da29 2024-04-28T01:32:13.969516637Z [2024-04-28T01:32:13.968+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:32:13.970054912Z [2024-04-28T01:32:13.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:30:00+00:00, run_id=scheduled__2024-04-28T01:30:00+00:00, run_start_date=2024-04-28 01:32:00.261217+00:00, run_end_date=2024-04-28 01:32:13.969296+00:00, run_duration=13.708079, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:30:00+00:00, data_interval_end=2024-04-28 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:32:14.012967617Z [2024-04-28T01:32:14.008+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:32:00+00:00, run_after=2024-04-28T01:34:00+00:00 2024-04-28T01:32:15.201364312Z [2024-04-28T01:32:15.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 2 2024-04-28T01:32:15.208122501Z [2024-04-28T01:32:15.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:32:13.485156+00:00, run_end_date=2024-04-28 01:32:13.940476+00:00, run_duration=0.45532, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:32:12.580795+00:00, queued_by_job_id=1, pid=95 2024-04-28T01:34:00.469753817Z [2024-04-28T01:34:00.469+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:34:00.517050037Z [2024-04-28T01:34:00.516+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:34:00.517064193Z 2024-04-28T01:34:00.517317359Z [2024-04-28T01:34:00.517+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:34:00.518093103Z [2024-04-28T01:34:00.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:34:00.518101520Z 2024-04-28T01:34:00.523405893Z [2024-04-28T01:34:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:34:00.523820505Z [2024-04-28T01:34:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:34:00.587675747Z [2024-04-28T01:34:00.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:32:00+00:00 exited with status queued for try_number 1 2024-04-28T01:34:00.595364423Z [2024-04-28T01:34:00.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf821a53-e567-4839-89eb-55059706a7a1 2024-04-28T01:34:02.520393929Z [2024-04-28T01:34:02.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:34:02.521132682Z [2024-04-28T01:34:02.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:32:00+00:00, run_id=scheduled__2024-04-28T01:32:00+00:00, run_start_date=2024-04-28 01:34:00.483420+00:00, run_end_date=2024-04-28 01:34:02.520314+00:00, run_duration=2.036894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:32:00+00:00, data_interval_end=2024-04-28 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:34:02.530526810Z [2024-04-28T01:34:02.530+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:34:00+00:00, run_after=2024-04-28T01:36:00+00:00 2024-04-28T01:34:02.566936410Z [2024-04-28T01:34:02.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:32:00+00:00 exited with status success for try_number 1 2024-04-28T01:34:02.575899322Z [2024-04-28T01:34:02.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:32:00+00:00, map_index=-1, run_start_date=2024-04-28 01:34:01.463325+00:00, run_end_date=2024-04-28 01:34:01.934010+00:00, run_duration=0.470685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:34:00.518594+00:00, queued_by_job_id=1, pid=119 2024-04-28T01:36:00.467202799Z [2024-04-28T01:36:00.466+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:36:00.520460599Z [2024-04-28T01:36:00.520+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:36:00.520472923Z 2024-04-28T01:36:00.520824394Z [2024-04-28T01:36:00.520+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:36:00.521428773Z [2024-04-28T01:36:00.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:36:00.521439392Z 2024-04-28T01:36:00.524767755Z [2024-04-28T01:36:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:36:00.525064161Z [2024-04-28T01:36:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:36:00.574787130Z [2024-04-28T01:36:00.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:34:00+00:00 exited with status queued for try_number 1 2024-04-28T01:36:00.580175826Z [2024-04-28T01:36:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b1bc982-fea0-4e4c-9d34-0afb9f7ce552 2024-04-28T01:36:03.042778089Z [2024-04-28T01:36:03.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:36:03.042976492Z [2024-04-28T01:36:03.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:34:00+00:00, run_id=scheduled__2024-04-28T01:34:00+00:00, run_start_date=2024-04-28 01:36:00.483826+00:00, run_end_date=2024-04-28 01:36:03.042726+00:00, run_duration=2.5589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:34:00+00:00, data_interval_end=2024-04-28 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:36:03.052527053Z [2024-04-28T01:36:03.052+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:36:00+00:00, run_after=2024-04-28T01:38:00+00:00 2024-04-28T01:36:03.110477762Z [2024-04-28T01:36:03.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:34:00+00:00 exited with status success for try_number 1 2024-04-28T01:36:03.116891030Z [2024-04-28T01:36:03.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:34:00+00:00, map_index=-1, run_start_date=2024-04-28 01:36:01.351412+00:00, run_end_date=2024-04-28 01:36:01.954499+00:00, run_duration=0.603087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:36:00.522017+00:00, queued_by_job_id=1, pid=156 2024-04-28T01:36:15.348757553Z [2024-04-28T01:36:15.348+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T01:38:00.055216508Z [2024-04-28T01:38:00.054+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:38:00.122537947Z [2024-04-28T01:38:00.121+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:00.122575693Z 2024-04-28T01:38:00.129261227Z [2024-04-28T01:38:00.128+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:38:00.161122184Z [2024-04-28T01:38:00.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:00.161147762Z 2024-04-28T01:38:00.172578943Z [2024-04-28T01:38:00.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:00.176794154Z [2024-04-28T01:38:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:38:00.508414254Z [2024-04-28T01:38:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:36:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:00.516332495Z [2024-04-28T01:38:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to d20c9ee1-e5e2-4855-a795-da4c25ebda20 2024-04-28T01:38:01.633391354Z [2024-04-28T01:38:01.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:35:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:38:01.685908035Z [2024-04-28T01:38:01.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:38:01.686938934Z [2024-04-28T01:38:01.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:36:00+00:00, run_id=scheduled__2024-04-28T01:36:00+00:00, run_start_date=2024-04-28 01:38:00.068072+00:00, run_end_date=2024-04-28 01:38:01.685843+00:00, run_duration=1.617771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:36:00+00:00, data_interval_end=2024-04-28 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:38:01.704451620Z [2024-04-28T01:38:01.704+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:38:01.729415499Z [2024-04-28T01:38:01.729+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:01.729428379Z 2024-04-28T01:38:01.729654080Z [2024-04-28T01:38:01.729+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:38:01.730553930Z [2024-04-28T01:38:01.730+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:01.730560658Z 2024-04-28T01:38:01.733699969Z [2024-04-28T01:38:01.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:38:01.733939281Z [2024-04-28T01:38:01.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:38:01.833982705Z [2024-04-28T01:38:01.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:01.836233526Z [2024-04-28T01:38:01.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:36:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:01.857181306Z [2024-04-28T01:38:01.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3dcf9af-edfe-47cb-8ead-00343d868ae1 2024-04-28T01:38:01.857663332Z [2024-04-28T01:38:01.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:36:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:01.114985+00:00, run_end_date=2024-04-28 01:38:01.504905+00:00, run_duration=0.38992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:00.161508+00:00, queued_by_job_id=1, pid=192 2024-04-28T01:38:05.725592753Z [2024-04-28T01:38:05.724+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:05.725613555Z 2024-04-28T01:38:05.725638710Z [2024-04-28T01:38:05.725+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:38:05.727886271Z [2024-04-28T01:38:05.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:05.727898386Z 2024-04-28T01:38:05.734008940Z [2024-04-28T01:38:05.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:38:05.734359322Z [2024-04-28T01:38:05.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:38:05.824104565Z [2024-04-28T01:38:05.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:05.824292866Z [2024-04-28T01:38:05.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:05.832151391Z [2024-04-28T01:38:05.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:04.095506+00:00, run_end_date=2024-04-28 01:38:04.693739+00:00, run_duration=0.598233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:01.731699+00:00, queued_by_job_id=1, pid=223 2024-04-28T01:38:05.832412115Z [2024-04-28T01:38:05.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4df0f853-18d6-4f37-841c-eb5b581b794b 2024-04-28T01:38:09.100922946Z [2024-04-28T01:38:09.100+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:09.100938672Z 2024-04-28T01:38:09.101176234Z [2024-04-28T01:38:09.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:38:09.102160939Z [2024-04-28T01:38:09.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:09.102184530Z 2024-04-28T01:38:09.107153406Z [2024-04-28T01:38:09.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:38:09.107451162Z [2024-04-28T01:38:09.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:38:09.173189503Z [2024-04-28T01:38:09.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:09.173229217Z [2024-04-28T01:38:09.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:09.177935478Z [2024-04-28T01:38:09.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:08.202482+00:00, run_end_date=2024-04-28 01:38:08.515111+00:00, run_duration=0.312629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:05.728924+00:00, queued_by_job_id=1, pid=247 2024-04-28T01:38:09.178056457Z [2024-04-28T01:38:09.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to aaec73af-8670-4d70-aefe-5b68d92368c5 2024-04-28T01:38:11.459468142Z [2024-04-28T01:38:11.459+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:11.459506780Z 2024-04-28T01:38:11.459556694Z [2024-04-28T01:38:11.459+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:38:11.460202701Z [2024-04-28T01:38:11.459+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:11.460215899Z 2024-04-28T01:38:11.463355598Z [2024-04-28T01:38:11.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:11.466068007Z [2024-04-28T01:38:11.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:38:11.536317249Z [2024-04-28T01:38:11.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:11.541787207Z [2024-04-28T01:38:11.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96517b63-6f8b-420e-8c1e-322b92a0e986 2024-04-28T01:38:11.619663654Z [2024-04-28T01:38:11.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:11.626192617Z [2024-04-28T01:38:11.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=0, run_start_date=2024-04-28 01:38:11.042483+00:00, run_end_date=2024-04-28 01:38:11.389348+00:00, run_duration=0.346865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:09.103918+00:00, queued_by_job_id=1, pid=259 2024-04-28T01:38:14.690999437Z [2024-04-28T01:38:14.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:38:14.691726463Z [2024-04-28T01:38:14.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:30:00+00:00, run_id=scheduled__2024-04-28T01:30:00+00:00, run_start_date=2024-04-28 01:38:01.647010+00:00, run_end_date=2024-04-28 01:38:14.690907+00:00, run_duration=13.043897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:30:00+00:00, data_interval_end=2024-04-28 01:35:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T01:38:14.698340076Z [2024-04-28T01:38:14.698+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:35:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:38:14.726285295Z [2024-04-28T01:38:14.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:14.732257223Z [2024-04-28T01:38:14.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:13.781483+00:00, run_end_date=2024-04-28 01:38:14.298607+00:00, run_duration=0.517124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:11.460548+00:00, queued_by_job_id=1, pid=271 2024-04-28T01:38:25.986665835Z [2024-04-28T01:38:25.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:39:00+00:00 2024-04-28T01:38:26.000776706Z [2024-04-28T01:38:26.000+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:38:26.245925983Z [2024-04-28T01:38:26.245+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:38:26.245962114Z 2024-04-28T01:38:26.245970743Z 2024-04-28T01:38:26.245989797Z [2024-04-28T01:38:26.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:38:26.246321298Z [2024-04-28T01:38:26.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:38:26.250013021Z [2024-04-28T01:38:26.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:26.250034176Z 2024-04-28T01:38:26.250042814Z 2024-04-28T01:38:26.269254466Z [2024-04-28T01:38:26.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:26.269332382Z [2024-04-28T01:38:26.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:38:26.269486798Z [2024-04-28T01:38:26.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:26.269566033Z [2024-04-28T01:38:26.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:38:26.675548333Z [2024-04-28T01:38:26.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:26.675679531Z [2024-04-28T01:38:26.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:26.689541988Z [2024-04-28T01:38:26.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3a1e458-f733-44e5-9ba9-5b1828ca7290 2024-04-28T01:38:26.689877799Z [2024-04-28T01:38:26.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to b28c0a99-1c20-4fbc-8803-a0082ec9ad70 2024-04-28T01:38:30.391495437Z [2024-04-28T01:38:30.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:38:30.391923921Z [2024-04-28T01:38:30.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:37:00+00:00, run_id=scheduled__2024-04-28T01:37:00+00:00, run_start_date=2024-04-28 01:38:26.053846+00:00, run_end_date=2024-04-28 01:38:30.391454+00:00, run_duration=4.337608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:37:00+00:00, data_interval_end=2024-04-28 01:38:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:38:30.402904380Z [2024-04-28T01:38:30.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:39:00+00:00 2024-04-28T01:38:30.435278294Z [2024-04-28T01:38:30.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:30.441660455Z [2024-04-28T01:38:30.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:37:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:28.784632+00:00, run_end_date=2024-04-28 01:38:30.134772+00:00, run_duration=1.35014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:26.260965+00:00, queued_by_job_id=1, pid=294 2024-04-28T01:38:31.500772453Z [2024-04-28T01:38:31.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:38:31.501203183Z [2024-04-28T01:38:31.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:37:00+00:00, run_id=scheduled__2024-04-28T01:37:00+00:00, run_start_date=2024-04-28 01:38:26.054324+00:00, run_end_date=2024-04-28 01:38:31.500698+00:00, run_duration=5.446374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:37:00+00:00, data_interval_end=2024-04-28 01:38:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:38:31.513375634Z [2024-04-28T01:38:31.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:39:00+00:00 2024-04-28T01:38:31.544645407Z [2024-04-28T01:38:31.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:31.549510928Z [2024-04-28T01:38:31.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:37:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:29.009199+00:00, run_end_date=2024-04-28 01:38:30.744356+00:00, run_duration=1.735157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:26.260965+00:00, queued_by_job_id=1, pid=295 2024-04-28T01:38:33.663438980Z [2024-04-28T01:38:33.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:35:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:38:33.714114295Z [2024-04-28T01:38:33.712+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:33.714208934Z 2024-04-28T01:38:33.714236754Z [2024-04-28T01:38:33.712+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:38:33.714262150Z [2024-04-28T01:38:33.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:33.714265570Z 2024-04-28T01:38:33.715487192Z [2024-04-28T01:38:33.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:38:33.715499052Z [2024-04-28T01:38:33.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:38:33.773809699Z [2024-04-28T01:38:33.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:33.782034355Z [2024-04-28T01:38:33.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78900fc7-6848-4877-a3c3-d828cb7030e6 2024-04-28T01:38:36.305369315Z [2024-04-28T01:38:36.305+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:36.305394041Z 2024-04-28T01:38:36.305546660Z [2024-04-28T01:38:36.305+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:38:36.306289465Z [2024-04-28T01:38:36.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:36.306302505Z 2024-04-28T01:38:36.312197727Z [2024-04-28T01:38:36.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='split_metrics', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:38:36.312381140Z [2024-04-28T01:38:36.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'split_metrics', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:38:36.392459489Z [2024-04-28T01:38:36.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.split_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:36.392708049Z [2024-04-28T01:38:36.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:36.399211701Z [2024-04-28T01:38:36.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63766dcb-9f32-4b70-ad86-1b2be079f13d 2024-04-28T01:38:36.399534746Z [2024-04-28T01:38:36.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:35.765800+00:00, run_end_date=2024-04-28 01:38:36.136971+00:00, run_duration=0.371171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:33.713300+00:00, queued_by_job_id=1, pid=325 2024-04-28T01:38:38.705852559Z [2024-04-28T01:38:38.705+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:38.705871055Z 2024-04-28T01:38:38.709594142Z [2024-04-28T01:38:38.709+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:38:38.710249258Z [2024-04-28T01:38:38.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:38.710258046Z 2024-04-28T01:38:38.714392248Z [2024-04-28T01:38:38.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:38:38.714589683Z [2024-04-28T01:38:38.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'collect_metrics', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:38:38.790281485Z [2024-04-28T01:38:38.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.collect_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:38.790488368Z [2024-04-28T01:38:38.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.split_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:38.797989539Z [2024-04-28T01:38:38.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=split_metrics, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:38.276810+00:00, run_end_date=2024-04-28 01:38:38.574990+00:00, run_duration=0.29818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:36.307966+00:00, queued_by_job_id=1, pid=346 2024-04-28T01:38:38.798274488Z [2024-04-28T01:38:38.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37fe6b81-c31b-4c65-bec1-f3fe70078c51 2024-04-28T01:38:41.737022431Z [2024-04-28T01:38:41.736+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:38:41.737039808Z 2024-04-28T01:38:41.737277195Z [2024-04-28T01:38:41.737+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:38:41.737872656Z [2024-04-28T01:38:41.737+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:41.737879370Z 2024-04-28T01:38:41.741809443Z [2024-04-28T01:38:41.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:41.742085945Z [2024-04-28T01:38:41.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'send_prometheus', 'scheduled__2024-04-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:38:41.820832108Z [2024-04-28T01:38:41.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.send_prometheus run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:41.821015000Z [2024-04-28T01:38:41.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.collect_metrics run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:41.848662356Z [2024-04-28T01:38:41.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=0, run_start_date=2024-04-28 01:38:40.799498+00:00, run_end_date=2024-04-28 01:38:41.166767+00:00, run_duration=0.367269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:38.710768+00:00, queued_by_job_id=1, pid=358 2024-04-28T01:38:41.848927476Z [2024-04-28T01:38:41.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95e6711-b640-487e-ab32-b07fe69d75f5 2024-04-28T01:38:45.346174342Z [2024-04-28T01:38:45.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:38:45.346570352Z [2024-04-28T01:38:45.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:30:00+00:00, run_id=scheduled__2024-04-28T01:30:00+00:00, run_start_date=2024-04-28 01:38:33.676268+00:00, run_end_date=2024-04-28 01:38:45.346117+00:00, run_duration=11.669849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:30:00+00:00, data_interval_end=2024-04-28 01:35:00+00:00, dag_hash=5ee325d867d8e8935aed87feb49d5127 2024-04-28T01:38:45.365299080Z [2024-04-28T01:38:45.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:35:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:38:45.410278434Z [2024-04-28T01:38:45.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.send_prometheus run_id=scheduled__2024-04-28T01:30:00+00:00 exited with status success for try_number 1 2024-04-28T01:38:45.416172526Z [2024-04-28T01:38:45.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:30:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:43.841949+00:00, run_end_date=2024-04-28 01:38:44.210795+00:00, run_duration=0.368846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:41.738451+00:00, queued_by_job_id=1, pid=370 2024-04-28T01:38:57.585861175Z [2024-04-28T01:38:57.585+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:38:57.610025618Z [2024-04-28T01:38:57.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:39:00+00:00 2024-04-28T01:38:57.667455982Z [2024-04-28T01:38:57.667+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:38:57.667476558Z 2024-04-28T01:38:57.667479971Z 2024-04-28T01:38:57.667489856Z [2024-04-28T01:38:57.667+0000] {scheduler_job.py:425} INFO - DAG vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:38:57.667694196Z [2024-04-28T01:38:57.667+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:38:57.668236694Z [2024-04-28T01:38:57.668+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:38:57.668246246Z 2024-04-28T01:38:57.668249728Z 2024-04-28T01:38:57.670590434Z [2024-04-28T01:38:57.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:57.670662990Z [2024-04-28T01:38:57.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:38:57.670849119Z [2024-04-28T01:38:57.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:38:57.671026639Z [2024-04-28T01:38:57.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:38:57.921613319Z [2024-04-28T01:38:57.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:57.921720042Z [2024-04-28T01:38:57.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status queued for try_number 1 2024-04-28T01:38:57.932059156Z [2024-04-28T01:38:57.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c06e088-f932-4283-b046-a945e81ff425 2024-04-28T01:38:57.932225019Z [2024-04-28T01:38:57.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a0c85bc-73cb-4747-b6e7-21a770152b85 2024-04-28T01:39:00.616175566Z [2024-04-28T01:39:00.615+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:39:00.636027298Z [2024-04-28T01:39:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:00.652438388Z [2024-04-28T01:39:00.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:00.753854822Z [2024-04-28T01:39:00.753+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:39:00.753876101Z 2024-04-28T01:39:00.753879871Z 2024-04-28T01:39:00.753883245Z 2024-04-28T01:39:00.754169588Z [2024-04-28T01:39:00.754+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:39:00.754349469Z [2024-04-28T01:39:00.754+0000] {scheduler_job.py:425} INFO - DAG vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 1/16 running and queued tasks 2024-04-28T01:39:00.754571531Z [2024-04-28T01:39:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:39:00.755198318Z [2024-04-28T01:39:00.754+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:39:00.755202631Z 2024-04-28T01:39:00.755205853Z 2024-04-28T01:39:00.755208893Z 2024-04-28T01:39:00.759064488Z [2024-04-28T01:39:00.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:39:00.759276628Z [2024-04-28T01:39:00.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:39:00.759569239Z [2024-04-28T01:39:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:39:00.759738179Z [2024-04-28T01:39:00.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:39:00.759975009Z [2024-04-28T01:39:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:39:00.760161823Z [2024-04-28T01:39:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:39:01.085906778Z [2024-04-28T01:39:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status queued for try_number 1 2024-04-28T01:39:01.086100647Z [2024-04-28T01:39:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status queued for try_number 1 2024-04-28T01:39:01.086262763Z [2024-04-28T01:39:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status queued for try_number 1 2024-04-28T01:39:01.107364623Z [2024-04-28T01:39:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to da9ef5c7-3ef6-4dd5-a447-195860b60b7b 2024-04-28T01:39:01.107708483Z [2024-04-28T01:39:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to f43cb7dd-5df7-4dc4-b2d0-ac132b72bd7e 2024-04-28T01:39:01.107919314Z [2024-04-28T01:39:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9def0f73-573a-4ab8-aa34-0ee0f7493299 2024-04-28T01:39:02.319815218Z [2024-04-28T01:39:02.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:39:02.320457363Z [2024-04-28T01:39:02.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:37:00+00:00, run_id=scheduled__2024-04-28T01:37:00+00:00, run_start_date=2024-04-28 01:38:57.627872+00:00, run_end_date=2024-04-28 01:39:02.319732+00:00, run_duration=4.69186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:37:00+00:00, data_interval_end=2024-04-28 01:38:00+00:00, dag_hash=60a3f87a4265272532e40b0e2bdcface 2024-04-28T01:39:02.332262158Z [2024-04-28T01:39:02.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:39:00+00:00 2024-04-28T01:39:02.338880781Z [2024-04-28T01:39:02.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:39:02.339302749Z [2024-04-28T01:39:02.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:37:00+00:00, run_id=scheduled__2024-04-28T01:37:00+00:00, run_start_date=2024-04-28 01:38:57.629463+00:00, run_end_date=2024-04-28 01:39:02.338832+00:00, run_duration=4.709369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:37:00+00:00, data_interval_end=2024-04-28 01:38:00+00:00, dag_hash=ffcdb74bbc68850d1ba99d5912733972 2024-04-28T01:39:02.354776080Z [2024-04-28T01:39:02.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:38:00+00:00, run_after=2024-04-28T01:39:00+00:00 2024-04-28T01:39:02.418713396Z [2024-04-28T01:39:02.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status success for try_number 1 2024-04-28T01:39:02.418973570Z [2024-04-28T01:39:02.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:37:00+00:00 exited with status success for try_number 1 2024-04-28T01:39:02.433570735Z [2024-04-28T01:39:02.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:37:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:59.834633+00:00, run_end_date=2024-04-28 01:39:01.466943+00:00, run_duration=1.63231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:57.668804+00:00, queued_by_job_id=1, pid=393 2024-04-28T01:39:02.435013219Z [2024-04-28T01:39:02.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:37:00+00:00, map_index=-1, run_start_date=2024-04-28 01:38:59.805152+00:00, run_end_date=2024-04-28 01:39:01.156609+00:00, run_duration=1.351457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:38:57.668804+00:00, queued_by_job_id=1, pid=394 2024-04-28T01:39:02.687204112Z [2024-04-28T01:39:02.686+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:39:02.696254087Z [2024-04-28T01:39:02.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:02.917484112Z [2024-04-28T01:39:02.914+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:39:02.917511859Z 2024-04-28T01:39:02.917514948Z [2024-04-28T01:39:02.914+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:39:02.917518580Z [2024-04-28T01:39:02.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:39:02.917521380Z 2024-04-28T01:39:02.922555653Z [2024-04-28T01:39:02.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:39:02.922887322Z [2024-04-28T01:39:02.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:39:03.021481599Z [2024-04-28T01:39:03.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status queued for try_number 1 2024-04-28T01:39:03.043613647Z [2024-04-28T01:39:03.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82883454-6074-492d-8004-96131427ca61 2024-04-28T01:39:07.210026063Z [2024-04-28T01:39:07.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:39:07.210368867Z [2024-04-28T01:39:07.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:38:00+00:00, run_id=scheduled__2024-04-28T01:38:00+00:00, run_start_date=2024-04-28 01:39:00.664291+00:00, run_end_date=2024-04-28 01:39:07.209954+00:00, run_duration=6.545663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:38:00+00:00, data_interval_end=2024-04-28 01:39:00+00:00, dag_hash=ffcdb74bbc68850d1ba99d5912733972 2024-04-28T01:39:07.226474302Z [2024-04-28T01:39:07.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:07.241095273Z [2024-04-28T01:39:07.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:39:07.242192711Z [2024-04-28T01:39:07.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:38:00+00:00, run_id=scheduled__2024-04-28T01:38:00+00:00, run_start_date=2024-04-28 01:39:00.663851+00:00, run_end_date=2024-04-28 01:39:07.241018+00:00, run_duration=6.577167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:38:00+00:00, data_interval_end=2024-04-28 01:39:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:39:07.254099512Z [2024-04-28T01:39:07.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:07.363442874Z [2024-04-28T01:39:07.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status success for try_number 1 2024-04-28T01:39:07.363695252Z [2024-04-28T01:39:07.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status success for try_number 1 2024-04-28T01:39:07.380086341Z [2024-04-28T01:39:07.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:38:00+00:00, map_index=-1, run_start_date=2024-04-28 01:39:03.417136+00:00, run_end_date=2024-04-28 01:39:06.172059+00:00, run_duration=2.754923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:39:00.755802+00:00, queued_by_job_id=1, pid=438 2024-04-28T01:39:07.380688777Z [2024-04-28T01:39:07.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:38:00+00:00, map_index=-1, run_start_date=2024-04-28 01:39:04.160451+00:00, run_end_date=2024-04-28 01:39:06.531488+00:00, run_duration=2.371037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:39:00.755802+00:00, queued_by_job_id=1, pid=460 2024-04-28T01:39:08.421573574Z [2024-04-28T01:39:08.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:39:08.423489170Z [2024-04-28T01:39:08.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:38:00+00:00, run_id=scheduled__2024-04-28T01:38:00+00:00, run_start_date=2024-04-28 01:39:00.665807+00:00, run_end_date=2024-04-28 01:39:08.423075+00:00, run_duration=7.757268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:38:00+00:00, data_interval_end=2024-04-28 01:39:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:39:08.432103061Z [2024-04-28T01:39:08.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:08.485200376Z [2024-04-28T01:39:08.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status success for try_number 1 2024-04-28T01:39:08.489628564Z [2024-04-28T01:39:08.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:38:00+00:00, map_index=-1, run_start_date=2024-04-28 01:39:04.868608+00:00, run_end_date=2024-04-28 01:39:07.871163+00:00, run_duration=3.002555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:39:00.755802+00:00, queued_by_job_id=1, pid=476 2024-04-28T01:39:09.833625020Z [2024-04-28T01:39:09.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:39:09.833835865Z [2024-04-28T01:39:09.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:38:00+00:00, run_id=scheduled__2024-04-28T01:38:00+00:00, run_start_date=2024-04-28 01:39:02.717408+00:00, run_end_date=2024-04-28 01:39:09.833540+00:00, run_duration=7.116132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:38:00+00:00, data_interval_end=2024-04-28 01:39:00+00:00, dag_hash=60a3f87a4265272532e40b0e2bdcface 2024-04-28T01:39:09.843522939Z [2024-04-28T01:39:09.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:39:00+00:00, run_after=2024-04-28T01:40:00+00:00 2024-04-28T01:39:09.870450478Z [2024-04-28T01:39:09.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status success for try_number 1 2024-04-28T01:39:09.877058891Z [2024-04-28T01:39:09.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:38:00+00:00, map_index=-1, run_start_date=2024-04-28 01:39:07.253049+00:00, run_end_date=2024-04-28 01:39:09.479380+00:00, run_duration=2.226331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:39:02.915653+00:00, queued_by_job_id=1, pid=496 2024-04-28T01:40:00.687288034Z [2024-04-28T01:40:00.686+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:40:00.700483006Z [2024-04-28T01:40:00.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:40:00.712059021Z [2024-04-28T01:40:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:40:00.720079295Z [2024-04-28T01:40:00.719+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:40:00.734565369Z [2024-04-28T01:40:00.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:41:00+00:00 2024-04-28T01:40:00.747962306Z [2024-04-28T01:40:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:41:00+00:00 2024-04-28T01:40:00.755537082Z [2024-04-28T01:40:00.755+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:40:00.933778893Z [2024-04-28T01:40:00.933+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-28T01:40:00.933796869Z 2024-04-28T01:40:00.933814533Z 2024-04-28T01:40:00.933822127Z 2024-04-28T01:40:00.933825886Z 2024-04-28T01:40:00.933831612Z 2024-04-28T01:40:00.933834757Z 2024-04-28T01:40:00.933838120Z 2024-04-28T01:40:00.933841553Z [2024-04-28T01:40:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:40:00.933851116Z [2024-04-28T01:40:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:40:00.933922000Z [2024-04-28T01:40:00.933+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:40:00.934073398Z [2024-04-28T01:40:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:40:00.934201728Z [2024-04-28T01:40:00.934+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:40:00.934324341Z [2024-04-28T01:40:00.934+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:40:00.934464453Z [2024-04-28T01:40:00.934+0000] {scheduler_job.py:425} INFO - DAG vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:40:00.935029671Z [2024-04-28T01:40:00.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:40:00.935039887Z 2024-04-28T01:40:00.935043091Z 2024-04-28T01:40:00.935046392Z 2024-04-28T01:40:00.935049710Z 2024-04-28T01:40:00.935052824Z 2024-04-28T01:40:00.935055821Z 2024-04-28T01:40:00.935059199Z 2024-04-28T01:40:00.940024386Z [2024-04-28T01:40:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:40:00.940147896Z [2024-04-28T01:40:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:40:00.940372887Z [2024-04-28T01:40:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:40:00.940511741Z [2024-04-28T01:40:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:40:00.940709296Z [2024-04-28T01:40:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:00.940863869Z [2024-04-28T01:40:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:40:00.941045644Z [2024-04-28T01:40:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:00.941177354Z [2024-04-28T01:40:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:40:00.941392421Z [2024-04-28T01:40:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:00.941531202Z [2024-04-28T01:40:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:40:00.941800384Z [2024-04-28T01:40:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:00.941934441Z [2024-04-28T01:40:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:40:00.942139203Z [2024-04-28T01:40:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:00.942296120Z [2024-04-28T01:40:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:40:01.733844483Z [2024-04-28T01:40:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.734368460Z [2024-04-28T01:40:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.734787227Z [2024-04-28T01:40:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.735075704Z [2024-04-28T01:40:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.735339226Z [2024-04-28T01:40:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.735606603Z [2024-04-28T01:40:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.736030350Z [2024-04-28T01:40:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:01.774098547Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to a796a84e-2e02-4049-9d23-3ad2bebc9803 2024-04-28T01:40:01.774120673Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0dadbf2-0e98-4727-abbc-f8a446c93ebd 2024-04-28T01:40:01.774124377Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6d79592-653f-4c9f-93db-2ece0bb07fc2 2024-04-28T01:40:01.774127586Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fc56d75-d088-4c13-89f0-fa5365260f98 2024-04-28T01:40:01.774130674Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a1dd45f-084d-42ef-90cf-16163d95d5a9 2024-04-28T01:40:01.774133635Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4e5c629-15e1-4e9a-8a36-d52f9820a0f5 2024-04-28T01:40:01.776482592Z [2024-04-28T01:40:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0da15b2-cc87-4d0c-b957-0589bec34afb 2024-04-28T01:40:04.568030055Z [2024-04-28T01:40:04.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:40:04.568597883Z [2024-04-28T01:40:04.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:38:00+00:00, run_id=scheduled__2024-04-28T01:38:00+00:00, run_start_date=2024-04-28 01:40:00.778910+00:00, run_end_date=2024-04-28 01:40:04.567923+00:00, run_duration=3.789013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:38:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:40:04.579361254Z [2024-04-28T01:40:04.579+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:40:04.730865004Z [2024-04-28T01:40:04.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:38:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:04.737730311Z [2024-04-28T01:40:04.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:38:00+00:00, map_index=-1, run_start_date=2024-04-28 01:40:03.589896+00:00, run_end_date=2024-04-28 01:40:03.972735+00:00, run_duration=0.382839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=529 2024-04-28T01:40:05.960508237Z [2024-04-28T01:40:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status failed for try_number 1 2024-04-28T01:40:05.962117483Z [2024-04-28T01:40:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status failed for try_number 1 2024-04-28T01:40:05.976406904Z [2024-04-28T01:40:05.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:40:05.976902223Z [2024-04-28T01:40:05.976+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:05.981796663Z [2024-04-28T01:40:05.981+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:06.029270778Z [2024-04-28T01:40:06.029+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=extract_metrics_from_vnfrs, execution_date=20240428T013500, start_date=, end_date=20240428T014005 2024-04-28T01:40:06.046160741Z [2024-04-28T01:40:06.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:40:06.046580979Z [2024-04-28T01:40:06.046+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:06.048687771Z [2024-04-28T01:40:06.048+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:06.061328070Z [2024-04-28T01:40:06.061+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T013900, start_date=, end_date=20240428T014006 2024-04-28T01:40:08.081564881Z [2024-04-28T01:40:08.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:40:08.081870668Z [2024-04-28T01:40:08.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:39:00+00:00, run_id=scheduled__2024-04-28T01:39:00+00:00, run_start_date=2024-04-28 01:40:00.790918+00:00, run_end_date=2024-04-28 01:40:08.081427+00:00, run_duration=7.290509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:39:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:40:08.092572344Z [2024-04-28T01:40:08.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:41:00+00:00 2024-04-28T01:40:08.189721750Z [2024-04-28T01:40:08.189+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:40:08.189806911Z 2024-04-28T01:40:08.189826019Z [2024-04-28T01:40:08.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:40:08.190783555Z [2024-04-28T01:40:08.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:40:08.190836008Z 2024-04-28T01:40:08.194428518Z [2024-04-28T01:40:08.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:40:08.194581091Z [2024-04-28T01:40:08.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:40:08.287235603Z [2024-04-28T01:40:08.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:08.288274027Z [2024-04-28T01:40:08.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:08.288522678Z [2024-04-28T01:40:08.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:08.288672232Z [2024-04-28T01:40:08.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status failed for try_number 1 2024-04-28T01:40:08.303512276Z [2024-04-28T01:40:08.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:39:00+00:00, map_index=-1, run_start_date=2024-04-28 01:40:05.786502+00:00, run_end_date=2024-04-28 01:40:07.651437+00:00, run_duration=1.864935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=597 2024-04-28T01:40:08.303785633Z [2024-04-28T01:40:08.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0155012b-a885-47ea-b003-89291935604d 2024-04-28T01:40:08.303996843Z [2024-04-28T01:40:08.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=2024-04-28 01:40:06.755895+00:00, run_end_date=2024-04-28 01:40:07.395253+00:00, run_duration=0.639358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=625 2024-04-28T01:40:08.304203101Z [2024-04-28T01:40:08.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:40:08.304754133Z [2024-04-28T01:40:08.304+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:08.310477646Z [2024-04-28T01:40:08.310+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:08.326219342Z [2024-04-28T01:40:08.325+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T013900, start_date=, end_date=20240428T014008 2024-04-28T01:40:09.597738667Z [2024-04-28T01:40:09.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:40:09.597761860Z [2024-04-28T01:40:09.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:39:00+00:00, run_id=scheduled__2024-04-28T01:39:00+00:00, run_start_date=2024-04-28 01:40:00.787104+00:00, run_end_date=2024-04-28 01:40:09.594127+00:00, run_duration=8.807023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:39:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:40:09.623559830Z [2024-04-28T01:40:09.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:41:00+00:00 2024-04-28T01:40:09.729199698Z [2024-04-28T01:40:09.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:09.734777105Z [2024-04-28T01:40:09.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:39:00+00:00, map_index=-1, run_start_date=2024-04-28 01:40:04.789276+00:00, run_end_date=2024-04-28 01:40:08.475382+00:00, run_duration=3.686106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:00.936211+00:00, queued_by_job_id=1, pid=568 2024-04-28T01:40:11.252673275Z [2024-04-28T01:40:11.252+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:40:11.252740636Z 2024-04-28T01:40:11.252767729Z [2024-04-28T01:40:11.252+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:40:11.253253816Z [2024-04-28T01:40:11.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:40:11.253269550Z 2024-04-28T01:40:11.255788145Z [2024-04-28T01:40:11.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:40:11.255935492Z [2024-04-28T01:40:11.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:40:11.329257156Z [2024-04-28T01:40:11.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:11.329815284Z [2024-04-28T01:40:11.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:11.334818455Z [2024-04-28T01:40:11.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=2024-04-28 01:40:09.965115+00:00, run_end_date=2024-04-28 01:40:10.349155+00:00, run_duration=0.38404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:08.191244+00:00, queued_by_job_id=1, pid=667 2024-04-28T01:40:11.335105317Z [2024-04-28T01:40:11.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51ee4980-1f5c-4a0f-846a-ae3a83d26713 2024-04-28T01:40:14.413668536Z [2024-04-28T01:40:14.413+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:40:14.413696076Z 2024-04-28T01:40:14.414258104Z [2024-04-28T01:40:14.414+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:40:14.415027186Z [2024-04-28T01:40:14.414+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:40:14.415039347Z 2024-04-28T01:40:14.417623064Z [2024-04-28T01:40:14.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:14.417902265Z [2024-04-28T01:40:14.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:40:14.480045784Z [2024-04-28T01:40:14.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:40:14.480126621Z [2024-04-28T01:40:14.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:14.485474392Z [2024-04-28T01:40:14.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=0, run_start_date=2024-04-28 01:40:12.906763+00:00, run_end_date=2024-04-28 01:40:13.242502+00:00, run_duration=0.335739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:11.253529+00:00, queued_by_job_id=1, pid=679 2024-04-28T01:40:14.485915987Z [2024-04-28T01:40:14.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to f47deda7-a71c-45d4-9f24-b799ecdd48c9 2024-04-28T01:40:17.086470054Z [2024-04-28T01:40:17.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:40:17.087080086Z [2024-04-28T01:40:17.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:35:00+00:00, run_id=scheduled__2024-04-28T01:35:00+00:00, run_start_date=2024-04-28 01:40:00.770980+00:00, run_end_date=2024-04-28 01:40:17.086339+00:00, run_duration=16.315359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:35:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T01:40:17.093092127Z [2024-04-28T01:40:17.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:40:17.129352847Z [2024-04-28T01:40:17.128+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:40:17.129419583Z 2024-04-28T01:40:17.129429227Z 2024-04-28T01:40:17.129436941Z [2024-04-28T01:40:17.129+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:40:17.129444528Z [2024-04-28T01:40:17.129+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:40:17.129912905Z [2024-04-28T01:40:17.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:40:17.129935176Z 2024-04-28T01:40:17.129939422Z 2024-04-28T01:40:17.132125570Z [2024-04-28T01:40:17.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:40:17.132139261Z [2024-04-28T01:40:17.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:40:17.132423397Z [2024-04-28T01:40:17.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:17.132582347Z [2024-04-28T01:40:17.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:40:17.329122805Z [2024-04-28T01:40:17.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 2 2024-04-28T01:40:17.329449397Z [2024-04-28T01:40:17.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status queued for try_number 2 2024-04-28T01:40:17.329728271Z [2024-04-28T01:40:17.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:40:17.337541704Z [2024-04-28T01:40:17.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=2024-04-28 01:40:16.126263+00:00, run_end_date=2024-04-28 01:40:16.502899+00:00, run_duration=0.376636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:14.415426+00:00, queued_by_job_id=1, pid=691 2024-04-28T01:40:17.337893616Z [2024-04-28T01:40:17.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to a99b78f4-17fa-43cf-a798-db8cbfbd15f1 2024-04-28T01:40:17.338109913Z [2024-04-28T01:40:17.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 229cf25e-a1c6-4925-ad9a-77f92ee8757e 2024-04-28T01:40:17.407848481Z [2024-04-28T01:40:17.407+0000] {dagbag.py:207} WARNING - Serialized DAG vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 no longer exists 2024-04-28T01:40:17.408043499Z [2024-04-28T01:40:17.407+0000] {scheduler_job.py:970} ERROR - DAG 'vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13' not found in serialized_dag table 2024-04-28T01:40:18.537916216Z [2024-04-28T01:40:18.537+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:40:18.537940970Z 2024-04-28T01:40:18.538187061Z [2024-04-28T01:40:18.537+0000] {scheduler_job.py:425} INFO - DAG vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:40:18.538726986Z [2024-04-28T01:40:18.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:40:18.538771180Z 2024-04-28T01:40:18.540670733Z [2024-04-28T01:40:18.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:40:18.540923618Z [2024-04-28T01:40:18.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:40:18.599007879Z [2024-04-28T01:40:18.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status queued for try_number 2 2024-04-28T01:40:18.604960075Z [2024-04-28T01:40:18.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fa90928-b708-4583-864b-b9d33ccc50af 2024-04-28T01:40:18.708755783Z [2024-04-28T01:40:18.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status failed for try_number 2 2024-04-28T01:40:18.716832415Z [2024-04-28T01:40:18.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:40:06.050927+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:17.130354+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:40:18.717326467Z [2024-04-28T01:40:18.717+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:18.719586140Z [2024-04-28T01:40:18.719+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:18.732534977Z [2024-04-28T01:40:18.732+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T013900, start_date=, end_date=20240428T014018 2024-04-28T01:40:19.797770459Z [2024-04-28T01:40:19.797+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:40:19.798217593Z [2024-04-28T01:40:19.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:39:00+00:00, run_id=scheduled__2024-04-28T01:39:00+00:00, run_start_date=2024-04-28 01:40:00.789329+00:00, run_end_date=2024-04-28 01:40:19.797630+00:00, run_duration=19.008301, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:39:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=60a3f87a4265272532e40b0e2bdcface 2024-04-28T01:40:19.810524874Z [2024-04-28T01:40:19.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:41:00+00:00 2024-04-28T01:40:19.843405732Z [2024-04-28T01:40:19.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status failed for try_number 2 2024-04-28T01:40:19.849291174Z [2024-04-28T01:40:19.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:40:05.998104+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:17.130354+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:40:19.849670221Z [2024-04-28T01:40:19.849+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:19.859974164Z [2024-04-28T01:40:19.857+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-28T01:40:19.859992963Z Traceback (most recent call last): 2024-04-28T01:40:19.859997334Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-28T01:40:19.860000559Z task = dag.get_task(ti.task_id) 2024-04-28T01:40:19.860004344Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-28T01:40:20.232074063Z [2024-04-28T01:40:20.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:39:00+00:00 exited with status failed for try_number 2 2024-04-28T01:40:20.239075340Z [2024-04-28T01:40:20.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:40:08.313767+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:40:18.539033+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:40:20.239709669Z [2024-04-28T01:40:20.239+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:20.242201512Z [2024-04-28T01:40:20.241+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:40:20.256556772Z [2024-04-28T01:40:20.256+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T013900, start_date=, end_date=20240428T014020 2024-04-28T01:40:21.327142000Z [2024-04-28T01:40:21.326+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:40:21.327594749Z [2024-04-28T01:40:21.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:39:00+00:00, run_id=scheduled__2024-04-28T01:39:00+00:00, run_start_date=2024-04-28 01:40:00.792111+00:00, run_end_date=2024-04-28 01:40:21.327034+00:00, run_duration=20.534923, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:39:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=ffcdb74bbc68850d1ba99d5912733972 2024-04-28T01:40:21.343605724Z [2024-04-28T01:40:21.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:41:00+00:00 2024-04-28T01:41:00.104064619Z [2024-04-28T01:41:00.103+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:41:00.118682419Z [2024-04-28T01:41:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:41:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:41:00.132105384Z [2024-04-28T01:41:00.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:41:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:41:00.138968994Z [2024-04-28T01:41:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:41:00.224553340Z [2024-04-28T01:41:00.224+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T01:41:00.224582797Z 2024-04-28T01:41:00.224587991Z 2024-04-28T01:41:00.224592537Z 2024-04-28T01:41:00.224596735Z 2024-04-28T01:41:00.224610005Z [2024-04-28T01:41:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:41:00.224710081Z [2024-04-28T01:41:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:41:00.224877720Z [2024-04-28T01:41:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:41:00.224960996Z [2024-04-28T01:41:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:41:00.225576532Z [2024-04-28T01:41:00.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:41:00.225588390Z 2024-04-28T01:41:00.225611225Z 2024-04-28T01:41:00.225615871Z 2024-04-28T01:41:00.225620170Z 2024-04-28T01:41:00.229976513Z [2024-04-28T01:41:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:41:00.230053624Z [2024-04-28T01:41:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:41:00.230338040Z [2024-04-28T01:41:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:41:00.230456935Z [2024-04-28T01:41:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:41:00.230646167Z [2024-04-28T01:41:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:41:00.230725604Z [2024-04-28T01:41:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:41:00.230893713Z [2024-04-28T01:41:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:41:00.230969548Z [2024-04-28T01:41:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:41:00.635369331Z [2024-04-28T01:41:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:41:00.635545556Z [2024-04-28T01:41:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:41:00.635767164Z [2024-04-28T01:41:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:41:00.636147296Z [2024-04-28T01:41:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:41:00.664607002Z [2024-04-28T01:41:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4797c22c-7368-4b0e-9a2f-0d9966ed8ef5 2024-04-28T01:41:00.667125786Z [2024-04-28T01:41:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ea43e8d-6212-4790-8702-5675a47ef9f7 2024-04-28T01:41:00.667332570Z [2024-04-28T01:41:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 640133a6-f901-4285-88ed-daab561dec8f 2024-04-28T01:41:00.667506178Z [2024-04-28T01:41:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49a34304-bc2a-4a74-a400-fe18145c6c0a 2024-04-28T01:41:03.045815102Z [2024-04-28T01:41:03.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status failed for try_number 1 2024-04-28T01:41:03.045969155Z [2024-04-28T01:41:03.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status failed for try_number 1 2024-04-28T01:41:03.057023986Z [2024-04-28T01:41:03.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:41:00.226457+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:41:03.057537716Z [2024-04-28T01:41:03.057+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:03.061128878Z [2024-04-28T01:41:03.060+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:03.075017146Z [2024-04-28T01:41:03.074+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T014000, start_date=, end_date=20240428T014103 2024-04-28T01:41:03.083074999Z [2024-04-28T01:41:03.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:41:00.226457+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:41:03.083486014Z [2024-04-28T01:41:03.083+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:03.086767249Z [2024-04-28T01:41:03.086+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:03.098273354Z [2024-04-28T01:41:03.097+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T014000, start_date=, end_date=20240428T014103 2024-04-28T01:41:03.789013168Z [2024-04-28T01:41:03.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:41:03.789370404Z [2024-04-28T01:41:03.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:41:00.151499+00:00, run_end_date=2024-04-28 01:41:03.789004+00:00, run_duration=3.637505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:41:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:41:03.799211585Z [2024-04-28T01:41:03.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:41:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:41:04.920482888Z [2024-04-28T01:41:04.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:41:04.920769569Z [2024-04-28T01:41:04.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:41:00.148910+00:00, run_end_date=2024-04-28 01:41:04.920447+00:00, run_duration=4.771537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:41:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:41:04.954524202Z [2024-04-28T01:41:04.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:41:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:41:05.017466315Z [2024-04-28T01:41:05.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:41:05.017842824Z [2024-04-28T01:41:05.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:41:05.035231271Z [2024-04-28T01:41:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=2024-04-28 01:41:02.333002+00:00, run_end_date=2024-04-28 01:41:04.314964+00:00, run_duration=1.981962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:41:00.226457+00:00, queued_by_job_id=1, pid=824 2024-04-28T01:41:05.035637678Z [2024-04-28T01:41:05.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=2024-04-28 01:41:02.350225+00:00, run_end_date=2024-04-28 01:41:03.745980+00:00, run_duration=1.395755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:41:00.226457+00:00, queued_by_job_id=1, pid=825 2024-04-28T01:41:13.315435949Z [2024-04-28T01:41:13.315+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:41:13.315507916Z 2024-04-28T01:41:13.315517028Z 2024-04-28T01:41:13.315537850Z [2024-04-28T01:41:13.315+0000] {scheduler_job.py:425} INFO - DAG vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:41:13.315754897Z [2024-04-28T01:41:13.315+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 has 0/16 running and queued tasks 2024-04-28T01:41:13.316316084Z [2024-04-28T01:41:13.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:41:13.316329517Z 2024-04-28T01:41:13.316337380Z 2024-04-28T01:41:13.318824434Z [2024-04-28T01:41:13.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:41:13.318869378Z [2024-04-28T01:41:13.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:41:13.319115018Z [2024-04-28T01:41:13.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:41:13.319152847Z [2024-04-28T01:41:13.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:41:13.481108216Z [2024-04-28T01:41:13.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 2 2024-04-28T01:41:13.481196703Z [2024-04-28T01:41:13.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 2 2024-04-28T01:41:13.488161274Z [2024-04-28T01:41:13.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ef09cbd-fd53-45d3-b5d6-c47b0113766e 2024-04-28T01:41:13.488245182Z [2024-04-28T01:41:13.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dae2895-36f3-4cd3-a19c-e6fc1c40b84e 2024-04-28T01:41:15.439669358Z [2024-04-28T01:41:15.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status failed for try_number 2 2024-04-28T01:41:15.439695692Z [2024-04-28T01:41:15.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status failed for try_number 2 2024-04-28T01:41:15.450598816Z [2024-04-28T01:41:15.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:41:03.063804+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:41:13.316829+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:41:15.451190522Z [2024-04-28T01:41:15.450+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:15.453426657Z [2024-04-28T01:41:15.453+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:15.474868322Z [2024-04-28T01:41:15.474+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T014000, start_date=, end_date=20240428T014115 2024-04-28T01:41:15.483533930Z [2024-04-28T01:41:15.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:41:03.088922+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:41:13.316829+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:41:15.484132386Z [2024-04-28T01:41:15.483+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:15.486595089Z [2024-04-28T01:41:15.486+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:41:15.498733293Z [2024-04-28T01:41:15.498+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T014000, start_date=, end_date=20240428T014115 2024-04-28T01:41:15.517317736Z [2024-04-28T01:41:15.516+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T01:41:16.121542539Z [2024-04-28T01:41:16.120+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:41:16.121565672Z [2024-04-28T01:41:16.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:41:00.150399+00:00, run_end_date=2024-04-28 01:41:16.121043+00:00, run_duration=15.970644, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:41:00+00:00, dag_hash=ffcdb74bbc68850d1ba99d5912733972 2024-04-28T01:41:16.142219628Z [2024-04-28T01:41:16.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:41:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:41:16.149569574Z [2024-04-28T01:41:16.149+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:41:16.150857034Z [2024-04-28T01:41:16.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:41:00.152681+00:00, run_end_date=2024-04-28 01:41:16.150526+00:00, run_duration=15.997845, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:41:00+00:00, dag_hash=60a3f87a4265272532e40b0e2bdcface 2024-04-28T01:41:16.164081855Z [2024-04-28T01:41:16.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f80b1c1d-fc9e-4ace-8b0e-934c37981a13 to 2024-04-28T01:41:00+00:00, run_after=2024-04-28T01:42:00+00:00 2024-04-28T01:42:00.219030474Z [2024-04-28T01:42:00.218+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:42:00.226257925Z [2024-04-28T01:42:00.225+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:42:00.239113730Z [2024-04-28T01:42:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:43:00+00:00 2024-04-28T01:42:00.330875083Z [2024-04-28T01:42:00.329+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:42:00.330916008Z 2024-04-28T01:42:00.330931298Z 2024-04-28T01:42:00.330940693Z 2024-04-28T01:42:00.331561921Z [2024-04-28T01:42:00.331+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:42:00.331978003Z [2024-04-28T01:42:00.331+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:42:00.332396657Z [2024-04-28T01:42:00.332+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:42:00.334677716Z [2024-04-28T01:42:00.334+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:00.334702938Z 2024-04-28T01:42:00.334713267Z 2024-04-28T01:42:00.334722107Z 2024-04-28T01:42:00.343511229Z [2024-04-28T01:42:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:42:00.343790661Z [2024-04-28T01:42:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:42:00.344145221Z [2024-04-28T01:42:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:42:00.344432662Z [2024-04-28T01:42:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:42:00.344753616Z [2024-04-28T01:42:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:42:00.344988387Z [2024-04-28T01:42:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:42:00.635067521Z [2024-04-28T01:42:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:00.635494570Z [2024-04-28T01:42:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:00.635731517Z [2024-04-28T01:42:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:00.642959350Z [2024-04-28T01:42:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1499e7b-9cf1-4a91-82ab-6e92f6683c8f 2024-04-28T01:42:00.643199974Z [2024-04-28T01:42:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fd78a1d-e245-4a93-90ea-c8e7dca87c2b 2024-04-28T01:42:00.643446765Z [2024-04-28T01:42:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to caae9440-e736-4012-b797-6fe3689a54fc 2024-04-28T01:42:02.165071131Z [2024-04-28T01:42:02.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:42:02.165567414Z [2024-04-28T01:42:02.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:42:00.247978+00:00, run_end_date=2024-04-28 01:42:02.164945+00:00, run_duration=1.916967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:42:02.173947242Z [2024-04-28T01:42:02.173+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:42:02.230954687Z [2024-04-28T01:42:02.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:02.237488862Z [2024-04-28T01:42:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:01.054533+00:00, run_end_date=2024-04-28 01:42:01.500816+00:00, run_duration=0.446283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:00.337016+00:00, queued_by_job_id=1, pid=890 2024-04-28T01:42:04.104693937Z [2024-04-28T01:42:04.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:42:04.105554085Z [2024-04-28T01:42:04.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:41:00+00:00, run_id=scheduled__2024-04-28T01:41:00+00:00, run_start_date=2024-04-28 01:42:00.250248+00:00, run_end_date=2024-04-28 01:42:04.104623+00:00, run_duration=3.854375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:41:00+00:00, data_interval_end=2024-04-28 01:42:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:42:04.117993605Z [2024-04-28T01:42:04.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:43:00+00:00 2024-04-28T01:42:04.153542490Z [2024-04-28T01:42:04.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:04.158560646Z [2024-04-28T01:42:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:41:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:02.329992+00:00, run_end_date=2024-04-28 01:42:03.661798+00:00, run_duration=1.331806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:00.337016+00:00, queued_by_job_id=1, pid=930 2024-04-28T01:42:05.368042250Z [2024-04-28T01:42:05.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:42:05.368528160Z [2024-04-28T01:42:05.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:41:00+00:00, run_id=scheduled__2024-04-28T01:41:00+00:00, run_start_date=2024-04-28 01:42:00.249215+00:00, run_end_date=2024-04-28 01:42:05.368174+00:00, run_duration=5.118959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:41:00+00:00, data_interval_end=2024-04-28 01:42:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:42:05.377460660Z [2024-04-28T01:42:05.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:43:00+00:00 2024-04-28T01:42:05.426938571Z [2024-04-28T01:42:05.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:05.438676189Z [2024-04-28T01:42:05.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:41:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:02.470588+00:00, run_end_date=2024-04-28 01:42:04.294770+00:00, run_duration=1.824182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:00.337016+00:00, queued_by_job_id=1, pid=931 2024-04-28T01:42:08.619755960Z [2024-04-28T01:42:08.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:43:00+00:00 2024-04-28T01:42:08.692585650Z [2024-04-28T01:42:08.692+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:42:08.692634635Z 2024-04-28T01:42:08.692662011Z [2024-04-28T01:42:08.692+0000] {scheduler_job.py:425} INFO - DAG vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:42:08.693903048Z [2024-04-28T01:42:08.693+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:08.693918421Z 2024-04-28T01:42:08.698340064Z [2024-04-28T01:42:08.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:42:08.698533315Z [2024-04-28T01:42:08.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:42:08.774839078Z [2024-04-28T01:42:08.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:08.788868941Z [2024-04-28T01:42:08.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57b959fe-7008-4ee1-b510-be10b9d7e880 2024-04-28T01:42:10.468737919Z [2024-04-28T01:42:10.468+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:42:10.506661836Z [2024-04-28T01:42:10.506+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:42:10.506685314Z 2024-04-28T01:42:10.506689002Z [2024-04-28T01:42:10.506+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:42:10.507206433Z [2024-04-28T01:42:10.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:10.507216175Z 2024-04-28T01:42:10.509053744Z [2024-04-28T01:42:10.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:42:10.509137352Z [2024-04-28T01:42:10.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:42:10.561485233Z [2024-04-28T01:42:10.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:10.568187536Z [2024-04-28T01:42:10.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 163355e5-bfa8-469a-aaf6-7c3873854796 2024-04-28T01:42:12.275550819Z [2024-04-28T01:42:12.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:42:12.275903875Z [2024-04-28T01:42:12.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:41:00+00:00, run_id=scheduled__2024-04-28T01:41:00+00:00, run_start_date=2024-04-28 01:42:08.640958+00:00, run_end_date=2024-04-28 01:42:12.275529+00:00, run_duration=3.634571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:41:00+00:00, data_interval_end=2024-04-28 01:42:00+00:00, dag_hash=2c65a99bd5de6e9650b3e00d0e3f40c0 2024-04-28T01:42:12.286625512Z [2024-04-28T01:42:12.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:43:00+00:00 2024-04-28T01:42:12.323655577Z [2024-04-28T01:42:12.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:12.328609675Z [2024-04-28T01:42:12.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:41:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:10.499998+00:00, run_end_date=2024-04-28 01:42:11.760847+00:00, run_duration=1.260849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:08.694584+00:00, queued_by_job_id=1, pid=964 2024-04-28T01:42:14.465566664Z [2024-04-28T01:42:14.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:42:14.465850607Z [2024-04-28T01:42:14.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:41:00+00:00, run_id=scheduled__2024-04-28T01:41:00+00:00, run_start_date=2024-04-28 01:42:10.477484+00:00, run_end_date=2024-04-28 01:42:14.465373+00:00, run_duration=3.987889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:41:00+00:00, data_interval_end=2024-04-28 01:42:00+00:00, dag_hash=71d7a5a793239695907115bc66a3b263 2024-04-28T01:42:14.474691112Z [2024-04-28T01:42:14.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:42:00+00:00, run_after=2024-04-28T01:43:00+00:00 2024-04-28T01:42:14.504999203Z [2024-04-28T01:42:14.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:41:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:14.514002748Z [2024-04-28T01:42:14.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:41:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:12.123075+00:00, run_end_date=2024-04-28 01:42:13.673133+00:00, run_duration=1.550058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:10.507378+00:00, queued_by_job_id=1, pid=984 2024-04-28T01:42:18.339422845Z [2024-04-28T01:42:18.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:42:18.395562611Z [2024-04-28T01:42:18.394+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:42:18.395603474Z 2024-04-28T01:42:18.395614140Z [2024-04-28T01:42:18.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:42:18.396409189Z [2024-04-28T01:42:18.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:18.396430524Z 2024-04-28T01:42:18.399348047Z [2024-04-28T01:42:18.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:42:18.399419774Z [2024-04-28T01:42:18.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:42:18.464238767Z [2024-04-28T01:42:18.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:18.470170886Z [2024-04-28T01:42:18.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5708eeed-3b14-4215-828d-3467b59c74b4 2024-04-28T01:42:20.705177798Z [2024-04-28T01:42:20.704+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:42:20.705220581Z 2024-04-28T01:42:20.705644746Z [2024-04-28T01:42:20.705+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:42:20.707626165Z [2024-04-28T01:42:20.707+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:20.707643446Z 2024-04-28T01:42:20.714046757Z [2024-04-28T01:42:20.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='split_metrics', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:42:20.714315701Z [2024-04-28T01:42:20.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'split_metrics', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:42:20.765154776Z [2024-04-28T01:42:20.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.split_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:20.765644042Z [2024-04-28T01:42:20.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:20.773949818Z [2024-04-28T01:42:20.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:20.154326+00:00, run_end_date=2024-04-28 01:42:20.543443+00:00, run_duration=0.389117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:18.396771+00:00, queued_by_job_id=1, pid=1005 2024-04-28T01:42:20.774537030Z [2024-04-28T01:42:20.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to bed3b01b-e89d-45f3-92a1-0218343427e3 2024-04-28T01:42:23.500281703Z [2024-04-28T01:42:23.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:42:23.500317919Z 2024-04-28T01:42:23.500548880Z [2024-04-28T01:42:23.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:42:23.501220776Z [2024-04-28T01:42:23.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:23.501232526Z 2024-04-28T01:42:23.503620935Z [2024-04-28T01:42:23.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:42:23.503895218Z [2024-04-28T01:42:23.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'collect_metrics', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:42:23.567655413Z [2024-04-28T01:42:23.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.collect_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:23.567959989Z [2024-04-28T01:42:23.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.split_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:23.577925790Z [2024-04-28T01:42:23.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to f396ecfa-e82f-4f6f-83e1-ebaa26e60937 2024-04-28T01:42:23.578421327Z [2024-04-28T01:42:23.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=split_metrics, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:22.371006+00:00, run_end_date=2024-04-28 01:42:22.780969+00:00, run_duration=0.409963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:20.708594+00:00, queued_by_job_id=1, pid=1026 2024-04-28T01:42:26.923601394Z [2024-04-28T01:42:26.923+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:42:26.923648062Z 2024-04-28T01:42:26.923769081Z [2024-04-28T01:42:26.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:42:26.924422669Z [2024-04-28T01:42:26.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:42:26.924435428Z 2024-04-28T01:42:26.926916800Z [2024-04-28T01:42:26.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:42:26.927102580Z [2024-04-28T01:42:26.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'send_prometheus', 'scheduled__2024-04-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:42:26.978592420Z [2024-04-28T01:42:26.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.send_prometheus run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status queued for try_number 1 2024-04-28T01:42:26.979003510Z [2024-04-28T01:42:26.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.collect_metrics run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:26.990317169Z [2024-04-28T01:42:26.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=0, run_start_date=2024-04-28 01:42:25.260810+00:00, run_end_date=2024-04-28 01:42:25.766832+00:00, run_duration=0.506022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:23.501560+00:00, queued_by_job_id=1, pid=1038 2024-04-28T01:42:26.990870549Z [2024-04-28T01:42:26.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 045649b5-a0c1-484b-875d-9c3717bc6545 2024-04-28T01:42:29.207200611Z [2024-04-28T01:42:29.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:42:29.207483069Z [2024-04-28T01:42:29.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:35:00+00:00, run_id=scheduled__2024-04-28T01:35:00+00:00, run_start_date=2024-04-28 01:42:18.351285+00:00, run_end_date=2024-04-28 01:42:29.207059+00:00, run_duration=10.855774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:35:00+00:00, data_interval_end=2024-04-28 01:40:00+00:00, dag_hash=d9a750100930e6d293917e3c9247e52e 2024-04-28T01:42:29.216886454Z [2024-04-28T01:42:29.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:40:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:42:29.251599179Z [2024-04-28T01:42:29.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.send_prometheus run_id=scheduled__2024-04-28T01:35:00+00:00 exited with status success for try_number 1 2024-04-28T01:42:29.259380396Z [2024-04-28T01:42:29.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:35:00+00:00, map_index=-1, run_start_date=2024-04-28 01:42:28.585400+00:00, run_end_date=2024-04-28 01:42:28.929576+00:00, run_duration=0.344176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:42:26.924751+00:00, queued_by_job_id=1, pid=1050 2024-04-28T01:43:00.239269696Z [2024-04-28T01:43:00.238+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:43:00.250711063Z [2024-04-28T01:43:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:43:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:43:00.256864085Z [2024-04-28T01:43:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:43:00.267602399Z [2024-04-28T01:43:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:43:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:43:00.342524572Z [2024-04-28T01:43:00.340+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T01:43:00.342598948Z 2024-04-28T01:43:00.342610510Z 2024-04-28T01:43:00.342619211Z 2024-04-28T01:43:00.342627687Z 2024-04-28T01:43:00.342636018Z [2024-04-28T01:43:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:43:00.342644385Z [2024-04-28T01:43:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:43:00.342652735Z [2024-04-28T01:43:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:43:00.342661160Z [2024-04-28T01:43:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:43:00.344171368Z [2024-04-28T01:43:00.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:43:00.344196796Z 2024-04-28T01:43:00.344205010Z 2024-04-28T01:43:00.344212272Z 2024-04-28T01:43:00.344219360Z 2024-04-28T01:43:00.352188396Z [2024-04-28T01:43:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:43:00.352568321Z [2024-04-28T01:43:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:43:00.353075411Z [2024-04-28T01:43:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:43:00.353415322Z [2024-04-28T01:43:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:43:00.353910104Z [2024-04-28T01:43:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:43:00.354039013Z [2024-04-28T01:43:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:43:00.354577027Z [2024-04-28T01:43:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:43:00.354597275Z [2024-04-28T01:43:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:43:00.635958380Z [2024-04-28T01:43:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status queued for try_number 1 2024-04-28T01:43:00.636247821Z [2024-04-28T01:43:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status queued for try_number 1 2024-04-28T01:43:00.636447027Z [2024-04-28T01:43:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status queued for try_number 1 2024-04-28T01:43:00.636649565Z [2024-04-28T01:43:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status queued for try_number 1 2024-04-28T01:43:00.648262764Z [2024-04-28T01:43:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd20e3e6-840e-45ec-8003-108b3358dd58 2024-04-28T01:43:00.648633919Z [2024-04-28T01:43:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08bff79c-51df-40a8-a2e7-8e121b977314 2024-04-28T01:43:00.648936524Z [2024-04-28T01:43:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23410779-10d2-4e02-9d64-496b0c9484fa 2024-04-28T01:43:00.649221264Z [2024-04-28T01:43:00.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb6dfb44-f903-4b81-b625-d9f3e86dd900 2024-04-28T01:43:04.433419106Z [2024-04-28T01:43:04.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:43:04.433629008Z [2024-04-28T01:43:04.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:42:00+00:00, run_id=scheduled__2024-04-28T01:42:00+00:00, run_start_date=2024-04-28 01:43:00.279199+00:00, run_end_date=2024-04-28 01:43:04.433338+00:00, run_duration=4.154139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:42:00+00:00, data_interval_end=2024-04-28 01:43:00+00:00, dag_hash=2c65a99bd5de6e9650b3e00d0e3f40c0 2024-04-28T01:43:04.445078971Z [2024-04-28T01:43:04.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:43:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:43:04.516949606Z [2024-04-28T01:43:04.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status success for try_number 1 2024-04-28T01:43:04.522084154Z [2024-04-28T01:43:04.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:42:00+00:00, map_index=-1, run_start_date=2024-04-28 01:43:02.504451+00:00, run_end_date=2024-04-28 01:43:04.259777+00:00, run_duration=1.755326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:43:00.346707+00:00, queued_by_job_id=1, pid=1096 2024-04-28T01:43:05.561556229Z [2024-04-28T01:43:05.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:43:05.564060483Z [2024-04-28T01:43:05.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:42:00+00:00, run_id=scheduled__2024-04-28T01:42:00+00:00, run_start_date=2024-04-28 01:43:00.280186+00:00, run_end_date=2024-04-28 01:43:05.561447+00:00, run_duration=5.281261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:42:00+00:00, data_interval_end=2024-04-28 01:43:00+00:00, dag_hash=71d7a5a793239695907115bc66a3b263 2024-04-28T01:43:05.572318784Z [2024-04-28T01:43:05.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:43:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:43:05.581255373Z [2024-04-28T01:43:05.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:43:05.581584379Z [2024-04-28T01:43:05.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:42:00+00:00, run_id=scheduled__2024-04-28T01:42:00+00:00, run_start_date=2024-04-28 01:43:00.281838+00:00, run_end_date=2024-04-28 01:43:05.581173+00:00, run_duration=5.299335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:42:00+00:00, data_interval_end=2024-04-28 01:43:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:43:05.591858482Z [2024-04-28T01:43:05.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:43:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:43:05.659480601Z [2024-04-28T01:43:05.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status success for try_number 1 2024-04-28T01:43:05.659875312Z [2024-04-28T01:43:05.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status success for try_number 1 2024-04-28T01:43:05.667822507Z [2024-04-28T01:43:05.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:42:00+00:00, map_index=-1, run_start_date=2024-04-28 01:43:02.916748+00:00, run_end_date=2024-04-28 01:43:04.846134+00:00, run_duration=1.929386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:43:00.346707+00:00, queued_by_job_id=1, pid=1114 2024-04-28T01:43:05.668131486Z [2024-04-28T01:43:05.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:42:00+00:00, map_index=-1, run_start_date=2024-04-28 01:43:02.535609+00:00, run_end_date=2024-04-28 01:43:04.686269+00:00, run_duration=2.15066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:43:00.346707+00:00, queued_by_job_id=1, pid=1097 2024-04-28T01:43:06.729312753Z [2024-04-28T01:43:06.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:43:06.729814613Z [2024-04-28T01:43:06.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:42:00+00:00, run_id=scheduled__2024-04-28T01:42:00+00:00, run_start_date=2024-04-28 01:43:00.278023+00:00, run_end_date=2024-04-28 01:43:06.729164+00:00, run_duration=6.451141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:42:00+00:00, data_interval_end=2024-04-28 01:43:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:43:06.738322314Z [2024-04-28T01:43:06.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:43:00+00:00, run_after=2024-04-28T01:44:00+00:00 2024-04-28T01:43:06.768752185Z [2024-04-28T01:43:06.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status success for try_number 1 2024-04-28T01:43:06.774742965Z [2024-04-28T01:43:06.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:42:00+00:00, map_index=-1, run_start_date=2024-04-28 01:43:02.836987+00:00, run_end_date=2024-04-28 01:43:05.674445+00:00, run_duration=2.837458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:43:00.346707+00:00, queued_by_job_id=1, pid=1107 2024-04-28T01:44:00.644390420Z [2024-04-28T01:44:00.643+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:44:00.655657700Z [2024-04-28T01:44:00.655+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:44:00.676630625Z [2024-04-28T01:44:00.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:44:00.692399580Z [2024-04-28T01:44:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:44:00.701509229Z [2024-04-28T01:44:00.701+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:44:00.822055773Z [2024-04-28T01:44:00.821+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-28T01:44:00.822137900Z 2024-04-28T01:44:00.822150137Z 2024-04-28T01:44:00.822158880Z 2024-04-28T01:44:00.822228172Z 2024-04-28T01:44:00.822250334Z 2024-04-28T01:44:00.822337682Z [2024-04-28T01:44:00.821+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:44:00.822358827Z [2024-04-28T01:44:00.822+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:44:00.822486224Z [2024-04-28T01:44:00.822+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:44:00.822641221Z [2024-04-28T01:44:00.822+0000] {scheduler_job.py:425} INFO - DAG vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:44:00.822886002Z [2024-04-28T01:44:00.822+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:44:00.823644753Z [2024-04-28T01:44:00.823+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:44:00.823657126Z 2024-04-28T01:44:00.823661502Z 2024-04-28T01:44:00.823665009Z 2024-04-28T01:44:00.823668425Z 2024-04-28T01:44:00.823671972Z 2024-04-28T01:44:00.830713370Z [2024-04-28T01:44:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:44:00.830811305Z [2024-04-28T01:44:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:44:00.831071144Z [2024-04-28T01:44:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:44:00.831301710Z [2024-04-28T01:44:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:44:00.831604690Z [2024-04-28T01:44:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:44:00.831816275Z [2024-04-28T01:44:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:44:00.832129580Z [2024-04-28T01:44:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:44:00.832342528Z [2024-04-28T01:44:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:44:00.832621901Z [2024-04-28T01:44:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:44:00.832822920Z [2024-04-28T01:44:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:44:01.443234465Z [2024-04-28T01:44:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status queued for try_number 1 2024-04-28T01:44:01.445958305Z [2024-04-28T01:44:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status queued for try_number 1 2024-04-28T01:44:01.446088050Z [2024-04-28T01:44:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status queued for try_number 1 2024-04-28T01:44:01.446224010Z [2024-04-28T01:44:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status queued for try_number 1 2024-04-28T01:44:01.446332971Z [2024-04-28T01:44:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status queued for try_number 1 2024-04-28T01:44:01.469712149Z [2024-04-28T01:44:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to afa08b20-9e17-47cf-800c-c34cc401fad3 2024-04-28T01:44:01.469887788Z [2024-04-28T01:44:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8460cdf-08a9-4338-af03-e04c3a3897be 2024-04-28T01:44:01.470073315Z [2024-04-28T01:44:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c670848-e3b6-464a-b134-03a44767bae1 2024-04-28T01:44:01.470233534Z [2024-04-28T01:44:01.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b2c2b1e-8b21-498f-b011-fa956576654e 2024-04-28T01:44:01.470439519Z [2024-04-28T01:44:01.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a935953-21e6-4790-b537-f0c5981d9297 2024-04-28T01:44:03.386003106Z [2024-04-28T01:44:03.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:44:03.386275913Z [2024-04-28T01:44:03.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:42:00+00:00, run_id=scheduled__2024-04-28T01:42:00+00:00, run_start_date=2024-04-28 01:44:00.727872+00:00, run_end_date=2024-04-28 01:44:03.385929+00:00, run_duration=2.658057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:42:00+00:00, data_interval_end=2024-04-28 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:44:03.396868817Z [2024-04-28T01:44:03.396+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:46:00+00:00 2024-04-28T01:44:03.480563838Z [2024-04-28T01:44:03.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:42:00+00:00 exited with status success for try_number 1 2024-04-28T01:44:03.485319236Z [2024-04-28T01:44:03.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:42:00+00:00, map_index=-1, run_start_date=2024-04-28 01:44:01.947870+00:00, run_end_date=2024-04-28 01:44:02.617570+00:00, run_duration=0.6697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:44:00.824723+00:00, queued_by_job_id=1, pid=1162 2024-04-28T01:44:05.911226714Z [2024-04-28T01:44:05.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:44:05.911624656Z [2024-04-28T01:44:05.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:43:00+00:00, run_id=scheduled__2024-04-28T01:43:00+00:00, run_start_date=2024-04-28 01:44:00.731640+00:00, run_end_date=2024-04-28 01:44:05.911144+00:00, run_duration=5.179504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:43:00+00:00, data_interval_end=2024-04-28 01:44:00+00:00, dag_hash=71d7a5a793239695907115bc66a3b263 2024-04-28T01:44:05.926927592Z [2024-04-28T01:44:05.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:44:05.935133435Z [2024-04-28T01:44:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:44:05.935480130Z [2024-04-28T01:44:05.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:43:00+00:00, run_id=scheduled__2024-04-28T01:43:00+00:00, run_start_date=2024-04-28 01:44:00.733406+00:00, run_end_date=2024-04-28 01:44:05.935066+00:00, run_duration=5.20166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:43:00+00:00, data_interval_end=2024-04-28 01:44:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:44:05.951717197Z [2024-04-28T01:44:05.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:44:05.959065809Z [2024-04-28T01:44:05.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:44:05.959405518Z [2024-04-28T01:44:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:43:00+00:00, run_id=scheduled__2024-04-28T01:43:00+00:00, run_start_date=2024-04-28 01:44:00.735729+00:00, run_end_date=2024-04-28 01:44:05.958990+00:00, run_duration=5.223261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:43:00+00:00, data_interval_end=2024-04-28 01:44:00+00:00, dag_hash=2c65a99bd5de6e9650b3e00d0e3f40c0 2024-04-28T01:44:05.978779212Z [2024-04-28T01:44:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:44:05.988465936Z [2024-04-28T01:44:05.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:44:05.991771219Z [2024-04-28T01:44:05.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:43:00+00:00, run_id=scheduled__2024-04-28T01:43:00+00:00, run_start_date=2024-04-28 01:44:00.737333+00:00, run_end_date=2024-04-28 01:44:05.988375+00:00, run_duration=5.251042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:43:00+00:00, data_interval_end=2024-04-28 01:44:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:44:06.005426246Z [2024-04-28T01:44:06.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:44:00+00:00, run_after=2024-04-28T01:45:00+00:00 2024-04-28T01:44:06.034406737Z [2024-04-28T01:44:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status success for try_number 1 2024-04-28T01:44:06.034560005Z [2024-04-28T01:44:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status success for try_number 1 2024-04-28T01:44:06.034752108Z [2024-04-28T01:44:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status success for try_number 1 2024-04-28T01:44:06.035079289Z [2024-04-28T01:44:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:43:00+00:00 exited with status success for try_number 1 2024-04-28T01:44:06.042333101Z [2024-04-28T01:44:06.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:43:00+00:00, map_index=-1, run_start_date=2024-04-28 01:44:03.435956+00:00, run_end_date=2024-04-28 01:44:05.547571+00:00, run_duration=2.111615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:44:00.824723+00:00, queued_by_job_id=1, pid=1204 2024-04-28T01:44:06.042492226Z [2024-04-28T01:44:06.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:43:00+00:00, map_index=-1, run_start_date=2024-04-28 01:44:03.811169+00:00, run_end_date=2024-04-28 01:44:05.677079+00:00, run_duration=1.86591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:44:00.824723+00:00, queued_by_job_id=1, pid=1226 2024-04-28T01:44:06.042794106Z [2024-04-28T01:44:06.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:43:00+00:00, map_index=-1, run_start_date=2024-04-28 01:44:03.337789+00:00, run_end_date=2024-04-28 01:44:05.053924+00:00, run_duration=1.716135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:44:00.824723+00:00, queued_by_job_id=1, pid=1194 2024-04-28T01:44:06.043057269Z [2024-04-28T01:44:06.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:43:00+00:00, map_index=-1, run_start_date=2024-04-28 01:44:03.754098+00:00, run_end_date=2024-04-28 01:44:05.279610+00:00, run_duration=1.525512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:44:00.824723+00:00, queued_by_job_id=1, pid=1214 2024-04-28T01:45:00.489489732Z [2024-04-28T01:45:00.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:46:00+00:00 2024-04-28T01:45:00.502474130Z [2024-04-28T01:45:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:45:00.509162348Z [2024-04-28T01:45:00.508+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:45:00.515433768Z [2024-04-28T01:45:00.515+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:45:00.534630561Z [2024-04-28T01:45:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:45:00.549566086Z [2024-04-28T01:45:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:46:00+00:00 2024-04-28T01:45:00.667686961Z [2024-04-28T01:45:00.667+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-28T01:45:00.667772660Z 2024-04-28T01:45:00.667783964Z 2024-04-28T01:45:00.667794781Z 2024-04-28T01:45:00.667803264Z 2024-04-28T01:45:00.667811661Z 2024-04-28T01:45:00.667819955Z 2024-04-28T01:45:00.667863747Z [2024-04-28T01:45:00.667+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:45:00.668092821Z [2024-04-28T01:45:00.667+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:45:00.668216687Z [2024-04-28T01:45:00.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:45:00.668368765Z [2024-04-28T01:45:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:45:00.668512426Z [2024-04-28T01:45:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:45:00.668662935Z [2024-04-28T01:45:00.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:45:00.669283386Z [2024-04-28T01:45:00.669+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:45:00.669315374Z 2024-04-28T01:45:00.669364377Z 2024-04-28T01:45:00.669380203Z 2024-04-28T01:45:00.669392586Z 2024-04-28T01:45:00.669402408Z 2024-04-28T01:45:00.669411168Z 2024-04-28T01:45:00.674939559Z [2024-04-28T01:45:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:45:00.676202041Z [2024-04-28T01:45:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:45:00.676467798Z [2024-04-28T01:45:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:45:00.676592077Z [2024-04-28T01:45:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:45:00.676905654Z [2024-04-28T01:45:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:00.677042960Z [2024-04-28T01:45:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:45:00.677318920Z [2024-04-28T01:45:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:00.677457178Z [2024-04-28T01:45:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:45:00.677633969Z [2024-04-28T01:45:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:00.677833219Z [2024-04-28T01:45:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:45:00.678043621Z [2024-04-28T01:45:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:00.678156851Z [2024-04-28T01:45:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:45:01.356918568Z [2024-04-28T01:45:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:01.357185854Z [2024-04-28T01:45:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:01.357464976Z [2024-04-28T01:45:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:01.357598208Z [2024-04-28T01:45:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:01.357729920Z [2024-04-28T01:45:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:01.357903475Z [2024-04-28T01:45:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:01.381372576Z [2024-04-28T01:45:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28dc001d-9b3e-4ad2-8b54-b60945cba7cb 2024-04-28T01:45:01.381545872Z [2024-04-28T01:45:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca32bac6-1d49-4f81-aedf-b3b62768dcf8 2024-04-28T01:45:01.382611482Z [2024-04-28T01:45:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1124727-7684-406b-ba66-26637c01cbc3 2024-04-28T01:45:01.382848689Z [2024-04-28T01:45:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd3958a1-7c9d-4133-afc4-ca7800a00ff5 2024-04-28T01:45:01.383031483Z [2024-04-28T01:45:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to c22c6f2c-1ef3-4188-9322-f5c3cd43be35 2024-04-28T01:45:01.383217740Z [2024-04-28T01:45:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64538177-c2b2-4dd3-84ef-6e1487cdcf60 2024-04-28T01:45:05.067712123Z [2024-04-28T01:45:05.067+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:45:05.067735770Z 2024-04-28T01:45:05.070869344Z [2024-04-28T01:45:05.070+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:45:05.071643119Z [2024-04-28T01:45:05.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:45:05.071655672Z 2024-04-28T01:45:05.079023594Z [2024-04-28T01:45:05.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:45:05.079444150Z [2024-04-28T01:45:05.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:45:05.170220884Z [2024-04-28T01:45:05.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:05.170329697Z [2024-04-28T01:45:05.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status failed for try_number 1 2024-04-28T01:45:05.170338405Z [2024-04-28T01:45:05.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:45:05.170460727Z [2024-04-28T01:45:05.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status failed for try_number 1 2024-04-28T01:45:05.170470156Z [2024-04-28T01:45:05.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status failed for try_number 1 2024-04-28T01:45:05.186416611Z [2024-04-28T01:45:05.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:00.670395+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:45:05.187406283Z [2024-04-28T01:45:05.187+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:05.191223314Z [2024-04-28T01:45:05.190+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:05.218170688Z [2024-04-28T01:45:05.217+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=extract_metrics_from_vnfrs, execution_date=20240428T014000, start_date=, end_date=20240428T014505 2024-04-28T01:45:05.234572919Z [2024-04-28T01:45:05.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:00.670395+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:45:05.234927205Z [2024-04-28T01:45:05.234+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:05.238002849Z [2024-04-28T01:45:05.237+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:05.252539888Z [2024-04-28T01:45:05.252+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T014400, start_date=, end_date=20240428T014505 2024-04-28T01:45:05.261769432Z [2024-04-28T01:45:05.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0dfa943-c6dd-47e7-84c6-a518fb1d2923 2024-04-28T01:45:05.261882285Z [2024-04-28T01:45:05.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=2024-04-28 01:45:03.210529+00:00, run_end_date=2024-04-28 01:45:03.805783+00:00, run_duration=0.595254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:00.670395+00:00, queued_by_job_id=1, pid=1294 2024-04-28T01:45:05.262041997Z [2024-04-28T01:45:05.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:00.670395+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:45:05.262442319Z [2024-04-28T01:45:05.262+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:05.264523684Z [2024-04-28T01:45:05.264+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:05.276160612Z [2024-04-28T01:45:05.275+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T014400, start_date=, end_date=20240428T014505 2024-04-28T01:45:05.325734775Z [2024-04-28T01:45:05.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:45:05.326287834Z [2024-04-28T01:45:05.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:44:00+00:00, run_id=scheduled__2024-04-28T01:44:00+00:00, run_start_date=2024-04-28 01:45:00.565681+00:00, run_end_date=2024-04-28 01:45:05.325915+00:00, run_duration=4.760234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:44:00+00:00, data_interval_end=2024-04-28 01:45:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:45:05.336038317Z [2024-04-28T01:45:05.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:46:00+00:00 2024-04-28T01:45:05.447901254Z [2024-04-28T01:45:05.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status success for try_number 1 2024-04-28T01:45:05.465276246Z [2024-04-28T01:45:05.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=2024-04-28 01:45:03.430471+00:00, run_end_date=2024-04-28 01:45:05.061728+00:00, run_duration=1.631257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:00.670395+00:00, queued_by_job_id=1, pid=1295 2024-04-28T01:45:06.537978793Z [2024-04-28T01:45:06.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:45:06.538424475Z [2024-04-28T01:45:06.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:44:00+00:00, run_id=scheduled__2024-04-28T01:44:00+00:00, run_start_date=2024-04-28 01:45:00.566782+00:00, run_end_date=2024-04-28 01:45:06.537863+00:00, run_duration=5.971081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:44:00+00:00, data_interval_end=2024-04-28 01:45:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:45:06.555493113Z [2024-04-28T01:45:06.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:46:00+00:00 2024-04-28T01:45:06.682218412Z [2024-04-28T01:45:06.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status success for try_number 1 2024-04-28T01:45:06.687575932Z [2024-04-28T01:45:06.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=2024-04-28 01:45:04.105390+00:00, run_end_date=2024-04-28 01:45:06.024132+00:00, run_duration=1.918742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:00.670395+00:00, queued_by_job_id=1, pid=1340 2024-04-28T01:45:08.940764994Z [2024-04-28T01:45:08.940+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:45:08.940849103Z 2024-04-28T01:45:08.941005123Z [2024-04-28T01:45:08.940+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:45:08.942179478Z [2024-04-28T01:45:08.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:45:08.942227273Z 2024-04-28T01:45:08.945434810Z [2024-04-28T01:45:08.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:45:08.945485874Z [2024-04-28T01:45:08.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:45:09.013366911Z [2024-04-28T01:45:09.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:09.013405347Z [2024-04-28T01:45:09.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:45:09.023293303Z [2024-04-28T01:45:09.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=2024-04-28 01:45:07.423819+00:00, run_end_date=2024-04-28 01:45:07.804480+00:00, run_duration=0.380661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:05.072181+00:00, queued_by_job_id=1, pid=1400 2024-04-28T01:45:09.023595063Z [2024-04-28T01:45:09.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d8d0716-41f3-440e-a562-e718b4bb5b7b 2024-04-28T01:45:12.571616207Z [2024-04-28T01:45:12.571+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:45:12.571676057Z 2024-04-28T01:45:12.571989210Z [2024-04-28T01:45:12.571+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:45:12.572958055Z [2024-04-28T01:45:12.572+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:45:12.572980402Z 2024-04-28T01:45:12.575684388Z [2024-04-28T01:45:12.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:12.575735271Z [2024-04-28T01:45:12.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:45:12.650226015Z [2024-04-28T01:45:12.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 1 2024-04-28T01:45:12.650738930Z [2024-04-28T01:45:12.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:45:12.666650566Z [2024-04-28T01:45:12.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=0, run_start_date=2024-04-28 01:45:10.929520+00:00, run_end_date=2024-04-28 01:45:12.303457+00:00, run_duration=1.373937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:08.942768+00:00, queued_by_job_id=1, pid=1412 2024-04-28T01:45:12.666759680Z [2024-04-28T01:45:12.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to c10768d3-8297-40f9-bc36-1867ae5ad1fb 2024-04-28T01:45:15.125357107Z [2024-04-28T01:45:15.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:45:15.126074636Z [2024-04-28T01:45:15.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:45:00.564389+00:00, run_end_date=2024-04-28 01:45:15.125642+00:00, run_duration=14.561253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:45:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T01:45:15.134575244Z [2024-04-28T01:45:15.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:45:15.201609207Z [2024-04-28T01:45:15.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status success for try_number 1 2024-04-28T01:45:15.207181301Z [2024-04-28T01:45:15.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=2024-04-28 01:45:14.300049+00:00, run_end_date=2024-04-28 01:45:14.638624+00:00, run_duration=0.338575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:12.573400+00:00, queued_by_job_id=1, pid=1433 2024-04-28T01:45:16.300228279Z [2024-04-28T01:45:16.299+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:45:16.300275237Z 2024-04-28T01:45:16.300298342Z 2024-04-28T01:45:16.300301657Z 2024-04-28T01:45:16.300385414Z [2024-04-28T01:45:16.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:45:16.300609327Z [2024-04-28T01:45:16.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:45:16.300832573Z [2024-04-28T01:45:16.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:45:16.301459456Z [2024-04-28T01:45:16.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:45:16.301481726Z 2024-04-28T01:45:16.301485812Z 2024-04-28T01:45:16.301488943Z 2024-04-28T01:45:16.304317028Z [2024-04-28T01:45:16.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:45:16.304608587Z [2024-04-28T01:45:16.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:45:16.305000031Z [2024-04-28T01:45:16.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:16.305143386Z [2024-04-28T01:45:16.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:45:16.305434314Z [2024-04-28T01:45:16.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:45:16.305584996Z [2024-04-28T01:45:16.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:45:16.559915108Z [2024-04-28T01:45:16.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status queued for try_number 2 2024-04-28T01:45:16.560048379Z [2024-04-28T01:45:16.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 2 2024-04-28T01:45:16.560275392Z [2024-04-28T01:45:16.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 2 2024-04-28T01:45:16.567687427Z [2024-04-28T01:45:16.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d754e24-b2b9-4fa8-b5c4-4325282107ee 2024-04-28T01:45:16.567845076Z [2024-04-28T01:45:16.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to c296fb8a-6468-4ada-b37c-830404785353 2024-04-28T01:45:16.568084555Z [2024-04-28T01:45:16.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to db05139d-3bce-4150-ad5f-e5b36a0328c5 2024-04-28T01:45:18.049433309Z [2024-04-28T01:45:18.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status failed for try_number 2 2024-04-28T01:45:18.049464382Z [2024-04-28T01:45:18.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status failed for try_number 2 2024-04-28T01:45:18.056199944Z [2024-04-28T01:45:18.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:45:05.266559+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:16.302197+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:45:18.056553805Z [2024-04-28T01:45:18.056+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:18.058667384Z [2024-04-28T01:45:18.058+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:18.070359015Z [2024-04-28T01:45:18.070+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T014400, start_date=, end_date=20240428T014518 2024-04-28T01:45:18.077173377Z [2024-04-28T01:45:18.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:45:05.240592+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:16.302197+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:45:18.077527416Z [2024-04-28T01:45:18.077+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:18.079615999Z [2024-04-28T01:45:18.079+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:18.090354117Z [2024-04-28T01:45:18.090+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T014400, start_date=, end_date=20240428T014518 2024-04-28T01:45:19.170338365Z [2024-04-28T01:45:19.169+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:45:19.170991701Z [2024-04-28T01:45:19.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:44:00+00:00, run_id=scheduled__2024-04-28T01:44:00+00:00, run_start_date=2024-04-28 01:45:00.567859+00:00, run_end_date=2024-04-28 01:45:19.170133+00:00, run_duration=18.602274, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:44:00+00:00, data_interval_end=2024-04-28 01:45:00+00:00, dag_hash=71d7a5a793239695907115bc66a3b263 2024-04-28T01:45:19.181714122Z [2024-04-28T01:45:19.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:46:00+00:00 2024-04-28T01:45:19.217086361Z [2024-04-28T01:45:19.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:40:00+00:00 exited with status failed for try_number 2 2024-04-28T01:45:19.224173102Z [2024-04-28T01:45:19.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:45:05.195793+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:45:16.302197+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:45:19.224550266Z [2024-04-28T01:45:19.224+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:19.227025836Z [2024-04-28T01:45:19.226+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:45:19.242318769Z [2024-04-28T01:45:19.241+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=extract_metrics_from_vnfrs, execution_date=20240428T014000, start_date=, end_date=20240428T014519 2024-04-28T01:45:22.718711031Z [2024-04-28T01:45:22.717+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:45:22.718816539Z [2024-04-28T01:45:22.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:40:00+00:00, run_id=scheduled__2024-04-28T01:40:00+00:00, run_start_date=2024-04-28 01:45:00.562724+00:00, run_end_date=2024-04-28 01:45:22.718434+00:00, run_duration=22.15571, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:40:00+00:00, data_interval_end=2024-04-28 01:45:00+00:00, dag_hash=d9a750100930e6d293917e3c9247e52e 2024-04-28T01:45:22.725078868Z [2024-04-28T01:45:22.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:45:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:46:00.739213965Z [2024-04-28T01:46:00.738+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:46:00.750052237Z [2024-04-28T01:46:00.749+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:46:00.764269825Z [2024-04-28T01:46:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:46:00+00:00, run_after=2024-04-28T01:47:00+00:00 2024-04-28T01:46:00.771738979Z [2024-04-28T01:46:00.771+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:46:00.857360019Z [2024-04-28T01:46:00.856+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T01:46:00.857403323Z 2024-04-28T01:46:00.857500039Z 2024-04-28T01:46:00.857514226Z 2024-04-28T01:46:00.857523383Z 2024-04-28T01:46:00.857579595Z [2024-04-28T01:46:00.857+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:46:00.858063473Z [2024-04-28T01:46:00.857+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:46:00.858449417Z [2024-04-28T01:46:00.857+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:46:00.858978558Z [2024-04-28T01:46:00.858+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:46:00.860153108Z [2024-04-28T01:46:00.859+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:46:00.860220048Z 2024-04-28T01:46:00.860226722Z 2024-04-28T01:46:00.860231110Z 2024-04-28T01:46:00.860235270Z 2024-04-28T01:46:00.869070465Z [2024-04-28T01:46:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:46:00.869644616Z [2024-04-28T01:46:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:46:00.870067910Z [2024-04-28T01:46:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:46:00.870093302Z [2024-04-28T01:46:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:46:00.870357039Z [2024-04-28T01:46:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:46:00.870473717Z [2024-04-28T01:46:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:46:00.870704764Z [2024-04-28T01:46:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:46:00.870723928Z [2024-04-28T01:46:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:46:01.412340342Z [2024-04-28T01:46:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status queued for try_number 1 2024-04-28T01:46:01.412684563Z [2024-04-28T01:46:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:46:01.412959504Z [2024-04-28T01:46:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:46:01.413313392Z [2024-04-28T01:46:01.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:46:01.436623000Z [2024-04-28T01:46:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to c721b93e-33fd-4c65-97a4-d447ff46a891 2024-04-28T01:46:01.437070996Z [2024-04-28T01:46:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb5fe5da-63be-47a0-bd87-1e05e83ac3f3 2024-04-28T01:46:01.437386967Z [2024-04-28T01:46:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to b403a50a-fd12-4379-9cb8-06196bde35ad 2024-04-28T01:46:01.437651627Z [2024-04-28T01:46:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48c747fe-1d7d-402a-a522-f32009a37bd0 2024-04-28T01:46:02.943294164Z [2024-04-28T01:46:02.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:46:02.943565814Z [2024-04-28T01:46:02.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:44:00+00:00, run_id=scheduled__2024-04-28T01:44:00+00:00, run_start_date=2024-04-28 01:46:00.781247+00:00, run_end_date=2024-04-28 01:46:02.943242+00:00, run_duration=2.161995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:44:00+00:00, data_interval_end=2024-04-28 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:46:02.952463808Z [2024-04-28T01:46:02.952+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:46:00+00:00, run_after=2024-04-28T01:48:00+00:00 2024-04-28T01:46:03.017499338Z [2024-04-28T01:46:03.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:44:00+00:00 exited with status success for try_number 1 2024-04-28T01:46:03.023355498Z [2024-04-28T01:46:03.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:44:00+00:00, map_index=-1, run_start_date=2024-04-28 01:46:01.888472+00:00, run_end_date=2024-04-28 01:46:02.264601+00:00, run_duration=0.376129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:46:00.862361+00:00, queued_by_job_id=1, pid=1508 2024-04-28T01:46:03.731915066Z [2024-04-28T01:46:03.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status failed for try_number 1 2024-04-28T01:46:03.737731092Z [2024-04-28T01:46:03.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:46:00.862361+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:46:03.738497384Z [2024-04-28T01:46:03.738+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:46:03.740757256Z [2024-04-28T01:46:03.740+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:46:03.753421254Z [2024-04-28T01:46:03.753+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T014500, start_date=, end_date=20240428T014603 2024-04-28T01:46:05.531035148Z [2024-04-28T01:46:05.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:46:05.531417663Z [2024-04-28T01:46:05.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:45:00+00:00, run_id=scheduled__2024-04-28T01:45:00+00:00, run_start_date=2024-04-28 01:46:00.783527+00:00, run_end_date=2024-04-28 01:46:05.530913+00:00, run_duration=4.747386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:45:00+00:00, data_interval_end=2024-04-28 01:46:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:46:05.539517189Z [2024-04-28T01:46:05.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:46:00+00:00, run_after=2024-04-28T01:47:00+00:00 2024-04-28T01:46:05.548895994Z [2024-04-28T01:46:05.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:46:05.549243100Z [2024-04-28T01:46:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:45:00+00:00, run_id=scheduled__2024-04-28T01:45:00+00:00, run_start_date=2024-04-28 01:46:00.782435+00:00, run_end_date=2024-04-28 01:46:05.548750+00:00, run_duration=4.766315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:45:00+00:00, data_interval_end=2024-04-28 01:46:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:46:05.565342660Z [2024-04-28T01:46:05.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:46:00+00:00, run_after=2024-04-28T01:47:00+00:00 2024-04-28T01:46:05.681468091Z [2024-04-28T01:46:05.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status success for try_number 1 2024-04-28T01:46:05.681485531Z [2024-04-28T01:46:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status success for try_number 1 2024-04-28T01:46:05.693466883Z [2024-04-28T01:46:05.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=2024-04-28 01:46:03.634052+00:00, run_end_date=2024-04-28 01:46:05.009679+00:00, run_duration=1.375627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:46:00.862361+00:00, queued_by_job_id=1, pid=1567 2024-04-28T01:46:05.693914624Z [2024-04-28T01:46:05.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=2024-04-28 01:46:03.208968+00:00, run_end_date=2024-04-28 01:46:05.105844+00:00, run_duration=1.896876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:46:00.862361+00:00, queued_by_job_id=1, pid=1548 2024-04-28T01:46:13.932067284Z [2024-04-28T01:46:13.931+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:46:13.932109517Z 2024-04-28T01:46:13.932239625Z [2024-04-28T01:46:13.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 has 0/16 running and queued tasks 2024-04-28T01:46:13.933209362Z [2024-04-28T01:46:13.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:46:13.933244096Z 2024-04-28T01:46:13.936989043Z [2024-04-28T01:46:13.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:46:13.937152351Z [2024-04-28T01:46:13.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:46:13.998807948Z [2024-04-28T01:46:13.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 2 2024-04-28T01:46:14.006636459Z [2024-04-28T01:46:14.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83d74e6a-6748-4c7c-94a4-3f8656753b75 2024-04-28T01:46:15.636620527Z [2024-04-28T01:46:15.628+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T01:46:16.659648962Z [2024-04-28T01:46:16.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status failed for try_number 2 2024-04-28T01:46:16.666608836Z [2024-04-28T01:46:16.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 01:46:03.743072+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:46:13.933940+00:00, queued_by_job_id=1, pid=None 2024-04-28T01:46:16.667239556Z [2024-04-28T01:46:16.666+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:46:16.670057794Z [2024-04-28T01:46:16.669+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T01:46:16.686406589Z [2024-04-28T01:46:16.686+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T014500, start_date=, end_date=20240428T014616 2024-04-28T01:46:17.753792219Z [2024-04-28T01:46:17.753+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T01:46:17.754829707Z [2024-04-28T01:46:17.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8, execution_date=2024-04-28 01:45:00+00:00, run_id=scheduled__2024-04-28T01:45:00+00:00, run_start_date=2024-04-28 01:46:00.784464+00:00, run_end_date=2024-04-28 01:46:17.754431+00:00, run_duration=16.969967, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:45:00+00:00, data_interval_end=2024-04-28 01:46:00+00:00, dag_hash=71d7a5a793239695907115bc66a3b263 2024-04-28T01:46:17.764488761Z [2024-04-28T01:46:17.764+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cb9c60c4-802c-4609-a396-1bfe6d9caae8 to 2024-04-28T01:46:00+00:00, run_after=2024-04-28T01:47:00+00:00 2024-04-28T01:47:00.675380530Z [2024-04-28T01:47:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:47:00+00:00, run_after=2024-04-28T01:48:00+00:00 2024-04-28T01:47:00.683910315Z [2024-04-28T01:47:00.683+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:47:00.769316852Z [2024-04-28T01:47:00.768+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:47:00.769373973Z 2024-04-28T01:47:00.769472555Z 2024-04-28T01:47:00.769551670Z [2024-04-28T01:47:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:47:00.769571673Z [2024-04-28T01:47:00.769+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:47:00.770437776Z [2024-04-28T01:47:00.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:47:00.770484213Z 2024-04-28T01:47:00.770500380Z 2024-04-28T01:47:00.774601335Z [2024-04-28T01:47:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:47:00.774637282Z [2024-04-28T01:47:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:47:00.775117684Z [2024-04-28T01:47:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:47:00.775144192Z [2024-04-28T01:47:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:47:00.967146220Z [2024-04-28T01:47:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:46:00+00:00 exited with status queued for try_number 1 2024-04-28T01:47:00.967290240Z [2024-04-28T01:47:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:46:00+00:00 exited with status queued for try_number 1 2024-04-28T01:47:00.973786165Z [2024-04-28T01:47:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to caa5671c-07f5-4a0e-bea7-59c46d46578f 2024-04-28T01:47:00.974024645Z [2024-04-28T01:47:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 784f3404-720f-412c-992b-430bf5f99e6f 2024-04-28T01:47:04.411154533Z [2024-04-28T01:47:04.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:47:04.411451400Z [2024-04-28T01:47:04.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:46:00+00:00, run_id=scheduled__2024-04-28T01:46:00+00:00, run_start_date=2024-04-28 01:47:00.698196+00:00, run_end_date=2024-04-28 01:47:04.411121+00:00, run_duration=3.712925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:46:00+00:00, data_interval_end=2024-04-28 01:47:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:47:04.426528597Z [2024-04-28T01:47:04.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:47:00+00:00, run_after=2024-04-28T01:48:00+00:00 2024-04-28T01:47:04.772200642Z [2024-04-28T01:47:04.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:46:00+00:00 exited with status success for try_number 1 2024-04-28T01:47:04.791733812Z [2024-04-28T01:47:04.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:46:00+00:00, map_index=-1, run_start_date=2024-04-28 01:47:02.955511+00:00, run_end_date=2024-04-28 01:47:04.347883+00:00, run_duration=1.392372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:47:00.770889+00:00, queued_by_job_id=1, pid=1632 2024-04-28T01:47:05.898765724Z [2024-04-28T01:47:05.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:47:05.899100170Z [2024-04-28T01:47:05.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:46:00+00:00, run_id=scheduled__2024-04-28T01:46:00+00:00, run_start_date=2024-04-28 01:47:00.699833+00:00, run_end_date=2024-04-28 01:47:05.898681+00:00, run_duration=5.198848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:46:00+00:00, data_interval_end=2024-04-28 01:47:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:47:05.908351889Z [2024-04-28T01:47:05.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:47:00+00:00, run_after=2024-04-28T01:48:00+00:00 2024-04-28T01:47:05.943781292Z [2024-04-28T01:47:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:46:00+00:00 exited with status success for try_number 1 2024-04-28T01:47:05.950279802Z [2024-04-28T01:47:05.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:46:00+00:00, map_index=-1, run_start_date=2024-04-28 01:47:02.965737+00:00, run_end_date=2024-04-28 01:47:04.714583+00:00, run_duration=1.748846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:47:00.770889+00:00, queued_by_job_id=1, pid=1633 2024-04-28T01:48:00.764006134Z [2024-04-28T01:48:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:48:00+00:00, run_after=2024-04-28T01:49:00+00:00 2024-04-28T01:48:00.775283655Z [2024-04-28T01:48:00.774+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:48:00.785087521Z [2024-04-28T01:48:00.784+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:48:00.848856556Z [2024-04-28T01:48:00.848+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:48:00.848899921Z 2024-04-28T01:48:00.848907426Z 2024-04-28T01:48:00.848910662Z 2024-04-28T01:48:00.849157787Z [2024-04-28T01:48:00.848+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:48:00.849378485Z [2024-04-28T01:48:00.849+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:48:00.849574976Z [2024-04-28T01:48:00.849+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:48:00.850198835Z [2024-04-28T01:48:00.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:48:00.850209233Z 2024-04-28T01:48:00.850214530Z 2024-04-28T01:48:00.850218637Z 2024-04-28T01:48:00.853778774Z [2024-04-28T01:48:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:48:00.853798060Z [2024-04-28T01:48:00.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:48:00.854019280Z [2024-04-28T01:48:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:48:00.854031831Z [2024-04-28T01:48:00.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:48:00.854273585Z [2024-04-28T01:48:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:48:00.854285279Z [2024-04-28T01:48:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:48:01.076842371Z [2024-04-28T01:48:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:46:00+00:00 exited with status queued for try_number 1 2024-04-28T01:48:01.078944413Z [2024-04-28T01:48:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:47:00+00:00 exited with status queued for try_number 1 2024-04-28T01:48:01.079090733Z [2024-04-28T01:48:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:47:00+00:00 exited with status queued for try_number 1 2024-04-28T01:48:01.087311536Z [2024-04-28T01:48:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 706c19a9-9b76-4924-9339-c72d17e9ff9e 2024-04-28T01:48:01.087337302Z [2024-04-28T01:48:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8ac1ac3-7485-49da-8cce-bcc786729a0c 2024-04-28T01:48:01.087476245Z [2024-04-28T01:48:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fac3d3c-7483-406a-9e1a-1b3846f7aca6 2024-04-28T01:48:02.236749206Z [2024-04-28T01:48:02.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:48:02.237729526Z [2024-04-28T01:48:02.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:46:00+00:00, run_id=scheduled__2024-04-28T01:46:00+00:00, run_start_date=2024-04-28 01:48:00.795213+00:00, run_end_date=2024-04-28 01:48:02.237125+00:00, run_duration=1.441912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:46:00+00:00, data_interval_end=2024-04-28 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:48:02.247636542Z [2024-04-28T01:48:02.247+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:48:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:48:02.289528869Z [2024-04-28T01:48:02.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:46:00+00:00 exited with status success for try_number 1 2024-04-28T01:48:02.299939265Z [2024-04-28T01:48:02.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:46:00+00:00, map_index=-1, run_start_date=2024-04-28 01:48:01.613975+00:00, run_end_date=2024-04-28 01:48:01.967699+00:00, run_duration=0.353724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:48:00.850852+00:00, queued_by_job_id=1, pid=1658 2024-04-28T01:48:04.810466664Z [2024-04-28T01:48:04.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:48:04.812787321Z [2024-04-28T01:48:04.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:47:00+00:00, run_id=scheduled__2024-04-28T01:47:00+00:00, run_start_date=2024-04-28 01:48:00.796618+00:00, run_end_date=2024-04-28 01:48:04.810337+00:00, run_duration=4.013719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:47:00+00:00, data_interval_end=2024-04-28 01:48:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:48:04.826746194Z [2024-04-28T01:48:04.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:48:00+00:00, run_after=2024-04-28T01:49:00+00:00 2024-04-28T01:48:04.838040120Z [2024-04-28T01:48:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:48:04.838433415Z [2024-04-28T01:48:04.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:47:00+00:00, run_id=scheduled__2024-04-28T01:47:00+00:00, run_start_date=2024-04-28 01:48:00.797860+00:00, run_end_date=2024-04-28 01:48:04.837938+00:00, run_duration=4.040078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:47:00+00:00, data_interval_end=2024-04-28 01:48:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:48:04.848050659Z [2024-04-28T01:48:04.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:48:00+00:00, run_after=2024-04-28T01:49:00+00:00 2024-04-28T01:48:04.881659060Z [2024-04-28T01:48:04.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:47:00+00:00 exited with status success for try_number 1 2024-04-28T01:48:04.881862268Z [2024-04-28T01:48:04.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:47:00+00:00 exited with status success for try_number 1 2024-04-28T01:48:04.890521057Z [2024-04-28T01:48:04.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:47:00+00:00, map_index=-1, run_start_date=2024-04-28 01:48:02.919137+00:00, run_end_date=2024-04-28 01:48:04.299826+00:00, run_duration=1.380689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:48:00.850852+00:00, queued_by_job_id=1, pid=1699 2024-04-28T01:48:04.890783903Z [2024-04-28T01:48:04.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:47:00+00:00, map_index=-1, run_start_date=2024-04-28 01:48:02.748796+00:00, run_end_date=2024-04-28 01:48:04.517100+00:00, run_duration=1.768304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:48:00.850852+00:00, queued_by_job_id=1, pid=1698 2024-04-28T01:49:00.098267063Z [2024-04-28T01:49:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:49:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:49:00.114062643Z [2024-04-28T01:49:00.113+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:49:00.187032750Z [2024-04-28T01:49:00.186+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:49:00.187082418Z 2024-04-28T01:49:00.187091302Z 2024-04-28T01:49:00.187271774Z [2024-04-28T01:49:00.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:49:00.187618028Z [2024-04-28T01:49:00.187+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:49:00.188484725Z [2024-04-28T01:49:00.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:49:00.188501641Z 2024-04-28T01:49:00.188509721Z 2024-04-28T01:49:00.192460997Z [2024-04-28T01:49:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:49:00.192872654Z [2024-04-28T01:49:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:49:00.193406772Z [2024-04-28T01:49:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:49:00.193769368Z [2024-04-28T01:49:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:49:00.366012931Z [2024-04-28T01:49:00.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:48:00+00:00 exited with status queued for try_number 1 2024-04-28T01:49:00.366317665Z [2024-04-28T01:49:00.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:48:00+00:00 exited with status queued for try_number 1 2024-04-28T01:49:00.372478291Z [2024-04-28T01:49:00.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to c46a5451-775e-4d7e-9b5d-05f7442c234f 2024-04-28T01:49:00.372707166Z [2024-04-28T01:49:00.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45d89df9-a840-4b4b-b31b-d2586b122439 2024-04-28T01:49:04.076706010Z [2024-04-28T01:49:04.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:49:04.076895046Z [2024-04-28T01:49:04.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:48:00+00:00, run_id=scheduled__2024-04-28T01:48:00+00:00, run_start_date=2024-04-28 01:49:00.131084+00:00, run_end_date=2024-04-28 01:49:04.076597+00:00, run_duration=3.945513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:48:00+00:00, data_interval_end=2024-04-28 01:49:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:49:04.094736445Z [2024-04-28T01:49:04.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:49:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:49:04.101289317Z [2024-04-28T01:49:04.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:49:04.101469421Z [2024-04-28T01:49:04.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:48:00+00:00, run_id=scheduled__2024-04-28T01:48:00+00:00, run_start_date=2024-04-28 01:49:00.133106+00:00, run_end_date=2024-04-28 01:49:04.101221+00:00, run_duration=3.968115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:48:00+00:00, data_interval_end=2024-04-28 01:49:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:49:04.110739665Z [2024-04-28T01:49:04.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:49:00+00:00, run_after=2024-04-28T01:50:00+00:00 2024-04-28T01:49:04.138934444Z [2024-04-28T01:49:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:48:00+00:00 exited with status success for try_number 1 2024-04-28T01:49:04.138959150Z [2024-04-28T01:49:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:48:00+00:00 exited with status success for try_number 1 2024-04-28T01:49:04.152155874Z [2024-04-28T01:49:04.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:48:00+00:00, map_index=-1, run_start_date=2024-04-28 01:49:02.142150+00:00, run_end_date=2024-04-28 01:49:03.851657+00:00, run_duration=1.709507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:49:00.189218+00:00, queued_by_job_id=1, pid=1754 2024-04-28T01:49:04.152264917Z [2024-04-28T01:49:04.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:48:00+00:00, map_index=-1, run_start_date=2024-04-28 01:49:02.044033+00:00, run_end_date=2024-04-28 01:49:03.472558+00:00, run_duration=1.428525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:49:00.189218+00:00, queued_by_job_id=1, pid=1753 2024-04-28T01:50:01.049271129Z [2024-04-28T01:50:01.048+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:50:01.066719721Z [2024-04-28T01:50:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:50:00+00:00, run_after=2024-04-28T01:55:00+00:00 2024-04-28T01:50:01.074835330Z [2024-04-28T01:50:01.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:50:01.089813498Z [2024-04-28T01:50:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:50:00+00:00, run_after=2024-04-28T01:51:00+00:00 2024-04-28T01:50:01.173070727Z [2024-04-28T01:50:01.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T01:50:01.173104660Z 2024-04-28T01:50:01.173110172Z 2024-04-28T01:50:01.173116084Z 2024-04-28T01:50:01.173120846Z 2024-04-28T01:50:01.173378275Z [2024-04-28T01:50:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:50:01.173597075Z [2024-04-28T01:50:01.173+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:50:01.173752660Z [2024-04-28T01:50:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:50:01.173931190Z [2024-04-28T01:50:01.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:50:01.174841645Z [2024-04-28T01:50:01.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:50:01.174857356Z 2024-04-28T01:50:01.174863379Z 2024-04-28T01:50:01.174868071Z 2024-04-28T01:50:01.174872514Z 2024-04-28T01:50:01.180060688Z [2024-04-28T01:50:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:50:01.180088043Z [2024-04-28T01:50:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:50:01.180364539Z [2024-04-28T01:50:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:50:01.180445567Z [2024-04-28T01:50:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:50:01.180788345Z [2024-04-28T01:50:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:50:01.180924169Z [2024-04-28T01:50:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:50:01.181203502Z [2024-04-28T01:50:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:50:01.181375487Z [2024-04-28T01:50:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:50:01.537852282Z [2024-04-28T01:50:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:01.537893307Z [2024-04-28T01:50:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:48:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:01.538088876Z [2024-04-28T01:50:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:49:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:01.538209772Z [2024-04-28T01:50:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:49:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:01.556035729Z [2024-04-28T01:50:01.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 467f440b-9412-4a02-9d3a-8deb874b81f5 2024-04-28T01:50:01.556189966Z [2024-04-28T01:50:01.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 095ab534-aa15-4551-bab7-f5fd66f1a94f 2024-04-28T01:50:01.556381071Z [2024-04-28T01:50:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cf5f877-8463-453e-8b5b-a0b0087e71fe 2024-04-28T01:50:01.556638175Z [2024-04-28T01:50:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c890d7b-b33a-468d-8cb0-7af22431eb8b 2024-04-28T01:50:04.255774516Z [2024-04-28T01:50:04.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:50:04.255791820Z [2024-04-28T01:50:04.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:48:00+00:00, run_id=scheduled__2024-04-28T01:48:00+00:00, run_start_date=2024-04-28 01:50:01.103283+00:00, run_end_date=2024-04-28 01:50:04.253797+00:00, run_duration=3.150514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:48:00+00:00, data_interval_end=2024-04-28 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:50:04.267350684Z [2024-04-28T01:50:04.266+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:50:00+00:00, run_after=2024-04-28T01:52:00+00:00 2024-04-28T01:50:04.453191674Z [2024-04-28T01:50:04.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:48:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:04.461010088Z [2024-04-28T01:50:04.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:48:00+00:00, map_index=-1, run_start_date=2024-04-28 01:50:02.838013+00:00, run_end_date=2024-04-28 01:50:03.342026+00:00, run_duration=0.504013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:01.176028+00:00, queued_by_job_id=1, pid=1791 2024-04-28T01:50:04.602707658Z [2024-04-28T01:50:04.602+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:50:04.602733988Z 2024-04-28T01:50:04.602817513Z [2024-04-28T01:50:04.602+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:50:04.603406618Z [2024-04-28T01:50:04.603+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:50:04.603418840Z 2024-04-28T01:50:04.606814846Z [2024-04-28T01:50:04.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:50:04.607001359Z [2024-04-28T01:50:04.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:50:04.727647539Z [2024-04-28T01:50:04.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:04.727680582Z [2024-04-28T01:50:04.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:04.739545092Z [2024-04-28T01:50:04.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84c8eaee-1da8-4a92-975b-54152dd45c78 2024-04-28T01:50:04.739899927Z [2024-04-28T01:50:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=2024-04-28 01:50:03.862947+00:00, run_end_date=2024-04-28 01:50:04.374991+00:00, run_duration=0.512044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:01.176028+00:00, queued_by_job_id=1, pid=1812 2024-04-28T01:50:06.663717057Z [2024-04-28T01:50:06.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:50:06.664079933Z [2024-04-28T01:50:06.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:49:00+00:00, run_id=scheduled__2024-04-28T01:49:00+00:00, run_start_date=2024-04-28 01:50:01.104309+00:00, run_end_date=2024-04-28 01:50:06.663622+00:00, run_duration=5.559313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:49:00+00:00, data_interval_end=2024-04-28 01:50:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:50:06.673026018Z [2024-04-28T01:50:06.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:50:00+00:00, run_after=2024-04-28T01:51:00+00:00 2024-04-28T01:50:06.680735375Z [2024-04-28T01:50:06.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:50:06.681087272Z [2024-04-28T01:50:06.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:49:00+00:00, run_id=scheduled__2024-04-28T01:49:00+00:00, run_start_date=2024-04-28 01:50:01.105385+00:00, run_end_date=2024-04-28 01:50:06.680631+00:00, run_duration=5.575246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:49:00+00:00, data_interval_end=2024-04-28 01:50:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:50:06.690703765Z [2024-04-28T01:50:06.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:50:00+00:00, run_after=2024-04-28T01:51:00+00:00 2024-04-28T01:50:06.743213097Z [2024-04-28T01:50:06.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:49:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:06.743455148Z [2024-04-28T01:50:06.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:49:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:06.749412745Z [2024-04-28T01:50:06.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:49:00+00:00, map_index=-1, run_start_date=2024-04-28 01:50:04.345354+00:00, run_end_date=2024-04-28 01:50:06.232311+00:00, run_duration=1.886957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:01.176028+00:00, queued_by_job_id=1, pid=1840 2024-04-28T01:50:06.749619525Z [2024-04-28T01:50:06.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:49:00+00:00, map_index=-1, run_start_date=2024-04-28 01:50:04.443973+00:00, run_end_date=2024-04-28 01:50:06.413272+00:00, run_duration=1.969299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:01.176028+00:00, queued_by_job_id=1, pid=1841 2024-04-28T01:50:07.845987865Z [2024-04-28T01:50:07.845+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:50:07.846022288Z 2024-04-28T01:50:07.846088458Z [2024-04-28T01:50:07.845+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:50:07.846747727Z [2024-04-28T01:50:07.846+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:50:07.846803469Z 2024-04-28T01:50:07.848951918Z [2024-04-28T01:50:07.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:50:07.849102075Z [2024-04-28T01:50:07.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:50:07.899962880Z [2024-04-28T01:50:07.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:07.905928662Z [2024-04-28T01:50:07.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee6556ff-0d47-4e76-bdd5-902f5eabbf44 2024-04-28T01:50:07.996596751Z [2024-04-28T01:50:07.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:08.008035928Z [2024-04-28T01:50:08.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=2024-04-28 01:50:07.387599+00:00, run_end_date=2024-04-28 01:50:07.762270+00:00, run_duration=0.374671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:04.603789+00:00, queued_by_job_id=1, pid=1873 2024-04-28T01:50:12.579348767Z [2024-04-28T01:50:12.578+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:50:12.579430626Z 2024-04-28T01:50:12.579445396Z [2024-04-28T01:50:12.579+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:50:12.580223707Z [2024-04-28T01:50:12.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:50:12.580248558Z 2024-04-28T01:50:12.583687536Z [2024-04-28T01:50:12.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:50:12.583729429Z [2024-04-28T01:50:12.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:50:12.656659340Z [2024-04-28T01:50:12.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status queued for try_number 1 2024-04-28T01:50:12.656708402Z [2024-04-28T01:50:12.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:12.670715580Z [2024-04-28T01:50:12.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=0, run_start_date=2024-04-28 01:50:09.641241+00:00, run_end_date=2024-04-28 01:50:11.698614+00:00, run_duration=2.057373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:07.846987+00:00, queued_by_job_id=1, pid=1885 2024-04-28T01:50:12.671398738Z [2024-04-28T01:50:12.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f18acf2-4764-4117-9937-9e99e36fb311 2024-04-28T01:50:14.806666185Z [2024-04-28T01:50:14.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:50:14.807150447Z [2024-04-28T01:50:14.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:45:00+00:00, run_id=scheduled__2024-04-28T01:45:00+00:00, run_start_date=2024-04-28 01:50:01.102055+00:00, run_end_date=2024-04-28 01:50:14.806737+00:00, run_duration=13.704682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:45:00+00:00, data_interval_end=2024-04-28 01:50:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T01:50:14.813715359Z [2024-04-28T01:50:14.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:50:00+00:00, run_after=2024-04-28T01:55:00+00:00 2024-04-28T01:50:14.847528586Z [2024-04-28T01:50:14.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:45:00+00:00 exited with status success for try_number 1 2024-04-28T01:50:14.854117756Z [2024-04-28T01:50:14.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:45:00+00:00, map_index=-1, run_start_date=2024-04-28 01:50:14.214490+00:00, run_end_date=2024-04-28 01:50:14.595764+00:00, run_duration=0.381274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:50:12.580634+00:00, queued_by_job_id=1, pid=1906 2024-04-28T01:51:01.033446367Z [2024-04-28T01:51:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:51:00+00:00, run_after=2024-04-28T01:52:00+00:00 2024-04-28T01:51:01.044983241Z [2024-04-28T01:51:01.044+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:51:01.137163601Z [2024-04-28T01:51:01.136+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:51:01.137228269Z 2024-04-28T01:51:01.137238753Z 2024-04-28T01:51:01.137360344Z [2024-04-28T01:51:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:51:01.137629559Z [2024-04-28T01:51:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:51:01.138747363Z [2024-04-28T01:51:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:51:01.138770319Z 2024-04-28T01:51:01.138779453Z 2024-04-28T01:51:01.144556717Z [2024-04-28T01:51:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:51:01.145094721Z [2024-04-28T01:51:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:51:01.146069762Z [2024-04-28T01:51:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:51:01.146258816Z [2024-04-28T01:51:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:51:01.337262517Z [2024-04-28T01:51:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:51:01.338830027Z [2024-04-28T01:51:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:51:01.353381568Z [2024-04-28T01:51:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3269d293-df4f-4810-b91c-0b26917c1f15 2024-04-28T01:51:01.353411938Z [2024-04-28T01:51:01.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56deb274-4eaf-491a-a3bc-322ed389e1e4 2024-04-28T01:51:05.313736993Z [2024-04-28T01:51:05.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:51:05.313769669Z [2024-04-28T01:51:05.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:50:00+00:00, run_id=scheduled__2024-04-28T01:50:00+00:00, run_start_date=2024-04-28 01:51:01.060214+00:00, run_end_date=2024-04-28 01:51:05.312037+00:00, run_duration=4.251823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:50:00+00:00, data_interval_end=2024-04-28 01:51:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:51:05.344127629Z [2024-04-28T01:51:05.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:51:00+00:00, run_after=2024-04-28T01:52:00+00:00 2024-04-28T01:51:06.543138415Z [2024-04-28T01:51:06.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:51:06.543696936Z [2024-04-28T01:51:06.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:50:00+00:00, run_id=scheduled__2024-04-28T01:50:00+00:00, run_start_date=2024-04-28 01:51:01.061862+00:00, run_end_date=2024-04-28 01:51:06.543010+00:00, run_duration=5.481148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:50:00+00:00, data_interval_end=2024-04-28 01:51:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:51:06.553577912Z [2024-04-28T01:51:06.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:51:00+00:00, run_after=2024-04-28T01:52:00+00:00 2024-04-28T01:51:06.582278832Z [2024-04-28T01:51:06.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:51:06.582383197Z [2024-04-28T01:51:06.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:51:06.589659747Z [2024-04-28T01:51:06.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=-1, run_start_date=2024-04-28 01:51:03.310923+00:00, run_end_date=2024-04-28 01:51:05.049417+00:00, run_duration=1.738494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:51:01.139806+00:00, queued_by_job_id=1, pid=1940 2024-04-28T01:51:06.589847150Z [2024-04-28T01:51:06.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=-1, run_start_date=2024-04-28 01:51:03.143716+00:00, run_end_date=2024-04-28 01:51:05.277462+00:00, run_duration=2.133746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:51:01.139806+00:00, queued_by_job_id=1, pid=1939 2024-04-28T01:51:15.683467173Z [2024-04-28T01:51:15.682+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T01:52:00.833856881Z [2024-04-28T01:52:00.833+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:52:00.852929635Z [2024-04-28T01:52:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:52:00+00:00, run_after=2024-04-28T01:53:00+00:00 2024-04-28T01:52:00.863293010Z [2024-04-28T01:52:00.862+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:52:00.945567235Z [2024-04-28T01:52:00.945+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:52:00.945608769Z 2024-04-28T01:52:00.945623688Z 2024-04-28T01:52:00.945631578Z 2024-04-28T01:52:00.945879342Z [2024-04-28T01:52:00.945+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:52:00.946162570Z [2024-04-28T01:52:00.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:52:00.946474945Z [2024-04-28T01:52:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:52:00.947387758Z [2024-04-28T01:52:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:52:00.947410312Z 2024-04-28T01:52:00.947418060Z 2024-04-28T01:52:00.947425814Z 2024-04-28T01:52:00.952148291Z [2024-04-28T01:52:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:52:00.952312080Z [2024-04-28T01:52:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:52:00.952637875Z [2024-04-28T01:52:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:52:00.952901204Z [2024-04-28T01:52:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:52:00.953178142Z [2024-04-28T01:52:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:52:00.953291567Z [2024-04-28T01:52:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:52:01.175988971Z [2024-04-28T01:52:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:52:01.176042925Z [2024-04-28T01:52:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:51:00+00:00 exited with status queued for try_number 1 2024-04-28T01:52:01.176233502Z [2024-04-28T01:52:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:51:00+00:00 exited with status queued for try_number 1 2024-04-28T01:52:01.187117280Z [2024-04-28T01:52:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95cd1bc0-8183-40f5-a245-8d95176c39bf 2024-04-28T01:52:01.187445288Z [2024-04-28T01:52:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to c23b3983-268d-4dc3-990f-d223775a10df 2024-04-28T01:52:01.187638490Z [2024-04-28T01:52:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to 306b2da5-1158-4fc8-9269-4443be2b164d 2024-04-28T01:52:02.374670433Z [2024-04-28T01:52:02.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:52:02.374892774Z [2024-04-28T01:52:02.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:50:00+00:00, run_id=scheduled__2024-04-28T01:50:00+00:00, run_start_date=2024-04-28 01:52:00.876494+00:00, run_end_date=2024-04-28 01:52:02.374582+00:00, run_duration=1.498088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:50:00+00:00, data_interval_end=2024-04-28 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:52:02.393971491Z [2024-04-28T01:52:02.393+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:52:00+00:00, run_after=2024-04-28T01:54:00+00:00 2024-04-28T01:52:02.438441386Z [2024-04-28T01:52:02.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:52:02.444820125Z [2024-04-28T01:52:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=-1, run_start_date=2024-04-28 01:52:01.643750+00:00, run_end_date=2024-04-28 01:52:02.096770+00:00, run_duration=0.45302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:52:00.948374+00:00, queued_by_job_id=1, pid=1965 2024-04-28T01:52:04.579849757Z [2024-04-28T01:52:04.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:52:04.580187415Z [2024-04-28T01:52:04.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:51:00+00:00, run_id=scheduled__2024-04-28T01:51:00+00:00, run_start_date=2024-04-28 01:52:00.878051+00:00, run_end_date=2024-04-28 01:52:04.579884+00:00, run_duration=3.701833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:51:00+00:00, data_interval_end=2024-04-28 01:52:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:52:04.600056853Z [2024-04-28T01:52:04.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:52:00+00:00, run_after=2024-04-28T01:53:00+00:00 2024-04-28T01:52:04.838312061Z [2024-04-28T01:52:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:52:04.838685393Z [2024-04-28T01:52:04.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:51:00+00:00, run_id=scheduled__2024-04-28T01:51:00+00:00, run_start_date=2024-04-28 01:52:00.879368+00:00, run_end_date=2024-04-28 01:52:04.838216+00:00, run_duration=3.958848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:51:00+00:00, data_interval_end=2024-04-28 01:52:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:52:04.847499494Z [2024-04-28T01:52:04.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:52:00+00:00, run_after=2024-04-28T01:53:00+00:00 2024-04-28T01:52:04.872436916Z [2024-04-28T01:52:04.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:51:00+00:00 exited with status success for try_number 1 2024-04-28T01:52:04.881647351Z [2024-04-28T01:52:04.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:51:00+00:00, map_index=-1, run_start_date=2024-04-28 01:52:02.834286+00:00, run_end_date=2024-04-28 01:52:04.479083+00:00, run_duration=1.644797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:52:00.948374+00:00, queued_by_job_id=1, pid=2005 2024-04-28T01:52:05.859480079Z [2024-04-28T01:52:05.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:51:00+00:00 exited with status success for try_number 1 2024-04-28T01:52:05.865582599Z [2024-04-28T01:52:05.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:51:00+00:00, map_index=-1, run_start_date=2024-04-28 01:52:02.892668+00:00, run_end_date=2024-04-28 01:52:04.763295+00:00, run_duration=1.870627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:52:00.948374+00:00, queued_by_job_id=1, pid=2006 2024-04-28T01:53:00.434799044Z [2024-04-28T01:53:00.434+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:53:00.464070331Z [2024-04-28T01:53:00.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:53:00+00:00, run_after=2024-04-28T01:54:00+00:00 2024-04-28T01:53:00.515724468Z [2024-04-28T01:53:00.515+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:53:00.515746485Z 2024-04-28T01:53:00.515749849Z 2024-04-28T01:53:00.515925898Z [2024-04-28T01:53:00.515+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:53:00.516085103Z [2024-04-28T01:53:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:53:00.516625479Z [2024-04-28T01:53:00.516+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:53:00.516636548Z 2024-04-28T01:53:00.516639791Z 2024-04-28T01:53:00.519035633Z [2024-04-28T01:53:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:53:00.519248837Z [2024-04-28T01:53:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:53:00.519593433Z [2024-04-28T01:53:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:53:00.519812009Z [2024-04-28T01:53:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:53:00.658984579Z [2024-04-28T01:53:00.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:52:00+00:00 exited with status queued for try_number 1 2024-04-28T01:53:00.659223385Z [2024-04-28T01:53:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:52:00+00:00 exited with status queued for try_number 1 2024-04-28T01:53:00.665463259Z [2024-04-28T01:53:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 260d5b60-7596-41e1-b539-bf8565212ce8 2024-04-28T01:53:00.665725633Z [2024-04-28T01:53:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dbbb5ae-afdb-4975-9509-e0c1c5b97186 2024-04-28T01:53:04.018166608Z [2024-04-28T01:53:04.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:53:04.018505813Z [2024-04-28T01:53:04.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:52:00+00:00, run_id=scheduled__2024-04-28T01:52:00+00:00, run_start_date=2024-04-28 01:53:00.478047+00:00, run_end_date=2024-04-28 01:53:04.017962+00:00, run_duration=3.539915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:52:00+00:00, data_interval_end=2024-04-28 01:53:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:53:04.028223247Z [2024-04-28T01:53:04.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:53:00+00:00, run_after=2024-04-28T01:54:00+00:00 2024-04-28T01:53:04.034707225Z [2024-04-28T01:53:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:53:04.034994986Z [2024-04-28T01:53:04.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:52:00+00:00, run_id=scheduled__2024-04-28T01:52:00+00:00, run_start_date=2024-04-28 01:53:00.479417+00:00, run_end_date=2024-04-28 01:53:04.034599+00:00, run_duration=3.555182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:52:00+00:00, data_interval_end=2024-04-28 01:53:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:53:04.044273234Z [2024-04-28T01:53:04.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:53:00+00:00, run_after=2024-04-28T01:54:00+00:00 2024-04-28T01:53:04.076635777Z [2024-04-28T01:53:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:52:00+00:00 exited with status success for try_number 1 2024-04-28T01:53:04.076675383Z [2024-04-28T01:53:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:52:00+00:00 exited with status success for try_number 1 2024-04-28T01:53:04.083436690Z [2024-04-28T01:53:04.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:52:00+00:00, map_index=-1, run_start_date=2024-04-28 01:53:02.238079+00:00, run_end_date=2024-04-28 01:53:03.489966+00:00, run_duration=1.251887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:53:00.517153+00:00, queued_by_job_id=1, pid=2060 2024-04-28T01:53:04.083703522Z [2024-04-28T01:53:04.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:52:00+00:00, map_index=-1, run_start_date=2024-04-28 01:53:02.190540+00:00, run_end_date=2024-04-28 01:53:03.823502+00:00, run_duration=1.632962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:53:00.517153+00:00, queued_by_job_id=1, pid=2059 2024-04-28T01:54:00.830600889Z [2024-04-28T01:54:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:54:00+00:00, run_after=2024-04-28T01:55:00+00:00 2024-04-28T01:54:00.839338221Z [2024-04-28T01:54:00.839+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:54:00.848962322Z [2024-04-28T01:54:00.848+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:54:00.953120814Z [2024-04-28T01:54:00.952+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:54:00.953178320Z 2024-04-28T01:54:00.953197778Z 2024-04-28T01:54:00.953210880Z 2024-04-28T01:54:00.953578818Z [2024-04-28T01:54:00.952+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:54:00.954090627Z [2024-04-28T01:54:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:54:00.954460483Z [2024-04-28T01:54:00.954+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:54:00.955548761Z [2024-04-28T01:54:00.955+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:54:00.955572572Z 2024-04-28T01:54:00.955582809Z 2024-04-28T01:54:00.955591654Z 2024-04-28T01:54:00.960496344Z [2024-04-28T01:54:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:54:00.960676181Z [2024-04-28T01:54:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:54:00.961086507Z [2024-04-28T01:54:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:54:00.961355554Z [2024-04-28T01:54:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:54:00.961772773Z [2024-04-28T01:54:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:54:00.961914945Z [2024-04-28T01:54:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:54:01.194446701Z [2024-04-28T01:54:01.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:52:00+00:00 exited with status queued for try_number 1 2024-04-28T01:54:01.194796255Z [2024-04-28T01:54:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:53:00+00:00 exited with status queued for try_number 1 2024-04-28T01:54:01.194954895Z [2024-04-28T01:54:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:53:00+00:00 exited with status queued for try_number 1 2024-04-28T01:54:01.204637294Z [2024-04-28T01:54:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to e41ee138-c342-4a35-8a22-c334f16fc5aa 2024-04-28T01:54:01.204955951Z [2024-04-28T01:54:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 747b4dce-47fe-4621-8950-087998b5e39e 2024-04-28T01:54:01.205336665Z [2024-04-28T01:54:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 337dc4b9-5427-4f10-8eb5-114cfc123308 2024-04-28T01:54:02.714317341Z [2024-04-28T01:54:02.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:54:02.714638985Z [2024-04-28T01:54:02.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:52:00+00:00, run_id=scheduled__2024-04-28T01:52:00+00:00, run_start_date=2024-04-28 01:54:00.863650+00:00, run_end_date=2024-04-28 01:54:02.714290+00:00, run_duration=1.85064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:52:00+00:00, data_interval_end=2024-04-28 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:54:02.724171350Z [2024-04-28T01:54:02.723+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:54:00+00:00, run_after=2024-04-28T01:56:00+00:00 2024-04-28T01:54:02.785204333Z [2024-04-28T01:54:02.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:52:00+00:00 exited with status success for try_number 1 2024-04-28T01:54:02.786476531Z [2024-04-28T01:54:02.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:52:00+00:00, map_index=-1, run_start_date=2024-04-28 01:54:01.681789+00:00, run_end_date=2024-04-28 01:54:02.106511+00:00, run_duration=0.424722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:54:00.956766+00:00, queued_by_job_id=1, pid=2085 2024-04-28T01:54:04.907563450Z [2024-04-28T01:54:04.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:54:04.908558530Z [2024-04-28T01:54:04.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:53:00+00:00, run_id=scheduled__2024-04-28T01:53:00+00:00, run_start_date=2024-04-28 01:54:00.865486+00:00, run_end_date=2024-04-28 01:54:04.907879+00:00, run_duration=4.042393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:53:00+00:00, data_interval_end=2024-04-28 01:54:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:54:04.941059001Z [2024-04-28T01:54:04.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:54:00+00:00, run_after=2024-04-28T01:55:00+00:00 2024-04-28T01:54:05.009744242Z [2024-04-28T01:54:05.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:53:00+00:00 exited with status success for try_number 1 2024-04-28T01:54:05.014962028Z [2024-04-28T01:54:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:53:00+00:00, map_index=-1, run_start_date=2024-04-28 01:54:03.014951+00:00, run_end_date=2024-04-28 01:54:04.578747+00:00, run_duration=1.563796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:54:00.956766+00:00, queued_by_job_id=1, pid=2127 2024-04-28T01:54:06.068784915Z [2024-04-28T01:54:06.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:54:06.069152854Z [2024-04-28T01:54:06.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:53:00+00:00, run_id=scheduled__2024-04-28T01:53:00+00:00, run_start_date=2024-04-28 01:54:00.866880+00:00, run_end_date=2024-04-28 01:54:06.068632+00:00, run_duration=5.201752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:53:00+00:00, data_interval_end=2024-04-28 01:54:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:54:06.081092161Z [2024-04-28T01:54:06.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:54:00+00:00, run_after=2024-04-28T01:55:00+00:00 2024-04-28T01:54:06.110487047Z [2024-04-28T01:54:06.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:53:00+00:00 exited with status success for try_number 1 2024-04-28T01:54:06.119735404Z [2024-04-28T01:54:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:53:00+00:00, map_index=-1, run_start_date=2024-04-28 01:54:02.927597+00:00, run_end_date=2024-04-28 01:54:04.961144+00:00, run_duration=2.033547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:54:00.956766+00:00, queued_by_job_id=1, pid=2126 2024-04-28T01:55:00.631575519Z [2024-04-28T01:55:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:55:00+00:00, run_after=2024-04-28T02:00:00+00:00 2024-04-28T01:55:00.644491732Z [2024-04-28T01:55:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:55:00+00:00, run_after=2024-04-28T01:56:00+00:00 2024-04-28T01:55:00.654145225Z [2024-04-28T01:55:00.653+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:55:00.742528516Z [2024-04-28T01:55:00.742+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:55:00.742577085Z 2024-04-28T01:55:00.742589144Z 2024-04-28T01:55:00.742598447Z 2024-04-28T01:55:00.742606988Z [2024-04-28T01:55:00.742+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:55:00.742738545Z [2024-04-28T01:55:00.742+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:55:00.742757374Z [2024-04-28T01:55:00.742+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:55:00.743344212Z [2024-04-28T01:55:00.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:55:00.743364877Z 2024-04-28T01:55:00.743375713Z 2024-04-28T01:55:00.743384767Z 2024-04-28T01:55:00.747030049Z [2024-04-28T01:55:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T01:55:00.747217934Z [2024-04-28T01:55:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:55:00.747347564Z [2024-04-28T01:55:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:55:00.747494585Z [2024-04-28T01:55:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:55:00.747746451Z [2024-04-28T01:55:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:55:00.747894392Z [2024-04-28T01:55:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:55:00.968983248Z [2024-04-28T01:55:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:55:00.969120593Z [2024-04-28T01:55:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:54:00+00:00 exited with status queued for try_number 1 2024-04-28T01:55:00.969229011Z [2024-04-28T01:55:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:54:00+00:00 exited with status queued for try_number 1 2024-04-28T01:55:00.979084173Z [2024-04-28T01:55:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 447ad793-1951-4181-93bd-d19338d457f2 2024-04-28T01:55:00.979227359Z [2024-04-28T01:55:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26c10162-2bf3-47f0-bc46-ec65f290ee13 2024-04-28T01:55:00.979372775Z [2024-04-28T01:55:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed87af8f-058f-4949-924b-834f8a9d36e4 2024-04-28T01:55:03.780901894Z [2024-04-28T01:55:03.780+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:55:03.780936015Z 2024-04-28T01:55:03.780972999Z [2024-04-28T01:55:03.780+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:55:03.781754468Z [2024-04-28T01:55:03.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:55:03.781769939Z 2024-04-28T01:55:03.784430934Z [2024-04-28T01:55:03.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T01:55:03.784631504Z [2024-04-28T01:55:03.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:55:03.849198895Z [2024-04-28T01:55:03.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:55:03.849545930Z [2024-04-28T01:55:03.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:55:03.859536176Z [2024-04-28T01:55:03.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 375a2ce4-f66a-4d2d-876b-2e540ac97f84 2024-04-28T01:55:03.859995488Z [2024-04-28T01:55:03.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=-1, run_start_date=2024-04-28 01:55:02.575257+00:00, run_end_date=2024-04-28 01:55:03.049760+00:00, run_duration=0.474503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:55:00.743962+00:00, queued_by_job_id=1, pid=2184 2024-04-28T01:55:03.919288370Z [2024-04-28T01:55:03.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:55:03.919768090Z [2024-04-28T01:55:03.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:54:00+00:00, run_id=scheduled__2024-04-28T01:54:00+00:00, run_start_date=2024-04-28 01:55:00.671339+00:00, run_end_date=2024-04-28 01:55:03.919211+00:00, run_duration=3.247872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:54:00+00:00, data_interval_end=2024-04-28 01:55:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:55:03.934756264Z [2024-04-28T01:55:03.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:55:00+00:00, run_after=2024-04-28T01:56:00+00:00 2024-04-28T01:55:03.989814267Z [2024-04-28T01:55:03.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:54:00+00:00 exited with status success for try_number 1 2024-04-28T01:55:03.995269595Z [2024-04-28T01:55:03.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:54:00+00:00, map_index=-1, run_start_date=2024-04-28 01:55:02.536797+00:00, run_end_date=2024-04-28 01:55:03.798395+00:00, run_duration=1.261598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:55:00.743962+00:00, queued_by_job_id=1, pid=2183 2024-04-28T01:55:05.081834613Z [2024-04-28T01:55:05.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:55:05.082004351Z [2024-04-28T01:55:05.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:54:00+00:00, run_id=scheduled__2024-04-28T01:54:00+00:00, run_start_date=2024-04-28 01:55:00.672569+00:00, run_end_date=2024-04-28 01:55:05.081755+00:00, run_duration=4.409186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:54:00+00:00, data_interval_end=2024-04-28 01:55:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:55:05.098690106Z [2024-04-28T01:55:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:55:00+00:00, run_after=2024-04-28T01:56:00+00:00 2024-04-28T01:55:06.272090189Z [2024-04-28T01:55:06.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:54:00+00:00 exited with status success for try_number 1 2024-04-28T01:55:06.277675070Z [2024-04-28T01:55:06.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:54:00+00:00, map_index=-1, run_start_date=2024-04-28 01:55:02.905480+00:00, run_end_date=2024-04-28 01:55:05.003117+00:00, run_duration=2.097637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:55:00.743962+00:00, queued_by_job_id=1, pid=2203 2024-04-28T01:55:07.119784364Z [2024-04-28T01:55:07.119+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:55:07.119816892Z 2024-04-28T01:55:07.120117311Z [2024-04-28T01:55:07.119+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:55:07.120853977Z [2024-04-28T01:55:07.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:55:07.120865451Z 2024-04-28T01:55:07.126055787Z [2024-04-28T01:55:07.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T01:55:07.126182134Z [2024-04-28T01:55:07.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T01:55:07.177318303Z [2024-04-28T01:55:07.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:55:07.177978675Z [2024-04-28T01:55:07.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:55:07.185393175Z [2024-04-28T01:55:07.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39fc9753-31b5-4500-88dc-603769fb1886 2024-04-28T01:55:07.185667526Z [2024-04-28T01:55:07.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=-1, run_start_date=2024-04-28 01:55:05.924700+00:00, run_end_date=2024-04-28 01:55:06.315598+00:00, run_duration=0.390898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:55:03.782097+00:00, queued_by_job_id=1, pid=2236 2024-04-28T01:55:10.083091581Z [2024-04-28T01:55:10.082+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T01:55:10.083115579Z 2024-04-28T01:55:10.083277470Z [2024-04-28T01:55:10.082+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:55:10.084158518Z [2024-04-28T01:55:10.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:55:10.084183900Z 2024-04-28T01:55:10.086941765Z [2024-04-28T01:55:10.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:55:10.087183772Z [2024-04-28T01:55:10.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T01:55:10.156287599Z [2024-04-28T01:55:10.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status queued for try_number 1 2024-04-28T01:55:10.156308973Z [2024-04-28T01:55:10.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:55:10.163655237Z [2024-04-28T01:55:10.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f59550e-59c4-4360-bc46-5d5efca02396 2024-04-28T01:55:10.171339176Z [2024-04-28T01:55:10.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=0, run_start_date=2024-04-28 01:55:08.678808+00:00, run_end_date=2024-04-28 01:55:09.071314+00:00, run_duration=0.392506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:55:07.121189+00:00, queued_by_job_id=1, pid=2248 2024-04-28T01:55:12.397808532Z [2024-04-28T01:55:12.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:55:12.398706670Z [2024-04-28T01:55:12.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:50:00+00:00, run_id=scheduled__2024-04-28T01:50:00+00:00, run_start_date=2024-04-28 01:55:00.669760+00:00, run_end_date=2024-04-28 01:55:12.397963+00:00, run_duration=11.728203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:50:00+00:00, data_interval_end=2024-04-28 01:55:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T01:55:12.409457057Z [2024-04-28T01:55:12.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:55:00+00:00, run_after=2024-04-28T02:00:00+00:00 2024-04-28T01:55:12.447091327Z [2024-04-28T01:55:12.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:50:00+00:00 exited with status success for try_number 1 2024-04-28T01:55:12.460988478Z [2024-04-28T01:55:12.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:50:00+00:00, map_index=-1, run_start_date=2024-04-28 01:55:11.875284+00:00, run_end_date=2024-04-28 01:55:12.297775+00:00, run_duration=0.422491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:55:10.084598+00:00, queued_by_job_id=1, pid=2260 2024-04-28T01:56:00.504609890Z [2024-04-28T01:56:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:56:00.511932918Z [2024-04-28T01:56:00.511+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:56:00.524255826Z [2024-04-28T01:56:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:56:00+00:00, run_after=2024-04-28T01:57:00+00:00 2024-04-28T01:56:00.595612663Z [2024-04-28T01:56:00.595+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:56:00.595638999Z 2024-04-28T01:56:00.595643144Z 2024-04-28T01:56:00.595646509Z 2024-04-28T01:56:00.596102874Z [2024-04-28T01:56:00.595+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:56:00.596359600Z [2024-04-28T01:56:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:56:00.596583013Z [2024-04-28T01:56:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:56:00.597717001Z [2024-04-28T01:56:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:56:00.597728194Z 2024-04-28T01:56:00.597732883Z 2024-04-28T01:56:00.597737538Z 2024-04-28T01:56:00.601841476Z [2024-04-28T01:56:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:56:00.602148082Z [2024-04-28T01:56:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:56:00.602596561Z [2024-04-28T01:56:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:56:00.602855524Z [2024-04-28T01:56:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:56:00.603279391Z [2024-04-28T01:56:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:56:00.603516422Z [2024-04-28T01:56:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:56:00.843266202Z [2024-04-28T01:56:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:54:00+00:00 exited with status queued for try_number 1 2024-04-28T01:56:00.843723932Z [2024-04-28T01:56:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status queued for try_number 1 2024-04-28T01:56:00.844033824Z [2024-04-28T01:56:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status queued for try_number 1 2024-04-28T01:56:00.851839157Z [2024-04-28T01:56:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 912293f2-3a61-43f6-a7b5-c510cf08c81d 2024-04-28T01:56:00.852141464Z [2024-04-28T01:56:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb213eb0-e5d6-456e-b609-69bbcc7a2fed 2024-04-28T01:56:00.852324994Z [2024-04-28T01:56:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6164b78c-ec57-4715-b6d5-8119dc12c06a 2024-04-28T01:56:01.992032303Z [2024-04-28T01:56:01.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:56:01.992458359Z [2024-04-28T01:56:01.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:54:00+00:00, run_id=scheduled__2024-04-28T01:54:00+00:00, run_start_date=2024-04-28 01:56:00.536867+00:00, run_end_date=2024-04-28 01:56:01.991932+00:00, run_duration=1.455065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:54:00+00:00, data_interval_end=2024-04-28 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:56:02.004533347Z [2024-04-28T01:56:02.004+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:56:00+00:00, run_after=2024-04-28T01:58:00+00:00 2024-04-28T01:56:02.080508153Z [2024-04-28T01:56:02.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:54:00+00:00 exited with status success for try_number 1 2024-04-28T01:56:02.091416680Z [2024-04-28T01:56:02.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:54:00+00:00, map_index=-1, run_start_date=2024-04-28 01:56:01.314042+00:00, run_end_date=2024-04-28 01:56:01.678976+00:00, run_duration=0.364934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:56:00.598784+00:00, queued_by_job_id=1, pid=2264 2024-04-28T01:56:04.608072210Z [2024-04-28T01:56:04.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:56:04.608478656Z [2024-04-28T01:56:04.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:55:00+00:00, run_id=scheduled__2024-04-28T01:55:00+00:00, run_start_date=2024-04-28 01:56:00.538916+00:00, run_end_date=2024-04-28 01:56:04.608139+00:00, run_duration=4.069223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:55:00+00:00, data_interval_end=2024-04-28 01:56:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:56:04.625684282Z [2024-04-28T01:56:04.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:56:00+00:00, run_after=2024-04-28T01:57:00+00:00 2024-04-28T01:56:04.633442228Z [2024-04-28T01:56:04.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:56:04.635160126Z [2024-04-28T01:56:04.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:55:00+00:00, run_id=scheduled__2024-04-28T01:55:00+00:00, run_start_date=2024-04-28 01:56:00.540300+00:00, run_end_date=2024-04-28 01:56:04.633482+00:00, run_duration=4.093182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:55:00+00:00, data_interval_end=2024-04-28 01:56:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:56:04.650404074Z [2024-04-28T01:56:04.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:56:00+00:00, run_after=2024-04-28T01:57:00+00:00 2024-04-28T01:56:04.691262536Z [2024-04-28T01:56:04.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status success for try_number 1 2024-04-28T01:56:04.691376073Z [2024-04-28T01:56:04.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status success for try_number 1 2024-04-28T01:56:04.707380275Z [2024-04-28T01:56:04.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:55:00+00:00, map_index=-1, run_start_date=2024-04-28 01:56:02.532405+00:00, run_end_date=2024-04-28 01:56:04.309697+00:00, run_duration=1.777292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:56:00.598784+00:00, queued_by_job_id=1, pid=2305 2024-04-28T01:56:04.726238731Z [2024-04-28T01:56:04.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:55:00+00:00, map_index=-1, run_start_date=2024-04-28 01:56:02.513769+00:00, run_end_date=2024-04-28 01:56:04.021193+00:00, run_duration=1.507424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:56:00.598784+00:00, queued_by_job_id=1, pid=2304 2024-04-28T01:56:15.738478397Z [2024-04-28T01:56:15.738+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T01:57:00.302215052Z [2024-04-28T01:57:00.301+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:57:00.315182465Z [2024-04-28T01:57:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:57:00+00:00, run_after=2024-04-28T01:58:00+00:00 2024-04-28T01:57:00.370835867Z [2024-04-28T01:57:00.370+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:57:00.370860126Z 2024-04-28T01:57:00.370864178Z 2024-04-28T01:57:00.371063570Z [2024-04-28T01:57:00.370+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:57:00.371221892Z [2024-04-28T01:57:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:57:00.371816142Z [2024-04-28T01:57:00.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:57:00.371832249Z 2024-04-28T01:57:00.371836573Z 2024-04-28T01:57:00.374214998Z [2024-04-28T01:57:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:57:00.374516309Z [2024-04-28T01:57:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:57:00.374828882Z [2024-04-28T01:57:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:57:00.374994663Z [2024-04-28T01:57:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:57:00.592749857Z [2024-04-28T01:57:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:56:00+00:00 exited with status queued for try_number 1 2024-04-28T01:57:00.592779267Z [2024-04-28T01:57:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:56:00+00:00 exited with status queued for try_number 1 2024-04-28T01:57:00.598798621Z [2024-04-28T01:57:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1afd71ac-f86a-4f97-8bb6-18f4510e8948 2024-04-28T01:57:00.598856610Z [2024-04-28T01:57:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1cdcdc9-938e-47b3-bff9-a51e682e3120 2024-04-28T01:57:03.952813720Z [2024-04-28T01:57:03.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:57:03.953351849Z [2024-04-28T01:57:03.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:56:00+00:00, run_id=scheduled__2024-04-28T01:56:00+00:00, run_start_date=2024-04-28 01:57:00.326779+00:00, run_end_date=2024-04-28 01:57:03.952708+00:00, run_duration=3.625929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:56:00+00:00, data_interval_end=2024-04-28 01:57:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:57:03.965381678Z [2024-04-28T01:57:03.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:57:00+00:00, run_after=2024-04-28T01:58:00+00:00 2024-04-28T01:57:04.018015335Z [2024-04-28T01:57:04.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:56:00+00:00 exited with status success for try_number 1 2024-04-28T01:57:04.028520886Z [2024-04-28T01:57:04.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:56:00+00:00, map_index=-1, run_start_date=2024-04-28 01:57:02.276842+00:00, run_end_date=2024-04-28 01:57:03.511070+00:00, run_duration=1.234228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:57:00.372284+00:00, queued_by_job_id=1, pid=2359 2024-04-28T01:57:04.319687707Z [2024-04-28T01:57:04.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:57:04.320067710Z [2024-04-28T01:57:04.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:56:00+00:00, run_id=scheduled__2024-04-28T01:56:00+00:00, run_start_date=2024-04-28 01:57:00.325243+00:00, run_end_date=2024-04-28 01:57:04.319608+00:00, run_duration=3.994365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:56:00+00:00, data_interval_end=2024-04-28 01:57:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:57:04.328663275Z [2024-04-28T01:57:04.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:57:00+00:00, run_after=2024-04-28T01:58:00+00:00 2024-04-28T01:57:04.355470524Z [2024-04-28T01:57:04.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:56:00+00:00 exited with status success for try_number 1 2024-04-28T01:57:04.361307665Z [2024-04-28T01:57:04.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:56:00+00:00, map_index=-1, run_start_date=2024-04-28 01:57:02.271571+00:00, run_end_date=2024-04-28 01:57:04.015214+00:00, run_duration=1.743643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:57:00.372284+00:00, queued_by_job_id=1, pid=2360 2024-04-28T01:58:00.107215543Z [2024-04-28T01:58:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:58:00+00:00, run_after=2024-04-28T01:59:00+00:00 2024-04-28T01:58:00.118410858Z [2024-04-28T01:58:00.118+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:58:00.125294295Z [2024-04-28T01:58:00.124+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:58:00.178790845Z [2024-04-28T01:58:00.178+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T01:58:00.178826485Z 2024-04-28T01:58:00.178833574Z 2024-04-28T01:58:00.178836852Z 2024-04-28T01:58:00.179103312Z [2024-04-28T01:58:00.178+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T01:58:00.179282673Z [2024-04-28T01:58:00.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:58:00.179485569Z [2024-04-28T01:58:00.179+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:58:00.180087724Z [2024-04-28T01:58:00.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:58:00.180109068Z 2024-04-28T01:58:00.180117517Z 2024-04-28T01:58:00.180124109Z 2024-04-28T01:58:00.183093557Z [2024-04-28T01:58:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:58:00.183328152Z [2024-04-28T01:58:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T01:58:00.183622945Z [2024-04-28T01:58:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:58:00.183895006Z [2024-04-28T01:58:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:58:00.184112557Z [2024-04-28T01:58:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:58:00.184264331Z [2024-04-28T01:58:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:58:00.484851607Z [2024-04-28T01:58:00.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:56:00+00:00 exited with status queued for try_number 1 2024-04-28T01:58:00.484939224Z [2024-04-28T01:58:00.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:57:00+00:00 exited with status queued for try_number 1 2024-04-28T01:58:00.485056153Z [2024-04-28T01:58:00.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:57:00+00:00 exited with status queued for try_number 1 2024-04-28T01:58:00.492309878Z [2024-04-28T01:58:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to f303204e-563b-4ad2-919d-b798340c3c8b 2024-04-28T01:58:00.492453821Z [2024-04-28T01:58:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73b1e2f5-0043-4485-8d82-46add1e1117e 2024-04-28T01:58:00.492610613Z [2024-04-28T01:58:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to d77f7d57-5ef3-447d-9e06-56cc349ec1df 2024-04-28T01:58:01.624305966Z [2024-04-28T01:58:01.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:58:01.624642996Z [2024-04-28T01:58:01.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:56:00+00:00, run_id=scheduled__2024-04-28T01:56:00+00:00, run_start_date=2024-04-28 01:58:00.134887+00:00, run_end_date=2024-04-28 01:58:01.624131+00:00, run_duration=1.489244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:56:00+00:00, data_interval_end=2024-04-28 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T01:58:01.632044559Z [2024-04-28T01:58:01.631+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T01:58:00+00:00, run_after=2024-04-28T02:00:00+00:00 2024-04-28T01:58:01.698352290Z [2024-04-28T01:58:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:56:00+00:00 exited with status success for try_number 1 2024-04-28T01:58:01.709242369Z [2024-04-28T01:58:01.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:56:00+00:00, map_index=-1, run_start_date=2024-04-28 01:58:00.951910+00:00, run_end_date=2024-04-28 01:58:01.355634+00:00, run_duration=0.403724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:58:00.180842+00:00, queued_by_job_id=1, pid=2385 2024-04-28T01:58:04.963761932Z [2024-04-28T01:58:04.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:58:04.963792853Z [2024-04-28T01:58:04.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:57:00+00:00, run_id=scheduled__2024-04-28T01:57:00+00:00, run_start_date=2024-04-28 01:58:00.136326+00:00, run_end_date=2024-04-28 01:58:04.962698+00:00, run_duration=4.826372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:57:00+00:00, data_interval_end=2024-04-28 01:58:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:58:04.988830572Z [2024-04-28T01:58:04.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:58:00+00:00, run_after=2024-04-28T01:59:00+00:00 2024-04-28T01:58:04.995880416Z [2024-04-28T01:58:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:58:04.996042072Z [2024-04-28T01:58:04.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:57:00+00:00, run_id=scheduled__2024-04-28T01:57:00+00:00, run_start_date=2024-04-28 01:58:00.137472+00:00, run_end_date=2024-04-28 01:58:04.995790+00:00, run_duration=4.858318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:57:00+00:00, data_interval_end=2024-04-28 01:58:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:58:05.011550611Z [2024-04-28T01:58:05.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:58:00+00:00, run_after=2024-04-28T01:59:00+00:00 2024-04-28T01:58:05.061523186Z [2024-04-28T01:58:05.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:57:00+00:00 exited with status success for try_number 1 2024-04-28T01:58:05.061654578Z [2024-04-28T01:58:05.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:57:00+00:00 exited with status success for try_number 1 2024-04-28T01:58:05.073330817Z [2024-04-28T01:58:05.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:57:00+00:00, map_index=-1, run_start_date=2024-04-28 01:58:02.393410+00:00, run_end_date=2024-04-28 01:58:03.860172+00:00, run_duration=1.466762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:58:00.180842+00:00, queued_by_job_id=1, pid=2425 2024-04-28T01:58:05.074413529Z [2024-04-28T01:58:05.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:57:00+00:00, map_index=-1, run_start_date=2024-04-28 01:58:02.376136+00:00, run_end_date=2024-04-28 01:58:04.165474+00:00, run_duration=1.789338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:58:00.180842+00:00, queued_by_job_id=1, pid=2424 2024-04-28T01:59:00.805145655Z [2024-04-28T01:59:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:59:00+00:00, run_after=2024-04-28T02:00:00+00:00 2024-04-28T01:59:00.812301531Z [2024-04-28T01:59:00.812+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T01:59:00.864788630Z [2024-04-28T01:59:00.864+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T01:59:00.864812145Z 2024-04-28T01:59:00.864817292Z 2024-04-28T01:59:00.865062258Z [2024-04-28T01:59:00.864+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:59:00.865283712Z [2024-04-28T01:59:00.865+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T01:59:00.865888649Z [2024-04-28T01:59:00.865+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T01:59:00.865899493Z 2024-04-28T01:59:00.865902936Z 2024-04-28T01:59:00.868828614Z [2024-04-28T01:59:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:59:00.869096890Z [2024-04-28T01:59:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T01:59:00.869469382Z [2024-04-28T01:59:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T01:59:00.869764920Z [2024-04-28T01:59:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T01:59:01.072319854Z [2024-04-28T01:59:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:58:00+00:00 exited with status queued for try_number 1 2024-04-28T01:59:01.072342756Z [2024-04-28T01:59:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:58:00+00:00 exited with status queued for try_number 1 2024-04-28T01:59:01.081836136Z [2024-04-28T01:59:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfd5cf48-cbce-4f11-9482-c2cdcf2ab756 2024-04-28T01:59:01.082117547Z [2024-04-28T01:59:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ad28def-5158-458a-ae9a-079693252b29 2024-04-28T01:59:05.864030552Z [2024-04-28T01:59:05.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:59:05.864389057Z [2024-04-28T01:59:05.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:58:00+00:00, run_id=scheduled__2024-04-28T01:58:00+00:00, run_start_date=2024-04-28 01:59:00.821488+00:00, run_end_date=2024-04-28 01:59:05.864002+00:00, run_duration=5.042514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:58:00+00:00, data_interval_end=2024-04-28 01:59:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T01:59:05.881592951Z [2024-04-28T01:59:05.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:59:00+00:00, run_after=2024-04-28T02:00:00+00:00 2024-04-28T01:59:05.897500053Z [2024-04-28T01:59:05.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T01:59:05.897773170Z [2024-04-28T01:59:05.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:58:00+00:00, run_id=scheduled__2024-04-28T01:58:00+00:00, run_start_date=2024-04-28 01:59:00.822630+00:00, run_end_date=2024-04-28 01:59:05.897388+00:00, run_duration=5.074758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:58:00+00:00, data_interval_end=2024-04-28 01:59:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T01:59:05.918426068Z [2024-04-28T01:59:05.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T01:59:00+00:00, run_after=2024-04-28T02:00:00+00:00 2024-04-28T01:59:05.991235190Z [2024-04-28T01:59:05.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:58:00+00:00 exited with status success for try_number 1 2024-04-28T01:59:05.992442184Z [2024-04-28T01:59:05.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:58:00+00:00 exited with status success for try_number 1 2024-04-28T01:59:05.999974421Z [2024-04-28T01:59:05.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:58:00+00:00, map_index=-1, run_start_date=2024-04-28 01:59:03.293739+00:00, run_end_date=2024-04-28 01:59:04.880336+00:00, run_duration=1.586597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:59:00.866544+00:00, queued_by_job_id=1, pid=2481 2024-04-28T01:59:06.001568727Z [2024-04-28T01:59:05.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:58:00+00:00, map_index=-1, run_start_date=2024-04-28 01:59:03.023401+00:00, run_end_date=2024-04-28 01:59:05.051577+00:00, run_duration=2.028176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 01:59:00.866544+00:00, queued_by_job_id=1, pid=2478 2024-04-28T02:00:00.164896152Z [2024-04-28T02:00:00.164+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:00:00.179176553Z [2024-04-28T02:00:00.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:00:00+00:00, run_after=2024-04-28T02:05:00+00:00 2024-04-28T02:00:00.196532247Z [2024-04-28T02:00:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:00:00+00:00, run_after=2024-04-28T02:01:00+00:00 2024-04-28T02:00:00.204352057Z [2024-04-28T02:00:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:00:00.298862753Z [2024-04-28T02:00:00.298+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:00:00.298886415Z 2024-04-28T02:00:00.298889950Z 2024-04-28T02:00:00.298893486Z 2024-04-28T02:00:00.298896804Z 2024-04-28T02:00:00.299097922Z [2024-04-28T02:00:00.298+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:00:00.299339729Z [2024-04-28T02:00:00.299+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:00:00.299660085Z [2024-04-28T02:00:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:00:00.299932027Z [2024-04-28T02:00:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:00:00.300939228Z [2024-04-28T02:00:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:00:00.300947813Z 2024-04-28T02:00:00.300951681Z 2024-04-28T02:00:00.300955089Z 2024-04-28T02:00:00.300958188Z 2024-04-28T02:00:00.305271042Z [2024-04-28T02:00:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:00:00.305491526Z [2024-04-28T02:00:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:00:00.305858790Z [2024-04-28T02:00:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:00:00.306080426Z [2024-04-28T02:00:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:00:00.306669416Z [2024-04-28T02:00:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:00:00.306837026Z [2024-04-28T02:00:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:00:00.307148514Z [2024-04-28T02:00:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:00:00.307292594Z [2024-04-28T02:00:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:00:00.573854537Z [2024-04-28T02:00:00.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:00.576222706Z [2024-04-28T02:00:00.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:58:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:00.576396906Z [2024-04-28T02:00:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:59:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:00.576650879Z [2024-04-28T02:00:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:59:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:00.587035930Z [2024-04-28T02:00:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf71aca3-0b12-4b61-bba6-c2e236cf2f15 2024-04-28T02:00:00.587493857Z [2024-04-28T02:00:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to e55f631c-cd1e-4b99-9d63-3c00ebe9efd1 2024-04-28T02:00:00.587790290Z [2024-04-28T02:00:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e2ead43-f604-4a59-93bc-f123229bb571 2024-04-28T02:00:00.588073708Z [2024-04-28T02:00:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5bb200a-a792-4a17-aaee-d3e6c6f432ea 2024-04-28T02:00:01.866275674Z [2024-04-28T02:00:01.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:00:01.867105478Z [2024-04-28T02:00:01.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 01:58:00+00:00, run_id=scheduled__2024-04-28T01:58:00+00:00, run_start_date=2024-04-28 02:00:00.217148+00:00, run_end_date=2024-04-28 02:00:01.866404+00:00, run_duration=1.649256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:58:00+00:00, data_interval_end=2024-04-28 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:00:01.883613135Z [2024-04-28T02:00:01.883+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:00:00+00:00, run_after=2024-04-28T02:02:00+00:00 2024-04-28T02:00:02.034459845Z [2024-04-28T02:00:02.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T01:58:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:02.053516148Z [2024-04-28T02:00:02.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T01:58:00+00:00, map_index=-1, run_start_date=2024-04-28 02:00:01.081193+00:00, run_end_date=2024-04-28 02:00:01.480026+00:00, run_duration=0.398833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:00.302159+00:00, queued_by_job_id=1, pid=2505 2024-04-28T02:00:03.421905596Z [2024-04-28T02:00:03.421+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:00:03.421945226Z 2024-04-28T02:00:03.421949618Z [2024-04-28T02:00:03.421+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:00:03.422418183Z [2024-04-28T02:00:03.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:00:03.422431741Z 2024-04-28T02:00:03.425918610Z [2024-04-28T02:00:03.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:00:03.425958229Z [2024-04-28T02:00:03.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:00:03.477890936Z [2024-04-28T02:00:03.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:03.478782094Z [2024-04-28T02:00:03.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:03.488790012Z [2024-04-28T02:00:03.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0beb027-4695-43d9-80b6-230dad34e39d 2024-04-28T02:00:03.489289037Z [2024-04-28T02:00:03.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T01:55:00+00:00, map_index=-1, run_start_date=2024-04-28 02:00:02.556845+00:00, run_end_date=2024-04-28 02:00:02.986254+00:00, run_duration=0.429409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:00.302159+00:00, queued_by_job_id=1, pid=2557 2024-04-28T02:00:04.648918812Z [2024-04-28T02:00:04.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:00:04.649429980Z [2024-04-28T02:00:04.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:59:00+00:00, run_id=scheduled__2024-04-28T01:59:00+00:00, run_start_date=2024-04-28 02:00:00.218470+00:00, run_end_date=2024-04-28 02:00:04.648822+00:00, run_duration=4.430352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:59:00+00:00, data_interval_end=2024-04-28 02:00:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:00:04.658254723Z [2024-04-28T02:00:04.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:00:00+00:00, run_after=2024-04-28T02:01:00+00:00 2024-04-28T02:00:04.704039774Z [2024-04-28T02:00:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:59:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:04.708646805Z [2024-04-28T02:00:04.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:59:00+00:00, map_index=-1, run_start_date=2024-04-28 02:00:02.532772+00:00, run_end_date=2024-04-28 02:00:03.906582+00:00, run_duration=1.37381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:00.302159+00:00, queued_by_job_id=1, pid=2556 2024-04-28T02:00:05.768073834Z [2024-04-28T02:00:05.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:00:05.768384315Z [2024-04-28T02:00:05.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:59:00+00:00, run_id=scheduled__2024-04-28T01:59:00+00:00, run_start_date=2024-04-28 02:00:00.219648+00:00, run_end_date=2024-04-28 02:00:05.767992+00:00, run_duration=5.548344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:59:00+00:00, data_interval_end=2024-04-28 02:00:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:00:05.791716365Z [2024-04-28T02:00:05.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:00:00+00:00, run_after=2024-04-28T02:01:00+00:00 2024-04-28T02:00:05.896201654Z [2024-04-28T02:00:05.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T01:59:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:05.901432563Z [2024-04-28T02:00:05.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T01:59:00+00:00, map_index=-1, run_start_date=2024-04-28 02:00:02.458016+00:00, run_end_date=2024-04-28 02:00:05.335351+00:00, run_duration=2.877335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:00.302159+00:00, queued_by_job_id=1, pid=2555 2024-04-28T02:00:06.995392482Z [2024-04-28T02:00:06.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:00:06.995437911Z 2024-04-28T02:00:06.995442314Z [2024-04-28T02:00:06.995+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:00:06.995949334Z [2024-04-28T02:00:06.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:00:06.995957827Z 2024-04-28T02:00:06.998232358Z [2024-04-28T02:00:06.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:00:06.998354482Z [2024-04-28T02:00:06.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:00:07.062533653Z [2024-04-28T02:00:07.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:07.063144880Z [2024-04-28T02:00:07.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:07.075150922Z [2024-04-28T02:00:07.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c160795-eb30-4aba-b6d3-77828f240106 2024-04-28T02:00:07.075704585Z [2024-04-28T02:00:07.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T01:55:00+00:00, map_index=-1, run_start_date=2024-04-28 02:00:05.612864+00:00, run_end_date=2024-04-28 02:00:06.162302+00:00, run_duration=0.549438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:03.423419+00:00, queued_by_job_id=1, pid=2599 2024-04-28T02:00:09.120172446Z [2024-04-28T02:00:09.119+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:00:09.120217470Z 2024-04-28T02:00:09.120227019Z [2024-04-28T02:00:09.119+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:00:09.120647791Z [2024-04-28T02:00:09.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:00:09.120690943Z 2024-04-28T02:00:09.122642439Z [2024-04-28T02:00:09.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:00:09.122689251Z [2024-04-28T02:00:09.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:00:09.186029981Z [2024-04-28T02:00:09.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status queued for try_number 1 2024-04-28T02:00:09.193694099Z [2024-04-28T02:00:09.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b13e2be-08b0-4382-8a38-06d2a46b3de7 2024-04-28T02:00:09.274700443Z [2024-04-28T02:00:09.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:09.279472497Z [2024-04-28T02:00:09.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T01:55:00+00:00, map_index=0, run_start_date=2024-04-28 02:00:08.678066+00:00, run_end_date=2024-04-28 02:00:09.046101+00:00, run_duration=0.368035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:06.996235+00:00, queued_by_job_id=1, pid=2611 2024-04-28T02:00:11.421597846Z [2024-04-28T02:00:11.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:00:11.421913877Z [2024-04-28T02:00:11.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 01:55:00+00:00, run_id=scheduled__2024-04-28T01:55:00+00:00, run_start_date=2024-04-28 02:00:00.215259+00:00, run_end_date=2024-04-28 02:00:11.421503+00:00, run_duration=11.206244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 01:55:00+00:00, data_interval_end=2024-04-28 02:00:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:00:11.428640609Z [2024-04-28T02:00:11.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:00:00+00:00, run_after=2024-04-28T02:05:00+00:00 2024-04-28T02:00:11.475766253Z [2024-04-28T02:00:11.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T01:55:00+00:00 exited with status success for try_number 1 2024-04-28T02:00:11.482206994Z [2024-04-28T02:00:11.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T01:55:00+00:00, map_index=-1, run_start_date=2024-04-28 02:00:10.716887+00:00, run_end_date=2024-04-28 02:00:11.054351+00:00, run_duration=0.337464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:00:09.120801+00:00, queued_by_job_id=1, pid=2623 2024-04-28T02:01:00.570878921Z [2024-04-28T02:01:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:01:00+00:00, run_after=2024-04-28T02:02:00+00:00 2024-04-28T02:01:00.578850212Z [2024-04-28T02:01:00.578+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:01:00.629587535Z [2024-04-28T02:01:00.629+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:01:00.629647912Z 2024-04-28T02:01:00.629659608Z 2024-04-28T02:01:00.629668365Z [2024-04-28T02:01:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:01:00.629783720Z [2024-04-28T02:01:00.629+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:01:00.630091716Z [2024-04-28T02:01:00.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:01:00.630108745Z 2024-04-28T02:01:00.630117690Z 2024-04-28T02:01:00.633236276Z [2024-04-28T02:01:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:01:00.633350562Z [2024-04-28T02:01:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:01:00.633426418Z [2024-04-28T02:01:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:01:00.633528306Z [2024-04-28T02:01:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:01:00.789155126Z [2024-04-28T02:01:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:01:00.789272448Z [2024-04-28T02:01:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:01:00.796164026Z [2024-04-28T02:01:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 403d802c-76ac-4c77-9547-d40543b01508 2024-04-28T02:01:00.796267264Z [2024-04-28T02:01:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to eda0c468-6273-498a-91ab-67b56da1d6a8 2024-04-28T02:01:04.184583516Z [2024-04-28T02:01:04.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:01:04.184632621Z [2024-04-28T02:01:04.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:00:00+00:00, run_id=scheduled__2024-04-28T02:00:00+00:00, run_start_date=2024-04-28 02:01:00.589611+00:00, run_end_date=2024-04-28 02:01:04.183674+00:00, run_duration=3.594063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:00:00+00:00, data_interval_end=2024-04-28 02:01:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:01:04.204276939Z [2024-04-28T02:01:04.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:01:00+00:00, run_after=2024-04-28T02:02:00+00:00 2024-04-28T02:01:04.214611968Z [2024-04-28T02:01:04.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:01:04.214634112Z [2024-04-28T02:01:04.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:00:00+00:00, run_id=scheduled__2024-04-28T02:00:00+00:00, run_start_date=2024-04-28 02:01:00.590770+00:00, run_end_date=2024-04-28 02:01:04.211875+00:00, run_duration=3.621105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:00:00+00:00, data_interval_end=2024-04-28 02:01:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:01:04.222134551Z [2024-04-28T02:01:04.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:01:00+00:00, run_after=2024-04-28T02:02:00+00:00 2024-04-28T02:01:04.279492096Z [2024-04-28T02:01:04.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:01:04.279514265Z [2024-04-28T02:01:04.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:01:04.300637350Z [2024-04-28T02:01:04.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=-1, run_start_date=2024-04-28 02:01:02.464803+00:00, run_end_date=2024-04-28 02:01:03.871902+00:00, run_duration=1.407099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:01:00.630512+00:00, queued_by_job_id=1, pid=2657 2024-04-28T02:01:04.304896911Z [2024-04-28T02:01:04.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=-1, run_start_date=2024-04-28 02:01:02.335471+00:00, run_end_date=2024-04-28 02:01:03.988433+00:00, run_duration=1.652962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:01:00.630512+00:00, queued_by_job_id=1, pid=2656 2024-04-28T02:01:15.788811645Z [2024-04-28T02:01:15.787+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:02:00.904082058Z [2024-04-28T02:02:00.903+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:02:00.911180384Z [2024-04-28T02:02:00.910+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:02:00.924149624Z [2024-04-28T02:02:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:02:00+00:00, run_after=2024-04-28T02:03:00+00:00 2024-04-28T02:02:00.985679036Z [2024-04-28T02:02:00.985+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:02:00.985711054Z 2024-04-28T02:02:00.985717399Z 2024-04-28T02:02:00.985721648Z 2024-04-28T02:02:00.985737108Z [2024-04-28T02:02:00.985+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:02:00.985785404Z [2024-04-28T02:02:00.985+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:02:00.985882447Z [2024-04-28T02:02:00.985+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:02:00.986584441Z [2024-04-28T02:02:00.986+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:02:00.986594824Z 2024-04-28T02:02:00.986614492Z 2024-04-28T02:02:00.986638317Z 2024-04-28T02:02:00.990454432Z [2024-04-28T02:02:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:02:00.990517012Z [2024-04-28T02:02:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:02:00.990889213Z [2024-04-28T02:02:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:02:00.990961349Z [2024-04-28T02:02:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:02:00.991252912Z [2024-04-28T02:02:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:02:00.991328038Z [2024-04-28T02:02:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:02:01.252361040Z [2024-04-28T02:02:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:02:01.253525682Z [2024-04-28T02:02:01.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:01:00+00:00 exited with status queued for try_number 1 2024-04-28T02:02:01.258703284Z [2024-04-28T02:02:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:01:00+00:00 exited with status queued for try_number 1 2024-04-28T02:02:01.267616730Z [2024-04-28T02:02:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8201b17f-6d0c-430d-a926-a8e04037afa6 2024-04-28T02:02:01.267711063Z [2024-04-28T02:02:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59737fc9-c684-426a-98f1-4bcc2950493e 2024-04-28T02:02:01.267890481Z [2024-04-28T02:02:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to a99a4cd1-739d-4464-b340-7d68e05d4d84 2024-04-28T02:02:02.391316992Z [2024-04-28T02:02:02.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:02:02.391634185Z [2024-04-28T02:02:02.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:00:00+00:00, run_id=scheduled__2024-04-28T02:00:00+00:00, run_start_date=2024-04-28 02:02:00.933469+00:00, run_end_date=2024-04-28 02:02:02.391192+00:00, run_duration=1.457723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:00:00+00:00, data_interval_end=2024-04-28 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:02:02.410770306Z [2024-04-28T02:02:02.410+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:02:00+00:00, run_after=2024-04-28T02:04:00+00:00 2024-04-28T02:02:02.468539554Z [2024-04-28T02:02:02.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:02:02.473479692Z [2024-04-28T02:02:02.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=-1, run_start_date=2024-04-28 02:02:01.760774+00:00, run_end_date=2024-04-28 02:02:02.169065+00:00, run_duration=0.408291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:02:00.987398+00:00, queued_by_job_id=1, pid=2682 2024-04-28T02:02:04.997477839Z [2024-04-28T02:02:04.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:02:04.997506687Z [2024-04-28T02:02:04.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:01:00+00:00, run_id=scheduled__2024-04-28T02:01:00+00:00, run_start_date=2024-04-28 02:02:00.935866+00:00, run_end_date=2024-04-28 02:02:04.994267+00:00, run_duration=4.058401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:01:00+00:00, data_interval_end=2024-04-28 02:02:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:02:05.008408139Z [2024-04-28T02:02:05.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:02:00+00:00, run_after=2024-04-28T02:03:00+00:00 2024-04-28T02:02:05.087395591Z [2024-04-28T02:02:05.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:01:00+00:00 exited with status success for try_number 1 2024-04-28T02:02:05.104350502Z [2024-04-28T02:02:05.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:01:00+00:00, map_index=-1, run_start_date=2024-04-28 02:02:03.268792+00:00, run_end_date=2024-04-28 02:02:04.854942+00:00, run_duration=1.58615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:02:00.987398+00:00, queued_by_job_id=1, pid=2723 2024-04-28T02:02:06.170491892Z [2024-04-28T02:02:06.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:02:06.171255326Z [2024-04-28T02:02:06.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:01:00+00:00, run_id=scheduled__2024-04-28T02:01:00+00:00, run_start_date=2024-04-28 02:02:00.934778+00:00, run_end_date=2024-04-28 02:02:06.170658+00:00, run_duration=5.23588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:01:00+00:00, data_interval_end=2024-04-28 02:02:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:02:06.192723666Z [2024-04-28T02:02:06.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:02:00+00:00, run_after=2024-04-28T02:03:00+00:00 2024-04-28T02:02:06.230535320Z [2024-04-28T02:02:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:01:00+00:00 exited with status success for try_number 1 2024-04-28T02:02:06.237428269Z [2024-04-28T02:02:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:01:00+00:00, map_index=-1, run_start_date=2024-04-28 02:02:03.146181+00:00, run_end_date=2024-04-28 02:02:05.075661+00:00, run_duration=1.92948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:02:00.987398+00:00, queued_by_job_id=1, pid=2722 2024-04-28T02:03:00.201758050Z [2024-04-28T02:03:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:03:00+00:00, run_after=2024-04-28T02:04:00+00:00 2024-04-28T02:03:00.211409893Z [2024-04-28T02:03:00.211+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:03:00.283350338Z [2024-04-28T02:03:00.282+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:03:00.283373113Z 2024-04-28T02:03:00.283376858Z 2024-04-28T02:03:00.284179674Z [2024-04-28T02:03:00.283+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:03:00.285254066Z [2024-04-28T02:03:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:03:00.286694504Z [2024-04-28T02:03:00.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:03:00.286704905Z 2024-04-28T02:03:00.286708512Z 2024-04-28T02:03:00.291441039Z [2024-04-28T02:03:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:03:00.291661730Z [2024-04-28T02:03:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:03:00.291998747Z [2024-04-28T02:03:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:03:00.292160947Z [2024-04-28T02:03:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:03:00.472559937Z [2024-04-28T02:03:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:02:00+00:00 exited with status queued for try_number 1 2024-04-28T02:03:00.472854548Z [2024-04-28T02:03:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:02:00+00:00 exited with status queued for try_number 1 2024-04-28T02:03:00.490531789Z [2024-04-28T02:03:00.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c924927-ec5e-4d3f-ab8c-4067503c2c79 2024-04-28T02:03:00.490566327Z [2024-04-28T02:03:00.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53cab9d5-b090-49dc-86ec-a01149197a76 2024-04-28T02:03:03.846268118Z [2024-04-28T02:03:03.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:03:03.846627887Z [2024-04-28T02:03:03.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:02:00+00:00, run_id=scheduled__2024-04-28T02:02:00+00:00, run_start_date=2024-04-28 02:03:00.223595+00:00, run_end_date=2024-04-28 02:03:03.846177+00:00, run_duration=3.622582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:02:00+00:00, data_interval_end=2024-04-28 02:03:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:03:03.857282691Z [2024-04-28T02:03:03.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:03:00+00:00, run_after=2024-04-28T02:04:00+00:00 2024-04-28T02:03:03.868011373Z [2024-04-28T02:03:03.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:03:03.868346831Z [2024-04-28T02:03:03.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:02:00+00:00, run_id=scheduled__2024-04-28T02:02:00+00:00, run_start_date=2024-04-28 02:03:00.224996+00:00, run_end_date=2024-04-28 02:03:03.867939+00:00, run_duration=3.642943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:02:00+00:00, data_interval_end=2024-04-28 02:03:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:03:03.882445933Z [2024-04-28T02:03:03.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:03:00+00:00, run_after=2024-04-28T02:04:00+00:00 2024-04-28T02:03:03.914964822Z [2024-04-28T02:03:03.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:02:00+00:00 exited with status success for try_number 1 2024-04-28T02:03:03.914992589Z [2024-04-28T02:03:03.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:02:00+00:00 exited with status success for try_number 1 2024-04-28T02:03:03.921622240Z [2024-04-28T02:03:03.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:02:00+00:00, map_index=-1, run_start_date=2024-04-28 02:03:02.027412+00:00, run_end_date=2024-04-28 02:03:03.348508+00:00, run_duration=1.321096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:03:00.287908+00:00, queued_by_job_id=1, pid=2779 2024-04-28T02:03:03.921810100Z [2024-04-28T02:03:03.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:02:00+00:00, map_index=-1, run_start_date=2024-04-28 02:03:02.000070+00:00, run_end_date=2024-04-28 02:03:03.580564+00:00, run_duration=1.580494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:03:00.287908+00:00, queued_by_job_id=1, pid=2778 2024-04-28T02:04:00.609885459Z [2024-04-28T02:04:00.609+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:04:00.629138161Z [2024-04-28T02:04:00.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:04:00+00:00, run_after=2024-04-28T02:05:00+00:00 2024-04-28T02:04:00.640334322Z [2024-04-28T02:04:00.639+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:04:00.752156787Z [2024-04-28T02:04:00.751+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:04:00.752198680Z 2024-04-28T02:04:00.752217031Z 2024-04-28T02:04:00.752224655Z 2024-04-28T02:04:00.752277753Z [2024-04-28T02:04:00.752+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:04:00.752422016Z [2024-04-28T02:04:00.752+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:04:00.752588709Z [2024-04-28T02:04:00.752+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:04:00.753355105Z [2024-04-28T02:04:00.753+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:04:00.753369959Z 2024-04-28T02:04:00.753377124Z 2024-04-28T02:04:00.753383871Z 2024-04-28T02:04:00.757577005Z [2024-04-28T02:04:00.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:04:00.757667702Z [2024-04-28T02:04:00.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:04:00.757908997Z [2024-04-28T02:04:00.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:04:00.757983506Z [2024-04-28T02:04:00.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:04:00.758240122Z [2024-04-28T02:04:00.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:04:00.758553971Z [2024-04-28T02:04:00.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:04:00.987855356Z [2024-04-28T02:04:00.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:02:00+00:00 exited with status queued for try_number 1 2024-04-28T02:04:00.990848606Z [2024-04-28T02:04:00.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:03:00+00:00 exited with status queued for try_number 1 2024-04-28T02:04:00.991069235Z [2024-04-28T02:04:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:03:00+00:00 exited with status queued for try_number 1 2024-04-28T02:04:01.003243753Z [2024-04-28T02:04:01.002+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d14d1c5-65fe-4bbc-8db1-964ce95c4f2d 2024-04-28T02:04:01.003458038Z [2024-04-28T02:04:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48790983-7bf4-4a90-8446-5cad9fd6264e 2024-04-28T02:04:01.003633751Z [2024-04-28T02:04:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1aa7658f-3de8-437e-9dab-ff8144d6a41f 2024-04-28T02:04:02.155571925Z [2024-04-28T02:04:02.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:04:02.156178415Z [2024-04-28T02:04:02.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:02:00+00:00, run_id=scheduled__2024-04-28T02:02:00+00:00, run_start_date=2024-04-28 02:04:00.653627+00:00, run_end_date=2024-04-28 02:04:02.155739+00:00, run_duration=1.502112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:02:00+00:00, data_interval_end=2024-04-28 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:04:02.164497106Z [2024-04-28T02:04:02.164+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:04:00+00:00, run_after=2024-04-28T02:06:00+00:00 2024-04-28T02:04:02.209855818Z [2024-04-28T02:04:02.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:02:00+00:00 exited with status success for try_number 1 2024-04-28T02:04:02.218692331Z [2024-04-28T02:04:02.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:02:00+00:00, map_index=-1, run_start_date=2024-04-28 02:04:01.544675+00:00, run_end_date=2024-04-28 02:04:01.949979+00:00, run_duration=0.405304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:04:00.754164+00:00, queued_by_job_id=1, pid=2804 2024-04-28T02:04:05.481202252Z [2024-04-28T02:04:05.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:04:05.481773436Z [2024-04-28T02:04:05.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:03:00+00:00, run_id=scheduled__2024-04-28T02:03:00+00:00, run_start_date=2024-04-28 02:04:00.655129+00:00, run_end_date=2024-04-28 02:04:05.481103+00:00, run_duration=4.825974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:03:00+00:00, data_interval_end=2024-04-28 02:04:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:04:05.494944793Z [2024-04-28T02:04:05.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:04:00+00:00, run_after=2024-04-28T02:05:00+00:00 2024-04-28T02:04:05.501762741Z [2024-04-28T02:04:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:04:05.502025717Z [2024-04-28T02:04:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:03:00+00:00, run_id=scheduled__2024-04-28T02:03:00+00:00, run_start_date=2024-04-28 02:04:00.656361+00:00, run_end_date=2024-04-28 02:04:05.501712+00:00, run_duration=4.845351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:03:00+00:00, data_interval_end=2024-04-28 02:04:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:04:05.515238330Z [2024-04-28T02:04:05.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:04:00+00:00, run_after=2024-04-28T02:05:00+00:00 2024-04-28T02:04:05.577118179Z [2024-04-28T02:04:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:03:00+00:00 exited with status success for try_number 1 2024-04-28T02:04:05.577232619Z [2024-04-28T02:04:05.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:03:00+00:00 exited with status success for try_number 1 2024-04-28T02:04:05.592490301Z [2024-04-28T02:04:05.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:03:00+00:00, map_index=-1, run_start_date=2024-04-28 02:04:02.740656+00:00, run_end_date=2024-04-28 02:04:04.358705+00:00, run_duration=1.618049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:04:00.754164+00:00, queued_by_job_id=1, pid=2844 2024-04-28T02:04:05.605939940Z [2024-04-28T02:04:05.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:03:00+00:00, map_index=-1, run_start_date=2024-04-28 02:04:02.736975+00:00, run_end_date=2024-04-28 02:04:04.423431+00:00, run_duration=1.686456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:04:00.754164+00:00, queued_by_job_id=1, pid=2843 2024-04-28T02:05:00.097640315Z [2024-04-28T02:05:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:05:00+00:00, run_after=2024-04-28T02:06:00+00:00 2024-04-28T02:05:00.113596450Z [2024-04-28T02:05:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:05:00.134153395Z [2024-04-28T02:05:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:05:00+00:00, run_after=2024-04-28T02:10:00+00:00 2024-04-28T02:05:00.233821028Z [2024-04-28T02:05:00.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:05:00.233844336Z 2024-04-28T02:05:00.233848591Z 2024-04-28T02:05:00.233851844Z 2024-04-28T02:05:00.233985203Z [2024-04-28T02:05:00.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:05:00.234155708Z [2024-04-28T02:05:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:05:00.234395810Z [2024-04-28T02:05:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:05:00.235677500Z [2024-04-28T02:05:00.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:05:00.235697272Z 2024-04-28T02:05:00.235701100Z 2024-04-28T02:05:00.235704229Z 2024-04-28T02:05:00.240974568Z [2024-04-28T02:05:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:05:00.241224391Z [2024-04-28T02:05:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:05:00.241561158Z [2024-04-28T02:05:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:05:00.241711218Z [2024-04-28T02:05:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:05:00.241970133Z [2024-04-28T02:05:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:05:00.242100700Z [2024-04-28T02:05:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:05:00.580409900Z [2024-04-28T02:05:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:05:00.580778786Z [2024-04-28T02:05:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:04:00+00:00 exited with status queued for try_number 1 2024-04-28T02:05:00.581064137Z [2024-04-28T02:05:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:04:00+00:00 exited with status queued for try_number 1 2024-04-28T02:05:00.595193329Z [2024-04-28T02:05:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8affa44b-8b81-4fcd-92e1-798ae4dcfcb4 2024-04-28T02:05:00.595460782Z [2024-04-28T02:05:00.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4eec1c9-7b9e-47c3-8cd2-b3661b58f0ef 2024-04-28T02:05:00.595635882Z [2024-04-28T02:05:00.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5404a375-a07e-4e3e-9bf3-2db47103529a 2024-04-28T02:05:03.278591490Z [2024-04-28T02:05:03.278+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:05:03.278618202Z 2024-04-28T02:05:03.278929377Z [2024-04-28T02:05:03.278+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:05:03.279655234Z [2024-04-28T02:05:03.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:05:03.279667767Z 2024-04-28T02:05:03.282208335Z [2024-04-28T02:05:03.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:05:03.282490106Z [2024-04-28T02:05:03.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:05:03.369395128Z [2024-04-28T02:05:03.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:05:03.372082104Z [2024-04-28T02:05:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:05:03.379529459Z [2024-04-28T02:05:03.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1a5c527-de1b-4765-a253-35f2a6eb867f 2024-04-28T02:05:03.380184568Z [2024-04-28T02:05:03.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=-1, run_start_date=2024-04-28 02:05:02.114106+00:00, run_end_date=2024-04-28 02:05:02.670324+00:00, run_duration=0.556218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:05:00.236992+00:00, queued_by_job_id=1, pid=2901 2024-04-28T02:05:03.462237971Z [2024-04-28T02:05:03.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:05:03.462522931Z [2024-04-28T02:05:03.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:04:00+00:00, run_id=scheduled__2024-04-28T02:04:00+00:00, run_start_date=2024-04-28 02:05:00.149450+00:00, run_end_date=2024-04-28 02:05:03.462153+00:00, run_duration=3.312703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:04:00+00:00, data_interval_end=2024-04-28 02:05:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:05:03.471750976Z [2024-04-28T02:05:03.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:05:00+00:00, run_after=2024-04-28T02:06:00+00:00 2024-04-28T02:05:04.643865064Z [2024-04-28T02:05:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:05:04.643964779Z [2024-04-28T02:05:04.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:04:00+00:00, run_id=scheduled__2024-04-28T02:04:00+00:00, run_start_date=2024-04-28 02:05:00.151001+00:00, run_end_date=2024-04-28 02:05:04.643717+00:00, run_duration=4.492716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:04:00+00:00, data_interval_end=2024-04-28 02:05:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:05:04.660431864Z [2024-04-28T02:05:04.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:05:00+00:00, run_after=2024-04-28T02:06:00+00:00 2024-04-28T02:05:04.748878608Z [2024-04-28T02:05:04.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:04:00+00:00 exited with status success for try_number 1 2024-04-28T02:05:04.748939941Z [2024-04-28T02:05:04.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:04:00+00:00 exited with status success for try_number 1 2024-04-28T02:05:04.760039539Z [2024-04-28T02:05:04.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:04:00+00:00, map_index=-1, run_start_date=2024-04-28 02:05:02.060260+00:00, run_end_date=2024-04-28 02:05:03.382007+00:00, run_duration=1.321747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:05:00.236992+00:00, queued_by_job_id=1, pid=2900 2024-04-28T02:05:04.760327603Z [2024-04-28T02:05:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:04:00+00:00, map_index=-1, run_start_date=2024-04-28 02:05:02.823112+00:00, run_end_date=2024-04-28 02:05:04.352371+00:00, run_duration=1.529259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:05:00.236992+00:00, queued_by_job_id=1, pid=2929 2024-04-28T02:05:07.087711748Z [2024-04-28T02:05:07.087+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:05:07.087737767Z 2024-04-28T02:05:07.087741539Z [2024-04-28T02:05:07.087+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:05:07.088266076Z [2024-04-28T02:05:07.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:05:07.088274749Z 2024-04-28T02:05:07.095228504Z [2024-04-28T02:05:07.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:05:07.095284511Z [2024-04-28T02:05:07.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:05:07.209531502Z [2024-04-28T02:05:07.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:05:07.209729712Z [2024-04-28T02:05:07.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:05:07.219391778Z [2024-04-28T02:05:07.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40032473-d1b5-4ba0-af54-0fd6d3df79cb 2024-04-28T02:05:07.219806474Z [2024-04-28T02:05:07.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=-1, run_start_date=2024-04-28 02:05:05.741165+00:00, run_end_date=2024-04-28 02:05:06.239609+00:00, run_duration=0.498444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:05:03.280096+00:00, queued_by_job_id=1, pid=2953 2024-04-28T02:05:09.492425834Z [2024-04-28T02:05:09.491+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:05:09.492487208Z 2024-04-28T02:05:09.492659476Z [2024-04-28T02:05:09.492+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:05:09.493721939Z [2024-04-28T02:05:09.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:05:09.493740188Z 2024-04-28T02:05:09.496290858Z [2024-04-28T02:05:09.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:05:09.496333306Z [2024-04-28T02:05:09.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:05:09.638276931Z [2024-04-28T02:05:09.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status queued for try_number 1 2024-04-28T02:05:09.638605071Z [2024-04-28T02:05:09.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:05:09.645571448Z [2024-04-28T02:05:09.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b82341-0769-4c2d-b784-a208179c65df 2024-04-28T02:05:09.645823990Z [2024-04-28T02:05:09.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=0, run_start_date=2024-04-28 02:05:08.720461+00:00, run_end_date=2024-04-28 02:05:09.058222+00:00, run_duration=0.337761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:05:07.088599+00:00, queued_by_job_id=1, pid=2965 2024-04-28T02:05:12.311090068Z [2024-04-28T02:05:12.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:05:12.311806416Z [2024-04-28T02:05:12.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:00:00+00:00, run_id=scheduled__2024-04-28T02:00:00+00:00, run_start_date=2024-04-28 02:05:00.147798+00:00, run_end_date=2024-04-28 02:05:12.310869+00:00, run_duration=12.163071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:00:00+00:00, data_interval_end=2024-04-28 02:05:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:05:12.325950131Z [2024-04-28T02:05:12.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:05:00+00:00, run_after=2024-04-28T02:10:00+00:00 2024-04-28T02:05:12.368436171Z [2024-04-28T02:05:12.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:00:00+00:00 exited with status success for try_number 1 2024-04-28T02:05:12.379435587Z [2024-04-28T02:05:12.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:00:00+00:00, map_index=-1, run_start_date=2024-04-28 02:05:11.314902+00:00, run_end_date=2024-04-28 02:05:11.718885+00:00, run_duration=0.403983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:05:09.494072+00:00, queued_by_job_id=1, pid=2977 2024-04-28T02:06:00.246956858Z [2024-04-28T02:06:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:06:00+00:00, run_after=2024-04-28T02:07:00+00:00 2024-04-28T02:06:00.257879295Z [2024-04-28T02:06:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:06:00.269089344Z [2024-04-28T02:06:00.268+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:06:00.364005506Z [2024-04-28T02:06:00.363+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:06:00.364028822Z 2024-04-28T02:06:00.364035430Z 2024-04-28T02:06:00.364038726Z 2024-04-28T02:06:00.364157992Z [2024-04-28T02:06:00.363+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:06:00.364386099Z [2024-04-28T02:06:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:06:00.364563864Z [2024-04-28T02:06:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:06:00.365149163Z [2024-04-28T02:06:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:06:00.365156817Z 2024-04-28T02:06:00.365160272Z 2024-04-28T02:06:00.365163388Z 2024-04-28T02:06:00.368119487Z [2024-04-28T02:06:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:06:00.368259291Z [2024-04-28T02:06:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:06:00.368517320Z [2024-04-28T02:06:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:06:00.368667583Z [2024-04-28T02:06:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:06:00.368964151Z [2024-04-28T02:06:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:06:00.369095946Z [2024-04-28T02:06:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:06:00.564114177Z [2024-04-28T02:06:00.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:04:00+00:00 exited with status queued for try_number 1 2024-04-28T02:06:00.567898502Z [2024-04-28T02:06:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status queued for try_number 1 2024-04-28T02:06:00.568157496Z [2024-04-28T02:06:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status queued for try_number 1 2024-04-28T02:06:00.576749093Z [2024-04-28T02:06:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0f61f89-35c1-401a-8be6-3fbe983b5643 2024-04-28T02:06:00.577093496Z [2024-04-28T02:06:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77bdefc8-6bbf-47e1-bbb9-97c09d6f7e97 2024-04-28T02:06:00.577762491Z [2024-04-28T02:06:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60cdd671-5f87-440d-b3e4-0f964b228529 2024-04-28T02:06:01.716638889Z [2024-04-28T02:06:01.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:06:01.716754380Z [2024-04-28T02:06:01.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:04:00+00:00, run_id=scheduled__2024-04-28T02:04:00+00:00, run_start_date=2024-04-28 02:06:00.288978+00:00, run_end_date=2024-04-28 02:06:01.716322+00:00, run_duration=1.427344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:04:00+00:00, data_interval_end=2024-04-28 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:06:01.724730084Z [2024-04-28T02:06:01.724+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:06:00+00:00, run_after=2024-04-28T02:08:00+00:00 2024-04-28T02:06:01.782427434Z [2024-04-28T02:06:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:04:00+00:00 exited with status success for try_number 1 2024-04-28T02:06:01.808198780Z [2024-04-28T02:06:01.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:04:00+00:00, map_index=-1, run_start_date=2024-04-28 02:06:01.164247+00:00, run_end_date=2024-04-28 02:06:01.523190+00:00, run_duration=0.358943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:06:00.365820+00:00, queued_by_job_id=1, pid=2981 2024-04-28T02:06:04.292435991Z [2024-04-28T02:06:04.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:06:04.293887249Z [2024-04-28T02:06:04.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:05:00+00:00, run_id=scheduled__2024-04-28T02:05:00+00:00, run_start_date=2024-04-28 02:06:00.291239+00:00, run_end_date=2024-04-28 02:06:04.293444+00:00, run_duration=4.002205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:05:00+00:00, data_interval_end=2024-04-28 02:06:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:06:04.303591948Z [2024-04-28T02:06:04.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:06:00+00:00, run_after=2024-04-28T02:07:00+00:00 2024-04-28T02:06:04.310466720Z [2024-04-28T02:06:04.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:06:04.310800644Z [2024-04-28T02:06:04.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:05:00+00:00, run_id=scheduled__2024-04-28T02:05:00+00:00, run_start_date=2024-04-28 02:06:00.293608+00:00, run_end_date=2024-04-28 02:06:04.310513+00:00, run_duration=4.016905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:05:00+00:00, data_interval_end=2024-04-28 02:06:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:06:04.320755756Z [2024-04-28T02:06:04.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:06:00+00:00, run_after=2024-04-28T02:07:00+00:00 2024-04-28T02:06:04.357428349Z [2024-04-28T02:06:04.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status success for try_number 1 2024-04-28T02:06:04.357617747Z [2024-04-28T02:06:04.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status success for try_number 1 2024-04-28T02:06:04.371125483Z [2024-04-28T02:06:04.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:05:00+00:00, map_index=-1, run_start_date=2024-04-28 02:06:02.410529+00:00, run_end_date=2024-04-28 02:06:03.790470+00:00, run_duration=1.379941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:06:00.365820+00:00, queued_by_job_id=1, pid=3022 2024-04-28T02:06:04.374791246Z [2024-04-28T02:06:04.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:05:00+00:00, map_index=-1, run_start_date=2024-04-28 02:06:02.167167+00:00, run_end_date=2024-04-28 02:06:03.796014+00:00, run_duration=1.628847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:06:00.365820+00:00, queued_by_job_id=1, pid=3012 2024-04-28T02:06:15.836035627Z [2024-04-28T02:06:15.835+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:07:00.151093986Z [2024-04-28T02:07:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:07:00.173941124Z [2024-04-28T02:07:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:07:00+00:00, run_after=2024-04-28T02:08:00+00:00 2024-04-28T02:07:00.248362672Z [2024-04-28T02:07:00.247+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:07:00.248387584Z 2024-04-28T02:07:00.248394366Z 2024-04-28T02:07:00.248398211Z [2024-04-28T02:07:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:07:00.248449595Z [2024-04-28T02:07:00.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:07:00.249057714Z [2024-04-28T02:07:00.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:07:00.249068816Z 2024-04-28T02:07:00.249072360Z 2024-04-28T02:07:00.252313550Z [2024-04-28T02:07:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:07:00.252464361Z [2024-04-28T02:07:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:07:00.252684991Z [2024-04-28T02:07:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:07:00.253527953Z [2024-04-28T02:07:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:07:00.486650094Z [2024-04-28T02:07:00.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:06:00+00:00 exited with status queued for try_number 1 2024-04-28T02:07:00.486870973Z [2024-04-28T02:07:00.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:06:00+00:00 exited with status queued for try_number 1 2024-04-28T02:07:00.493413950Z [2024-04-28T02:07:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to da6b7f7f-b9a0-424c-8cd0-6765f77e225d 2024-04-28T02:07:00.493601183Z [2024-04-28T02:07:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e52188b-1aa9-4c9c-91d0-7315063796c8 2024-04-28T02:07:04.170186710Z [2024-04-28T02:07:04.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:07:04.170562715Z [2024-04-28T02:07:04.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:06:00+00:00, run_id=scheduled__2024-04-28T02:06:00+00:00, run_start_date=2024-04-28 02:07:00.192925+00:00, run_end_date=2024-04-28 02:07:04.170107+00:00, run_duration=3.977182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:06:00+00:00, data_interval_end=2024-04-28 02:07:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:07:04.179895402Z [2024-04-28T02:07:04.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:07:00+00:00, run_after=2024-04-28T02:08:00+00:00 2024-04-28T02:07:04.238681861Z [2024-04-28T02:07:04.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:06:00+00:00 exited with status success for try_number 1 2024-04-28T02:07:04.242513156Z [2024-04-28T02:07:04.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:06:00+00:00, map_index=-1, run_start_date=2024-04-28 02:07:02.180087+00:00, run_end_date=2024-04-28 02:07:03.512157+00:00, run_duration=1.33207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:07:00.249865+00:00, queued_by_job_id=1, pid=3077 2024-04-28T02:07:05.334257801Z [2024-04-28T02:07:05.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:07:05.334425645Z [2024-04-28T02:07:05.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:06:00+00:00, run_id=scheduled__2024-04-28T02:06:00+00:00, run_start_date=2024-04-28 02:07:00.191102+00:00, run_end_date=2024-04-28 02:07:05.334136+00:00, run_duration=5.143034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:06:00+00:00, data_interval_end=2024-04-28 02:07:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:07:05.344941104Z [2024-04-28T02:07:05.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:07:00+00:00, run_after=2024-04-28T02:08:00+00:00 2024-04-28T02:07:05.378673343Z [2024-04-28T02:07:05.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:06:00+00:00 exited with status success for try_number 1 2024-04-28T02:07:05.384649566Z [2024-04-28T02:07:05.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:06:00+00:00, map_index=-1, run_start_date=2024-04-28 02:07:02.142343+00:00, run_end_date=2024-04-28 02:07:04.153811+00:00, run_duration=2.011468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:07:00.249865+00:00, queued_by_job_id=1, pid=3076 2024-04-28T02:08:00.116155043Z [2024-04-28T02:08:00.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:08:00+00:00, run_after=2024-04-28T02:09:00+00:00 2024-04-28T02:08:00.127897020Z [2024-04-28T02:08:00.127+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:08:00.136126983Z [2024-04-28T02:08:00.135+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:08:00.199230363Z [2024-04-28T02:08:00.198+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:08:00.199279576Z 2024-04-28T02:08:00.199288752Z 2024-04-28T02:08:00.199293781Z 2024-04-28T02:08:00.199309201Z [2024-04-28T02:08:00.199+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:08:00.199319175Z [2024-04-28T02:08:00.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:08:00.199397715Z [2024-04-28T02:08:00.199+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:08:00.200036995Z [2024-04-28T02:08:00.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:08:00.200043193Z 2024-04-28T02:08:00.200047582Z 2024-04-28T02:08:00.200051892Z 2024-04-28T02:08:00.203170776Z [2024-04-28T02:08:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:08:00.203265058Z [2024-04-28T02:08:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:08:00.203547991Z [2024-04-28T02:08:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:08:00.203638571Z [2024-04-28T02:08:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:08:00.203838699Z [2024-04-28T02:08:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:08:00.203909940Z [2024-04-28T02:08:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:08:00.431530174Z [2024-04-28T02:08:00.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:06:00+00:00 exited with status queued for try_number 1 2024-04-28T02:08:00.431754955Z [2024-04-28T02:08:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:07:00+00:00 exited with status queued for try_number 1 2024-04-28T02:08:00.431987785Z [2024-04-28T02:08:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:07:00+00:00 exited with status queued for try_number 1 2024-04-28T02:08:00.442402575Z [2024-04-28T02:08:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f40f02d-e5dc-4bcb-8c5e-a0228c9e3602 2024-04-28T02:08:00.442599378Z [2024-04-28T02:08:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a41cda5-1005-407a-86ac-dd29bc410947 2024-04-28T02:08:00.442771489Z [2024-04-28T02:08:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 714fcec9-e412-4497-ad6c-8ef0d9106ac9 2024-04-28T02:08:01.588638416Z [2024-04-28T02:08:01.588+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:08:01.589047224Z [2024-04-28T02:08:01.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:06:00+00:00, run_id=scheduled__2024-04-28T02:06:00+00:00, run_start_date=2024-04-28 02:08:00.145853+00:00, run_end_date=2024-04-28 02:08:01.588611+00:00, run_duration=1.442758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:06:00+00:00, data_interval_end=2024-04-28 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:08:01.597498589Z [2024-04-28T02:08:01.597+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:08:00+00:00, run_after=2024-04-28T02:10:00+00:00 2024-04-28T02:08:01.647951210Z [2024-04-28T02:08:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:06:00+00:00 exited with status success for try_number 1 2024-04-28T02:08:01.654117276Z [2024-04-28T02:08:01.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:06:00+00:00, map_index=-1, run_start_date=2024-04-28 02:08:00.994201+00:00, run_end_date=2024-04-28 02:08:01.401667+00:00, run_duration=0.407466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:08:00.200631+00:00, queued_by_job_id=1, pid=3102 2024-04-28T02:08:03.747960628Z [2024-04-28T02:08:03.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:08:03.748534811Z [2024-04-28T02:08:03.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:07:00+00:00, run_id=scheduled__2024-04-28T02:07:00+00:00, run_start_date=2024-04-28 02:08:00.147379+00:00, run_end_date=2024-04-28 02:08:03.748170+00:00, run_duration=3.600791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:07:00+00:00, data_interval_end=2024-04-28 02:08:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:08:03.759230796Z [2024-04-28T02:08:03.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:08:00+00:00, run_after=2024-04-28T02:09:00+00:00 2024-04-28T02:08:03.802473115Z [2024-04-28T02:08:03.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:07:00+00:00 exited with status success for try_number 1 2024-04-28T02:08:03.810514369Z [2024-04-28T02:08:03.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:07:00+00:00, map_index=-1, run_start_date=2024-04-28 02:08:02.258294+00:00, run_end_date=2024-04-28 02:08:03.553121+00:00, run_duration=1.294827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:08:00.200631+00:00, queued_by_job_id=1, pid=3143 2024-04-28T02:08:04.875297744Z [2024-04-28T02:08:04.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:08:04.875593075Z [2024-04-28T02:08:04.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:07:00+00:00, run_id=scheduled__2024-04-28T02:07:00+00:00, run_start_date=2024-04-28 02:08:00.148470+00:00, run_end_date=2024-04-28 02:08:04.875185+00:00, run_duration=4.726715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:07:00+00:00, data_interval_end=2024-04-28 02:08:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:08:04.899555306Z [2024-04-28T02:08:04.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:08:00+00:00, run_after=2024-04-28T02:09:00+00:00 2024-04-28T02:08:04.954597518Z [2024-04-28T02:08:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:07:00+00:00 exited with status success for try_number 1 2024-04-28T02:08:04.980368831Z [2024-04-28T02:08:04.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:07:00+00:00, map_index=-1, run_start_date=2024-04-28 02:08:02.190600+00:00, run_end_date=2024-04-28 02:08:03.810986+00:00, run_duration=1.620386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:08:00.200631+00:00, queued_by_job_id=1, pid=3142 2024-04-28T02:09:00.873821616Z [2024-04-28T02:09:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:09:00+00:00, run_after=2024-04-28T02:10:00+00:00 2024-04-28T02:09:00.885641077Z [2024-04-28T02:09:00.885+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:09:00.971397018Z [2024-04-28T02:09:00.970+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:09:00.971447397Z 2024-04-28T02:09:00.971457947Z 2024-04-28T02:09:00.971940220Z [2024-04-28T02:09:00.971+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:09:00.972373380Z [2024-04-28T02:09:00.971+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:09:00.973790555Z [2024-04-28T02:09:00.973+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:09:00.973831021Z 2024-04-28T02:09:00.973841853Z 2024-04-28T02:09:00.979861135Z [2024-04-28T02:09:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:09:00.980370144Z [2024-04-28T02:09:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:09:00.981239767Z [2024-04-28T02:09:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:09:00.981739978Z [2024-04-28T02:09:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:09:01.148585424Z [2024-04-28T02:09:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:08:00+00:00 exited with status queued for try_number 1 2024-04-28T02:09:01.150181325Z [2024-04-28T02:09:01.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:08:00+00:00 exited with status queued for try_number 1 2024-04-28T02:09:01.168640178Z [2024-04-28T02:09:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 503b323d-718a-43ef-a0e9-f56a4b217879 2024-04-28T02:09:01.168946947Z [2024-04-28T02:09:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c28d764-b514-463e-8b25-5b79d400109a 2024-04-28T02:09:05.234144667Z [2024-04-28T02:09:05.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:09:05.234576452Z [2024-04-28T02:09:05.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:08:00+00:00, run_id=scheduled__2024-04-28T02:08:00+00:00, run_start_date=2024-04-28 02:09:00.907157+00:00, run_end_date=2024-04-28 02:09:05.234066+00:00, run_duration=4.326909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:08:00+00:00, data_interval_end=2024-04-28 02:09:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:09:05.246700716Z [2024-04-28T02:09:05.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:09:00+00:00, run_after=2024-04-28T02:10:00+00:00 2024-04-28T02:09:05.284664179Z [2024-04-28T02:09:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:08:00+00:00 exited with status success for try_number 1 2024-04-28T02:09:05.294828691Z [2024-04-28T02:09:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:08:00+00:00, map_index=-1, run_start_date=2024-04-28 02:09:02.824125+00:00, run_end_date=2024-04-28 02:09:04.556566+00:00, run_duration=1.732441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:09:00.975109+00:00, queued_by_job_id=1, pid=3197 2024-04-28T02:09:06.359380740Z [2024-04-28T02:09:06.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:09:06.359814872Z [2024-04-28T02:09:06.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:08:00+00:00, run_id=scheduled__2024-04-28T02:08:00+00:00, run_start_date=2024-04-28 02:09:00.909625+00:00, run_end_date=2024-04-28 02:09:06.359319+00:00, run_duration=5.449694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:08:00+00:00, data_interval_end=2024-04-28 02:09:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:09:06.370918984Z [2024-04-28T02:09:06.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:09:00+00:00, run_after=2024-04-28T02:10:00+00:00 2024-04-28T02:09:06.402223941Z [2024-04-28T02:09:06.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:08:00+00:00 exited with status success for try_number 1 2024-04-28T02:09:06.407998045Z [2024-04-28T02:09:06.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:08:00+00:00, map_index=-1, run_start_date=2024-04-28 02:09:02.879629+00:00, run_end_date=2024-04-28 02:09:05.352451+00:00, run_duration=2.472822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:09:00.975109+00:00, queued_by_job_id=1, pid=3198 2024-04-28T02:10:00.569803983Z [2024-04-28T02:10:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:10:00+00:00, run_after=2024-04-28T02:11:00+00:00 2024-04-28T02:10:00.583473712Z [2024-04-28T02:10:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:10:00+00:00, run_after=2024-04-28T02:15:00+00:00 2024-04-28T02:10:00.590598487Z [2024-04-28T02:10:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:10:00.598154491Z [2024-04-28T02:10:00.597+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:10:00.706417254Z [2024-04-28T02:10:00.705+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:10:00.706453562Z 2024-04-28T02:10:00.706460220Z 2024-04-28T02:10:00.706467941Z 2024-04-28T02:10:00.706472892Z 2024-04-28T02:10:00.706830928Z [2024-04-28T02:10:00.706+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:10:00.707100841Z [2024-04-28T02:10:00.706+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:10:00.707348052Z [2024-04-28T02:10:00.707+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:10:00.708255372Z [2024-04-28T02:10:00.707+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:10:00.709488815Z [2024-04-28T02:10:00.709+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:10:00.709504431Z 2024-04-28T02:10:00.709511217Z 2024-04-28T02:10:00.709516605Z 2024-04-28T02:10:00.709521518Z 2024-04-28T02:10:00.715133251Z [2024-04-28T02:10:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:10:00.715239834Z [2024-04-28T02:10:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:10:00.715791345Z [2024-04-28T02:10:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:10:00.715940229Z [2024-04-28T02:10:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:10:00.716233142Z [2024-04-28T02:10:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:10:00.716321936Z [2024-04-28T02:10:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:10:00.716663430Z [2024-04-28T02:10:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:10:00.716815195Z [2024-04-28T02:10:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:10:01.200727304Z [2024-04-28T02:10:01.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:01.203206849Z [2024-04-28T02:10:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:08:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:01.203431637Z [2024-04-28T02:10:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:09:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:01.203618048Z [2024-04-28T02:10:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:09:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:01.219274495Z [2024-04-28T02:10:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 793cd371-ab01-43cc-85ba-dab119fec11d 2024-04-28T02:10:01.219622812Z [2024-04-28T02:10:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to 043b015c-f298-4232-b7cd-03b17bc3cc10 2024-04-28T02:10:01.219884636Z [2024-04-28T02:10:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to e510c900-167a-42df-95d7-146467bdf466 2024-04-28T02:10:01.220122544Z [2024-04-28T02:10:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14f9f600-99b8-4d46-8053-915cceed615a 2024-04-28T02:10:02.490717852Z [2024-04-28T02:10:02.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:10:02.490929765Z [2024-04-28T02:10:02.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:08:00+00:00, run_id=scheduled__2024-04-28T02:08:00+00:00, run_start_date=2024-04-28 02:10:00.611377+00:00, run_end_date=2024-04-28 02:10:02.490637+00:00, run_duration=1.87926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:08:00+00:00, data_interval_end=2024-04-28 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:10:02.504074729Z [2024-04-28T02:10:02.503+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:10:00+00:00, run_after=2024-04-28T02:12:00+00:00 2024-04-28T02:10:02.577490313Z [2024-04-28T02:10:02.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:08:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:02.603578844Z [2024-04-28T02:10:02.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:08:00+00:00, map_index=-1, run_start_date=2024-04-28 02:10:01.628742+00:00, run_end_date=2024-04-28 02:10:02.157792+00:00, run_duration=0.52905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:00.710646+00:00, queued_by_job_id=1, pid=3224 2024-04-28T02:10:03.538498432Z [2024-04-28T02:10:03.538+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:10:03.538521272Z 2024-04-28T02:10:03.538532053Z [2024-04-28T02:10:03.538+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:10:03.539238289Z [2024-04-28T02:10:03.539+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:10:03.539251249Z 2024-04-28T02:10:03.542176766Z [2024-04-28T02:10:03.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:10:03.542229079Z [2024-04-28T02:10:03.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:10:03.608473883Z [2024-04-28T02:10:03.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:03.608528269Z [2024-04-28T02:10:03.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:03.617029488Z [2024-04-28T02:10:03.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51749435-0199-46c1-a346-2fc71e1c760c 2024-04-28T02:10:03.618170497Z [2024-04-28T02:10:03.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:05:00+00:00, map_index=-1, run_start_date=2024-04-28 02:10:02.759050+00:00, run_end_date=2024-04-28 02:10:03.292859+00:00, run_duration=0.533809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:00.710646+00:00, queued_by_job_id=1, pid=3260 2024-04-28T02:10:04.774547520Z [2024-04-28T02:10:04.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:10:04.775049533Z [2024-04-28T02:10:04.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:09:00+00:00, run_id=scheduled__2024-04-28T02:09:00+00:00, run_start_date=2024-04-28 02:10:00.612465+00:00, run_end_date=2024-04-28 02:10:04.774497+00:00, run_duration=4.162032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:09:00+00:00, data_interval_end=2024-04-28 02:10:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:10:04.785835042Z [2024-04-28T02:10:04.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:10:00+00:00, run_after=2024-04-28T02:11:00+00:00 2024-04-28T02:10:04.834661362Z [2024-04-28T02:10:04.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:09:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:04.846723979Z [2024-04-28T02:10:04.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:09:00+00:00, map_index=-1, run_start_date=2024-04-28 02:10:03.105752+00:00, run_end_date=2024-04-28 02:10:04.610258+00:00, run_duration=1.504506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:00.710646+00:00, queued_by_job_id=1, pid=3274 2024-04-28T02:10:05.949119447Z [2024-04-28T02:10:05.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:10:05.949476962Z [2024-04-28T02:10:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:09:00+00:00, run_id=scheduled__2024-04-28T02:09:00+00:00, run_start_date=2024-04-28 02:10:00.613560+00:00, run_end_date=2024-04-28 02:10:05.949176+00:00, run_duration=5.335616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:09:00+00:00, data_interval_end=2024-04-28 02:10:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:10:05.967708548Z [2024-04-28T02:10:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:10:00+00:00, run_after=2024-04-28T02:11:00+00:00 2024-04-28T02:10:06.057660999Z [2024-04-28T02:10:06.057+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:10:06.057688238Z 2024-04-28T02:10:06.057754171Z [2024-04-28T02:10:06.057+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:10:06.058493903Z [2024-04-28T02:10:06.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:10:06.058510721Z 2024-04-28T02:10:06.063264101Z [2024-04-28T02:10:06.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:10:06.063582399Z [2024-04-28T02:10:06.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:10:06.133823078Z [2024-04-28T02:10:06.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:06.134092092Z [2024-04-28T02:10:06.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:09:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:06.141569187Z [2024-04-28T02:10:06.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:09:00+00:00, map_index=-1, run_start_date=2024-04-28 02:10:03.198213+00:00, run_end_date=2024-04-28 02:10:05.448330+00:00, run_duration=2.250117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:00.710646+00:00, queued_by_job_id=1, pid=3284 2024-04-28T02:10:06.141666399Z [2024-04-28T02:10:06.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8067db81-2981-466c-8659-3a066ecf8bdc 2024-04-28T02:10:06.214169167Z [2024-04-28T02:10:06.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:06.219022193Z [2024-04-28T02:10:06.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:05:00+00:00, map_index=-1, run_start_date=2024-04-28 02:10:05.438144+00:00, run_end_date=2024-04-28 02:10:05.949918+00:00, run_duration=0.511774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:03.539516+00:00, queued_by_job_id=1, pid=3317 2024-04-28T02:10:08.819225049Z [2024-04-28T02:10:08.818+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:10:08.819263928Z 2024-04-28T02:10:08.819701288Z [2024-04-28T02:10:08.819+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:10:08.820743631Z [2024-04-28T02:10:08.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:10:08.820783385Z 2024-04-28T02:10:08.824730893Z [2024-04-28T02:10:08.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:10:08.825081758Z [2024-04-28T02:10:08.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:10:08.899017312Z [2024-04-28T02:10:08.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status queued for try_number 1 2024-04-28T02:10:08.899511381Z [2024-04-28T02:10:08.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:08.907673385Z [2024-04-28T02:10:08.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22d95d36-b23f-486a-bd22-35e012db53fe 2024-04-28T02:10:08.908172048Z [2024-04-28T02:10:08.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:05:00+00:00, map_index=0, run_start_date=2024-04-28 02:10:07.673995+00:00, run_end_date=2024-04-28 02:10:08.042084+00:00, run_duration=0.368089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:06.059378+00:00, queued_by_job_id=1, pid=3329 2024-04-28T02:10:11.161408518Z [2024-04-28T02:10:11.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:10:11.161664106Z [2024-04-28T02:10:11.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:05:00+00:00, run_id=scheduled__2024-04-28T02:05:00+00:00, run_start_date=2024-04-28 02:10:00.609970+00:00, run_end_date=2024-04-28 02:10:11.161289+00:00, run_duration=10.551319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:05:00+00:00, data_interval_end=2024-04-28 02:10:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:10:11.168058739Z [2024-04-28T02:10:11.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:10:00+00:00, run_after=2024-04-28T02:15:00+00:00 2024-04-28T02:10:11.203737368Z [2024-04-28T02:10:11.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:05:00+00:00 exited with status success for try_number 1 2024-04-28T02:10:11.211244298Z [2024-04-28T02:10:11.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:05:00+00:00, map_index=-1, run_start_date=2024-04-28 02:10:10.381823+00:00, run_end_date=2024-04-28 02:10:10.780983+00:00, run_duration=0.39916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:10:08.821450+00:00, queued_by_job_id=1, pid=3341 2024-04-28T02:11:00.645312077Z [2024-04-28T02:11:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:11:00+00:00, run_after=2024-04-28T02:12:00+00:00 2024-04-28T02:11:00.655715957Z [2024-04-28T02:11:00.655+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:11:00.723558290Z [2024-04-28T02:11:00.723+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:11:00.723588472Z 2024-04-28T02:11:00.723592439Z 2024-04-28T02:11:00.723685552Z [2024-04-28T02:11:00.723+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:11:00.723859230Z [2024-04-28T02:11:00.723+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:11:00.724562896Z [2024-04-28T02:11:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:11:00.724586705Z 2024-04-28T02:11:00.724595140Z 2024-04-28T02:11:00.727742415Z [2024-04-28T02:11:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:11:00.727855831Z [2024-04-28T02:11:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:11:00.728186144Z [2024-04-28T02:11:00.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:11:00.728576769Z [2024-04-28T02:11:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:11:00.890499529Z [2024-04-28T02:11:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:11:00.890881938Z [2024-04-28T02:11:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:11:00.899862629Z [2024-04-28T02:11:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7a18b08-a6ba-4a9b-a4da-d39bd0f11649 2024-04-28T02:11:00.900136363Z [2024-04-28T02:11:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49c4d770-4ab3-457b-af3e-bc0924238da2 2024-04-28T02:11:05.089848713Z [2024-04-28T02:11:05.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:11:05.090507945Z [2024-04-28T02:11:05.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:10:00+00:00, run_id=scheduled__2024-04-28T02:10:00+00:00, run_start_date=2024-04-28 02:11:00.670014+00:00, run_end_date=2024-04-28 02:11:05.089773+00:00, run_duration=4.419759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:10:00+00:00, data_interval_end=2024-04-28 02:11:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:11:05.103215142Z [2024-04-28T02:11:05.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:11:00+00:00, run_after=2024-04-28T02:12:00+00:00 2024-04-28T02:11:05.112079869Z [2024-04-28T02:11:05.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:11:05.112575748Z [2024-04-28T02:11:05.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:10:00+00:00, run_id=scheduled__2024-04-28T02:10:00+00:00, run_start_date=2024-04-28 02:11:00.671568+00:00, run_end_date=2024-04-28 02:11:05.111980+00:00, run_duration=4.440412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:10:00+00:00, data_interval_end=2024-04-28 02:11:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:11:05.123157995Z [2024-04-28T02:11:05.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:11:00+00:00, run_after=2024-04-28T02:12:00+00:00 2024-04-28T02:11:05.163230462Z [2024-04-28T02:11:05.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:11:05.163252295Z [2024-04-28T02:11:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:11:05.171397565Z [2024-04-28T02:11:05.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=-1, run_start_date=2024-04-28 02:11:02.440149+00:00, run_end_date=2024-04-28 02:11:04.347277+00:00, run_duration=1.907128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:11:00.725177+00:00, queued_by_job_id=1, pid=3374 2024-04-28T02:11:05.171628698Z [2024-04-28T02:11:05.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=-1, run_start_date=2024-04-28 02:11:02.553779+00:00, run_end_date=2024-04-28 02:11:04.735750+00:00, run_duration=2.181971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:11:00.725177+00:00, queued_by_job_id=1, pid=3375 2024-04-28T02:11:15.902835981Z [2024-04-28T02:11:15.901+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:12:00.489894038Z [2024-04-28T02:12:00.489+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:12:00.499350026Z [2024-04-28T02:12:00.498+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:12:00.513910630Z [2024-04-28T02:12:00.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:12:00+00:00, run_after=2024-04-28T02:13:00+00:00 2024-04-28T02:12:00.596074875Z [2024-04-28T02:12:00.595+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:12:00.596108682Z 2024-04-28T02:12:00.596118443Z 2024-04-28T02:12:00.596124993Z 2024-04-28T02:12:00.596190993Z [2024-04-28T02:12:00.595+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:12:00.596447599Z [2024-04-28T02:12:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:12:00.596581347Z [2024-04-28T02:12:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:12:00.597577106Z [2024-04-28T02:12:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:12:00.597602478Z 2024-04-28T02:12:00.597617518Z 2024-04-28T02:12:00.597633927Z 2024-04-28T02:12:00.602241282Z [2024-04-28T02:12:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:12:00.602263623Z [2024-04-28T02:12:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:12:00.602663159Z [2024-04-28T02:12:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:12:00.602871979Z [2024-04-28T02:12:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:12:00.603184257Z [2024-04-28T02:12:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:12:00.603375891Z [2024-04-28T02:12:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:12:00.843009764Z [2024-04-28T02:12:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:12:00.845324629Z [2024-04-28T02:12:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:11:00+00:00 exited with status queued for try_number 1 2024-04-28T02:12:00.845579606Z [2024-04-28T02:12:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:11:00+00:00 exited with status queued for try_number 1 2024-04-28T02:12:00.854831104Z [2024-04-28T02:12:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b1295bc-4b61-4c42-86c3-e09b7595bbad 2024-04-28T02:12:00.855207583Z [2024-04-28T02:12:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to d55b5b62-49f6-46b3-ae36-8db05bc45c45 2024-04-28T02:12:00.855467429Z [2024-04-28T02:12:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8573b883-32c1-4c83-aca6-6aec7b2229ea 2024-04-28T02:12:01.981169040Z [2024-04-28T02:12:01.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:12:01.981511308Z [2024-04-28T02:12:01.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:10:00+00:00, run_id=scheduled__2024-04-28T02:10:00+00:00, run_start_date=2024-04-28 02:12:00.527341+00:00, run_end_date=2024-04-28 02:12:01.981121+00:00, run_duration=1.45378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:10:00+00:00, data_interval_end=2024-04-28 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:12:01.989535408Z [2024-04-28T02:12:01.989+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:12:00+00:00, run_after=2024-04-28T02:14:00+00:00 2024-04-28T02:12:02.045811928Z [2024-04-28T02:12:02.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:12:02.045833911Z [2024-04-28T02:12:02.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=-1, run_start_date=2024-04-28 02:12:01.277119+00:00, run_end_date=2024-04-28 02:12:01.645885+00:00, run_duration=0.368766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:12:00.598720+00:00, queued_by_job_id=1, pid=3400 2024-04-28T02:12:05.568727208Z [2024-04-28T02:12:05.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:12:05.569389683Z [2024-04-28T02:12:05.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:11:00+00:00, run_id=scheduled__2024-04-28T02:11:00+00:00, run_start_date=2024-04-28 02:12:00.530059+00:00, run_end_date=2024-04-28 02:12:05.568706+00:00, run_duration=5.038647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:11:00+00:00, data_interval_end=2024-04-28 02:12:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:12:05.581612502Z [2024-04-28T02:12:05.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:12:00+00:00, run_after=2024-04-28T02:13:00+00:00 2024-04-28T02:12:05.595728444Z [2024-04-28T02:12:05.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:12:05.595752143Z [2024-04-28T02:12:05.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:11:00+00:00, run_id=scheduled__2024-04-28T02:11:00+00:00, run_start_date=2024-04-28 02:12:00.528867+00:00, run_end_date=2024-04-28 02:12:05.594240+00:00, run_duration=5.065373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:11:00+00:00, data_interval_end=2024-04-28 02:12:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:12:05.608542877Z [2024-04-28T02:12:05.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:12:00+00:00, run_after=2024-04-28T02:13:00+00:00 2024-04-28T02:12:05.662010223Z [2024-04-28T02:12:05.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:11:00+00:00 exited with status success for try_number 1 2024-04-28T02:12:05.662055847Z [2024-04-28T02:12:05.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:11:00+00:00 exited with status success for try_number 1 2024-04-28T02:12:05.668890795Z [2024-04-28T02:12:05.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:11:00+00:00, map_index=-1, run_start_date=2024-04-28 02:12:02.570890+00:00, run_end_date=2024-04-28 02:12:04.757626+00:00, run_duration=2.186736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:12:00.598720+00:00, queued_by_job_id=1, pid=3440 2024-04-28T02:12:05.669185163Z [2024-04-28T02:12:05.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:11:00+00:00, map_index=-1, run_start_date=2024-04-28 02:12:02.685466+00:00, run_end_date=2024-04-28 02:12:04.490601+00:00, run_duration=1.805135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:12:00.598720+00:00, queued_by_job_id=1, pid=3441 2024-04-28T02:13:00.424408701Z [2024-04-28T02:13:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:13:00+00:00, run_after=2024-04-28T02:14:00+00:00 2024-04-28T02:13:00.435371887Z [2024-04-28T02:13:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:13:00.521274259Z [2024-04-28T02:13:00.520+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:13:00.521315690Z 2024-04-28T02:13:00.521325488Z 2024-04-28T02:13:00.521335081Z [2024-04-28T02:13:00.521+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:13:00.521477988Z [2024-04-28T02:13:00.521+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:13:00.522485106Z [2024-04-28T02:13:00.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:13:00.522505358Z 2024-04-28T02:13:00.522511018Z 2024-04-28T02:13:00.526995221Z [2024-04-28T02:13:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:13:00.527351448Z [2024-04-28T02:13:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:13:00.527878321Z [2024-04-28T02:13:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:13:00.528111015Z [2024-04-28T02:13:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:13:00.741553922Z [2024-04-28T02:13:00.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:12:00+00:00 exited with status queued for try_number 1 2024-04-28T02:13:00.741929821Z [2024-04-28T02:13:00.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:12:00+00:00 exited with status queued for try_number 1 2024-04-28T02:13:00.755680459Z [2024-04-28T02:13:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30559331-89f2-4145-aa0e-94be7c080bc3 2024-04-28T02:13:00.756003814Z [2024-04-28T02:13:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d98fa49-9fdb-440a-94ee-8bdcf3c370c2 2024-04-28T02:13:04.152798881Z [2024-04-28T02:13:04.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:13:04.153124887Z [2024-04-28T02:13:04.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:12:00+00:00, run_id=scheduled__2024-04-28T02:12:00+00:00, run_start_date=2024-04-28 02:13:00.457129+00:00, run_end_date=2024-04-28 02:13:04.152667+00:00, run_duration=3.695538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:12:00+00:00, data_interval_end=2024-04-28 02:13:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:13:04.163025411Z [2024-04-28T02:13:04.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:13:00+00:00, run_after=2024-04-28T02:14:00+00:00 2024-04-28T02:13:04.169654869Z [2024-04-28T02:13:04.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:13:04.170109125Z [2024-04-28T02:13:04.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:12:00+00:00, run_id=scheduled__2024-04-28T02:12:00+00:00, run_start_date=2024-04-28 02:13:00.459888+00:00, run_end_date=2024-04-28 02:13:04.169610+00:00, run_duration=3.709722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:12:00+00:00, data_interval_end=2024-04-28 02:13:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:13:04.180984323Z [2024-04-28T02:13:04.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:13:00+00:00, run_after=2024-04-28T02:14:00+00:00 2024-04-28T02:13:04.216583576Z [2024-04-28T02:13:04.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:12:00+00:00 exited with status success for try_number 1 2024-04-28T02:13:04.216607529Z [2024-04-28T02:13:04.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:12:00+00:00 exited with status success for try_number 1 2024-04-28T02:13:04.242818112Z [2024-04-28T02:13:04.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:12:00+00:00, map_index=-1, run_start_date=2024-04-28 02:13:02.196014+00:00, run_end_date=2024-04-28 02:13:03.509395+00:00, run_duration=1.313381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:13:00.523305+00:00, queued_by_job_id=1, pid=3494 2024-04-28T02:13:04.242839511Z [2024-04-28T02:13:04.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:12:00+00:00, map_index=-1, run_start_date=2024-04-28 02:13:02.324754+00:00, run_end_date=2024-04-28 02:13:03.920591+00:00, run_duration=1.595837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:13:00.523305+00:00, queued_by_job_id=1, pid=3495 2024-04-28T02:14:00.076508718Z [2024-04-28T02:14:00.075+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:14:00.089428058Z [2024-04-28T02:14:00.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:14:00.124716821Z [2024-04-28T02:14:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:14:00+00:00, run_after=2024-04-28T02:15:00+00:00 2024-04-28T02:14:00.211415236Z [2024-04-28T02:14:00.211+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:14:00.211445729Z 2024-04-28T02:14:00.211453808Z 2024-04-28T02:14:00.211460112Z 2024-04-28T02:14:00.211876807Z [2024-04-28T02:14:00.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:14:00.212194390Z [2024-04-28T02:14:00.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:14:00.212400180Z [2024-04-28T02:14:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:14:00.213068239Z [2024-04-28T02:14:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:14:00.213080590Z 2024-04-28T02:14:00.213087630Z 2024-04-28T02:14:00.213093820Z 2024-04-28T02:14:00.216626979Z [2024-04-28T02:14:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:14:00.216798058Z [2024-04-28T02:14:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:14:00.217732726Z [2024-04-28T02:14:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:14:00.217745102Z [2024-04-28T02:14:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:14:00.218024680Z [2024-04-28T02:14:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:14:00.218234928Z [2024-04-28T02:14:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:14:00.482028472Z [2024-04-28T02:14:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:12:00+00:00 exited with status queued for try_number 1 2024-04-28T02:14:00.482084051Z [2024-04-28T02:14:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:13:00+00:00 exited with status queued for try_number 1 2024-04-28T02:14:00.482238340Z [2024-04-28T02:14:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:13:00+00:00 exited with status queued for try_number 1 2024-04-28T02:14:00.494661763Z [2024-04-28T02:14:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to f78d077e-2bfb-4f2f-84f5-fd8a54c20b44 2024-04-28T02:14:00.494901869Z [2024-04-28T02:14:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff115a88-a9f4-4244-8306-e92d0aac1f03 2024-04-28T02:14:00.495109173Z [2024-04-28T02:14:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 164ddeb0-619d-4296-bb65-8855953865b3 2024-04-28T02:14:01.619202139Z [2024-04-28T02:14:01.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:14:01.619295401Z [2024-04-28T02:14:01.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:12:00+00:00, run_id=scheduled__2024-04-28T02:12:00+00:00, run_start_date=2024-04-28 02:14:00.139497+00:00, run_end_date=2024-04-28 02:14:01.618983+00:00, run_duration=1.479486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:12:00+00:00, data_interval_end=2024-04-28 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:14:01.633307292Z [2024-04-28T02:14:01.632+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:14:00+00:00, run_after=2024-04-28T02:16:00+00:00 2024-04-28T02:14:01.703856817Z [2024-04-28T02:14:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:12:00+00:00 exited with status success for try_number 1 2024-04-28T02:14:01.711242183Z [2024-04-28T02:14:01.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:12:00+00:00, map_index=-1, run_start_date=2024-04-28 02:14:00.971576+00:00, run_end_date=2024-04-28 02:14:01.367938+00:00, run_duration=0.396362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:14:00.213829+00:00, queued_by_job_id=1, pid=3520 2024-04-28T02:14:03.899514236Z [2024-04-28T02:14:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:14:03.899850831Z [2024-04-28T02:14:03.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:13:00+00:00, run_id=scheduled__2024-04-28T02:13:00+00:00, run_start_date=2024-04-28 02:14:00.142302+00:00, run_end_date=2024-04-28 02:14:03.899435+00:00, run_duration=3.757133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:13:00+00:00, data_interval_end=2024-04-28 02:14:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:14:03.909178570Z [2024-04-28T02:14:03.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:14:00+00:00, run_after=2024-04-28T02:15:00+00:00 2024-04-28T02:14:03.924831136Z [2024-04-28T02:14:03.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:14:03.925296641Z [2024-04-28T02:14:03.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:13:00+00:00, run_id=scheduled__2024-04-28T02:13:00+00:00, run_start_date=2024-04-28 02:14:00.141034+00:00, run_end_date=2024-04-28 02:14:03.924755+00:00, run_duration=3.783721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:13:00+00:00, data_interval_end=2024-04-28 02:14:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:14:03.939788120Z [2024-04-28T02:14:03.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:14:00+00:00, run_after=2024-04-28T02:15:00+00:00 2024-04-28T02:14:03.973058003Z [2024-04-28T02:14:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:13:00+00:00 exited with status success for try_number 1 2024-04-28T02:14:03.973326177Z [2024-04-28T02:14:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:13:00+00:00 exited with status success for try_number 1 2024-04-28T02:14:03.985770913Z [2024-04-28T02:14:03.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:13:00+00:00, map_index=-1, run_start_date=2024-04-28 02:14:02.012317+00:00, run_end_date=2024-04-28 02:14:03.574261+00:00, run_duration=1.561944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:14:00.213829+00:00, queued_by_job_id=1, pid=3560 2024-04-28T02:14:03.986415442Z [2024-04-28T02:14:03.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:13:00+00:00, map_index=-1, run_start_date=2024-04-28 02:14:02.082601+00:00, run_end_date=2024-04-28 02:14:03.300066+00:00, run_duration=1.217465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:14:00.213829+00:00, queued_by_job_id=1, pid=3561 2024-04-28T02:15:00.417420969Z [2024-04-28T02:15:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:15:00+00:00, run_after=2024-04-28T02:20:00+00:00 2024-04-28T02:15:00.430056556Z [2024-04-28T02:15:00.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:15:00+00:00, run_after=2024-04-28T02:16:00+00:00 2024-04-28T02:15:00.435879909Z [2024-04-28T02:15:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:15:00.502804981Z [2024-04-28T02:15:00.502+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:15:00.502829412Z 2024-04-28T02:15:00.502838257Z 2024-04-28T02:15:00.502841379Z 2024-04-28T02:15:00.502996357Z [2024-04-28T02:15:00.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:15:00.503160652Z [2024-04-28T02:15:00.503+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:15:00.503338065Z [2024-04-28T02:15:00.503+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:15:00.503920264Z [2024-04-28T02:15:00.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:15:00.503935449Z 2024-04-28T02:15:00.503940994Z 2024-04-28T02:15:00.503946549Z 2024-04-28T02:15:00.507140018Z [2024-04-28T02:15:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:15:00.507346170Z [2024-04-28T02:15:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:15:00.507689840Z [2024-04-28T02:15:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:15:00.507944646Z [2024-04-28T02:15:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:15:00.508240993Z [2024-04-28T02:15:00.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:15:00.508381868Z [2024-04-28T02:15:00.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:15:00.747812785Z [2024-04-28T02:15:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:15:00.747861665Z [2024-04-28T02:15:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:14:00+00:00 exited with status queued for try_number 1 2024-04-28T02:15:00.747873220Z [2024-04-28T02:15:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:14:00+00:00 exited with status queued for try_number 1 2024-04-28T02:15:00.756417368Z [2024-04-28T02:15:00.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7aa338c-8c5d-4e92-8b38-20cc9e73287d 2024-04-28T02:15:00.756528962Z [2024-04-28T02:15:00.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f7b5de6-125d-4d74-9aa7-bfe9b6de9661 2024-04-28T02:15:00.756789861Z [2024-04-28T02:15:00.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 580bb41f-ecb6-422d-86c9-147dd19b0e83 2024-04-28T02:15:03.844876789Z [2024-04-28T02:15:03.844+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:15:03.844907706Z 2024-04-28T02:15:03.845113783Z [2024-04-28T02:15:03.844+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:15:03.845728189Z [2024-04-28T02:15:03.845+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:15:03.845739143Z 2024-04-28T02:15:03.848422145Z [2024-04-28T02:15:03.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:15:03.848756252Z [2024-04-28T02:15:03.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:15:03.916123613Z [2024-04-28T02:15:03.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:15:03.916157190Z [2024-04-28T02:15:03.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:15:03.922546268Z [2024-04-28T02:15:03.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0562627-0833-4f2f-8712-17bc474aeb75 2024-04-28T02:15:03.922662758Z [2024-04-28T02:15:03.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=-1, run_start_date=2024-04-28 02:15:02.406160+00:00, run_end_date=2024-04-28 02:15:02.999675+00:00, run_duration=0.593515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:15:00.504541+00:00, queued_by_job_id=1, pid=3626 2024-04-28T02:15:03.971503587Z [2024-04-28T02:15:03.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:15:03.971821007Z [2024-04-28T02:15:03.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:14:00+00:00, run_id=scheduled__2024-04-28T02:14:00+00:00, run_start_date=2024-04-28 02:15:00.450237+00:00, run_end_date=2024-04-28 02:15:03.971381+00:00, run_duration=3.521144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:14:00+00:00, data_interval_end=2024-04-28 02:15:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:15:03.982095685Z [2024-04-28T02:15:03.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:15:00+00:00, run_after=2024-04-28T02:16:00+00:00 2024-04-28T02:15:04.053281767Z [2024-04-28T02:15:04.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:14:00+00:00 exited with status success for try_number 1 2024-04-28T02:15:04.058971854Z [2024-04-28T02:15:04.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:14:00+00:00, map_index=-1, run_start_date=2024-04-28 02:15:02.422514+00:00, run_end_date=2024-04-28 02:15:03.838652+00:00, run_duration=1.416138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:15:00.504541+00:00, queued_by_job_id=1, pid=3627 2024-04-28T02:15:05.109664031Z [2024-04-28T02:15:05.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:15:05.109807916Z [2024-04-28T02:15:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:14:00+00:00, run_id=scheduled__2024-04-28T02:14:00+00:00, run_start_date=2024-04-28 02:15:00.451332+00:00, run_end_date=2024-04-28 02:15:05.109560+00:00, run_duration=4.658228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:14:00+00:00, data_interval_end=2024-04-28 02:15:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:15:05.118076840Z [2024-04-28T02:15:05.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:15:00+00:00, run_after=2024-04-28T02:16:00+00:00 2024-04-28T02:15:05.170410630Z [2024-04-28T02:15:05.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:14:00+00:00 exited with status success for try_number 1 2024-04-28T02:15:05.182004528Z [2024-04-28T02:15:05.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:14:00+00:00, map_index=-1, run_start_date=2024-04-28 02:15:02.558863+00:00, run_end_date=2024-04-28 02:15:04.612228+00:00, run_duration=2.053365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:15:00.504541+00:00, queued_by_job_id=1, pid=3628 2024-04-28T02:15:06.921855218Z [2024-04-28T02:15:06.921+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:15:06.921900871Z 2024-04-28T02:15:06.922134809Z [2024-04-28T02:15:06.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:15:06.922818627Z [2024-04-28T02:15:06.922+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:15:06.922851640Z 2024-04-28T02:15:06.924963144Z [2024-04-28T02:15:06.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:15:06.925229378Z [2024-04-28T02:15:06.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:15:06.980516822Z [2024-04-28T02:15:06.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:15:06.980548122Z [2024-04-28T02:15:06.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:15:06.987587035Z [2024-04-28T02:15:06.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45b88b14-a206-4db8-95f9-a333125c0144 2024-04-28T02:15:06.987758580Z [2024-04-28T02:15:06.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=-1, run_start_date=2024-04-28 02:15:06.073684+00:00, run_end_date=2024-04-28 02:15:06.415789+00:00, run_duration=0.342105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:15:03.846101+00:00, queued_by_job_id=1, pid=3670 2024-04-28T02:15:10.077633031Z [2024-04-28T02:15:10.077+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:15:10.077681472Z 2024-04-28T02:15:10.077916079Z [2024-04-28T02:15:10.077+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:15:10.078728456Z [2024-04-28T02:15:10.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:15:10.078741772Z 2024-04-28T02:15:10.082454275Z [2024-04-28T02:15:10.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:15:10.082761522Z [2024-04-28T02:15:10.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:15:10.151195542Z [2024-04-28T02:15:10.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status queued for try_number 1 2024-04-28T02:15:10.151470757Z [2024-04-28T02:15:10.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:15:10.161904261Z [2024-04-28T02:15:10.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1a62b6e-d901-48d6-827b-b9bafece0668 2024-04-28T02:15:10.162251782Z [2024-04-28T02:15:10.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=0, run_start_date=2024-04-28 02:15:08.675111+00:00, run_end_date=2024-04-28 02:15:09.043697+00:00, run_duration=0.368586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:15:06.923193+00:00, queued_by_job_id=1, pid=3682 2024-04-28T02:15:12.411457228Z [2024-04-28T02:15:12.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:15:12.411913516Z [2024-04-28T02:15:12.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:10:00+00:00, run_id=scheduled__2024-04-28T02:10:00+00:00, run_start_date=2024-04-28 02:15:00.448994+00:00, run_end_date=2024-04-28 02:15:12.411235+00:00, run_duration=11.962241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:10:00+00:00, data_interval_end=2024-04-28 02:15:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:15:12.420198338Z [2024-04-28T02:15:12.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:15:00+00:00, run_after=2024-04-28T02:20:00+00:00 2024-04-28T02:15:12.472337298Z [2024-04-28T02:15:12.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:10:00+00:00 exited with status success for try_number 1 2024-04-28T02:15:12.479054327Z [2024-04-28T02:15:12.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:10:00+00:00, map_index=-1, run_start_date=2024-04-28 02:15:11.676341+00:00, run_end_date=2024-04-28 02:15:12.060798+00:00, run_duration=0.384457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:15:10.079163+00:00, queued_by_job_id=1, pid=3694 2024-04-28T02:16:00.630591208Z [2024-04-28T02:16:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:16:00+00:00, run_after=2024-04-28T02:17:00+00:00 2024-04-28T02:16:00.639146653Z [2024-04-28T02:16:00.638+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:16:00.646432530Z [2024-04-28T02:16:00.646+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:16:00.715096637Z [2024-04-28T02:16:00.714+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:16:00.715118947Z 2024-04-28T02:16:00.715123207Z 2024-04-28T02:16:00.715126547Z 2024-04-28T02:16:00.715327716Z [2024-04-28T02:16:00.715+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:16:00.715537088Z [2024-04-28T02:16:00.715+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:16:00.715718815Z [2024-04-28T02:16:00.715+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:16:00.716371222Z [2024-04-28T02:16:00.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:16:00.716383039Z 2024-04-28T02:16:00.716386687Z 2024-04-28T02:16:00.716389923Z 2024-04-28T02:16:00.719781192Z [2024-04-28T02:16:00.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:16:00.719978870Z [2024-04-28T02:16:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:16:00.720290309Z [2024-04-28T02:16:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:16:00.720470840Z [2024-04-28T02:16:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:16:00.720736682Z [2024-04-28T02:16:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:16:00.720947766Z [2024-04-28T02:16:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:16:01.090909491Z [2024-04-28T02:16:01.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:14:00+00:00 exited with status queued for try_number 1 2024-04-28T02:16:01.091256032Z [2024-04-28T02:16:01.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status queued for try_number 1 2024-04-28T02:16:01.091475944Z [2024-04-28T02:16:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status queued for try_number 1 2024-04-28T02:16:01.101803163Z [2024-04-28T02:16:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255c954c-8207-4f93-974c-823a47f6362d 2024-04-28T02:16:01.102114696Z [2024-04-28T02:16:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 909c9fca-7725-4453-8344-c551abaead56 2024-04-28T02:16:01.102333294Z [2024-04-28T02:16:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b60bee6-0793-4ea4-b1ae-af2a00fe019d 2024-04-28T02:16:02.292883657Z [2024-04-28T02:16:02.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:16:02.297246195Z [2024-04-28T02:16:02.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:14:00+00:00, run_id=scheduled__2024-04-28T02:14:00+00:00, run_start_date=2024-04-28 02:16:00.656119+00:00, run_end_date=2024-04-28 02:16:02.296517+00:00, run_duration=1.640398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:14:00+00:00, data_interval_end=2024-04-28 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:16:02.309890155Z [2024-04-28T02:16:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:16:00+00:00, run_after=2024-04-28T02:18:00+00:00 2024-04-28T02:16:02.365596909Z [2024-04-28T02:16:02.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:14:00+00:00 exited with status success for try_number 1 2024-04-28T02:16:02.371802589Z [2024-04-28T02:16:02.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:14:00+00:00, map_index=-1, run_start_date=2024-04-28 02:16:01.612258+00:00, run_end_date=2024-04-28 02:16:02.048708+00:00, run_duration=0.43645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:16:00.717154+00:00, queued_by_job_id=1, pid=3698 2024-04-28T02:16:05.813173512Z [2024-04-28T02:16:05.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:16:05.813410928Z [2024-04-28T02:16:05.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:15:00+00:00, run_id=scheduled__2024-04-28T02:15:00+00:00, run_start_date=2024-04-28 02:16:00.657315+00:00, run_end_date=2024-04-28 02:16:05.813095+00:00, run_duration=5.15578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:15:00+00:00, data_interval_end=2024-04-28 02:16:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:16:05.825770398Z [2024-04-28T02:16:05.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:16:00+00:00, run_after=2024-04-28T02:17:00+00:00 2024-04-28T02:16:05.833011619Z [2024-04-28T02:16:05.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:16:05.833207957Z [2024-04-28T02:16:05.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:15:00+00:00, run_id=scheduled__2024-04-28T02:15:00+00:00, run_start_date=2024-04-28 02:16:00.658477+00:00, run_end_date=2024-04-28 02:16:05.832898+00:00, run_duration=5.174421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:15:00+00:00, data_interval_end=2024-04-28 02:16:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:16:05.844523181Z [2024-04-28T02:16:05.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:16:00+00:00, run_after=2024-04-28T02:17:00+00:00 2024-04-28T02:16:05.884834863Z [2024-04-28T02:16:05.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status success for try_number 1 2024-04-28T02:16:05.884948038Z [2024-04-28T02:16:05.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status success for try_number 1 2024-04-28T02:16:05.890520850Z [2024-04-28T02:16:05.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:15:00+00:00, map_index=-1, run_start_date=2024-04-28 02:16:03.032306+00:00, run_end_date=2024-04-28 02:16:04.975950+00:00, run_duration=1.943644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:16:00.717154+00:00, queued_by_job_id=1, pid=3739 2024-04-28T02:16:05.892488645Z [2024-04-28T02:16:05.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:15:00+00:00, map_index=-1, run_start_date=2024-04-28 02:16:02.882584+00:00, run_end_date=2024-04-28 02:16:05.336578+00:00, run_duration=2.453994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:16:00.717154+00:00, queued_by_job_id=1, pid=3738 2024-04-28T02:16:15.956606015Z [2024-04-28T02:16:15.956+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:17:00.549367472Z [2024-04-28T02:17:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:17:00+00:00, run_after=2024-04-28T02:18:00+00:00 2024-04-28T02:17:00.556229677Z [2024-04-28T02:17:00.555+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:17:00.614195838Z [2024-04-28T02:17:00.613+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:17:00.614223336Z 2024-04-28T02:17:00.614226790Z 2024-04-28T02:17:00.614391029Z [2024-04-28T02:17:00.614+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:17:00.614796272Z [2024-04-28T02:17:00.614+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:17:00.616259851Z [2024-04-28T02:17:00.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:17:00.616265162Z 2024-04-28T02:17:00.616268529Z 2024-04-28T02:17:00.620964562Z [2024-04-28T02:17:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:17:00.621181079Z [2024-04-28T02:17:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:17:00.621518261Z [2024-04-28T02:17:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:17:00.621676030Z [2024-04-28T02:17:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:17:00.782648856Z [2024-04-28T02:17:00.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:16:00+00:00 exited with status queued for try_number 1 2024-04-28T02:17:00.782708803Z [2024-04-28T02:17:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:16:00+00:00 exited with status queued for try_number 1 2024-04-28T02:17:00.794660548Z [2024-04-28T02:17:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44c99ca1-52f3-41e4-844c-6b72ffcb6a3e 2024-04-28T02:17:00.794777189Z [2024-04-28T02:17:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d2b674-535d-4542-a6b1-d1bcb130d249 2024-04-28T02:17:04.127258169Z [2024-04-28T02:17:04.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:17:04.127556796Z [2024-04-28T02:17:04.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:16:00+00:00, run_id=scheduled__2024-04-28T02:16:00+00:00, run_start_date=2024-04-28 02:17:00.571682+00:00, run_end_date=2024-04-28 02:17:04.127045+00:00, run_duration=3.555363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:16:00+00:00, data_interval_end=2024-04-28 02:17:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:17:04.141965292Z [2024-04-28T02:17:04.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:17:00+00:00, run_after=2024-04-28T02:18:00+00:00 2024-04-28T02:17:04.148394600Z [2024-04-28T02:17:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:17:04.148584593Z [2024-04-28T02:17:04.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:16:00+00:00, run_id=scheduled__2024-04-28T02:16:00+00:00, run_start_date=2024-04-28 02:17:00.574989+00:00, run_end_date=2024-04-28 02:17:04.148300+00:00, run_duration=3.573311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:16:00+00:00, data_interval_end=2024-04-28 02:17:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:17:04.157814131Z [2024-04-28T02:17:04.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:17:00+00:00, run_after=2024-04-28T02:18:00+00:00 2024-04-28T02:17:04.206608863Z [2024-04-28T02:17:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:16:00+00:00 exited with status success for try_number 1 2024-04-28T02:17:04.206653580Z [2024-04-28T02:17:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:16:00+00:00 exited with status success for try_number 1 2024-04-28T02:17:04.214682290Z [2024-04-28T02:17:04.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:16:00+00:00, map_index=-1, run_start_date=2024-04-28 02:17:02.344953+00:00, run_end_date=2024-04-28 02:17:03.597513+00:00, run_duration=1.25256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:17:00.617543+00:00, queued_by_job_id=1, pid=3794 2024-04-28T02:17:04.214705545Z [2024-04-28T02:17:04.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:16:00+00:00, map_index=-1, run_start_date=2024-04-28 02:17:02.288922+00:00, run_end_date=2024-04-28 02:17:03.889476+00:00, run_duration=1.600554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:17:00.617543+00:00, queued_by_job_id=1, pid=3793 2024-04-28T02:18:00.065681960Z [2024-04-28T02:18:00.065+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:18:00.071668155Z [2024-04-28T02:18:00.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:18:00.082720587Z [2024-04-28T02:18:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:18:00+00:00, run_after=2024-04-28T02:19:00+00:00 2024-04-28T02:18:00.161688615Z [2024-04-28T02:18:00.161+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:18:00.161714643Z 2024-04-28T02:18:00.161732750Z 2024-04-28T02:18:00.161736417Z 2024-04-28T02:18:00.161819165Z [2024-04-28T02:18:00.161+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:18:00.161942968Z [2024-04-28T02:18:00.161+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:18:00.162073778Z [2024-04-28T02:18:00.161+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:18:00.162674599Z [2024-04-28T02:18:00.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:18:00.162685626Z 2024-04-28T02:18:00.162688881Z 2024-04-28T02:18:00.162691998Z 2024-04-28T02:18:00.165982359Z [2024-04-28T02:18:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:18:00.166136601Z [2024-04-28T02:18:00.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:18:00.166475699Z [2024-04-28T02:18:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:18:00.166601527Z [2024-04-28T02:18:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:18:00.166818280Z [2024-04-28T02:18:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:18:00.166942369Z [2024-04-28T02:18:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:18:00.531089435Z [2024-04-28T02:18:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:16:00+00:00 exited with status queued for try_number 1 2024-04-28T02:18:00.531115399Z [2024-04-28T02:18:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:17:00+00:00 exited with status queued for try_number 1 2024-04-28T02:18:00.531132959Z [2024-04-28T02:18:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:17:00+00:00 exited with status queued for try_number 1 2024-04-28T02:18:00.546565228Z [2024-04-28T02:18:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d5c424a-e84f-4f6b-a341-aea2385238fb 2024-04-28T02:18:00.546591687Z [2024-04-28T02:18:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2614d3d0-6af7-4aeb-96d2-45e7feac7612 2024-04-28T02:18:00.546595551Z [2024-04-28T02:18:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c358552-fe49-4cc9-8b72-7cc261feb8bd 2024-04-28T02:18:01.741629173Z [2024-04-28T02:18:01.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:18:01.742884638Z [2024-04-28T02:18:01.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:16:00+00:00, run_id=scheduled__2024-04-28T02:16:00+00:00, run_start_date=2024-04-28 02:18:00.092635+00:00, run_end_date=2024-04-28 02:18:01.741731+00:00, run_duration=1.649096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:16:00+00:00, data_interval_end=2024-04-28 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:18:01.753288610Z [2024-04-28T02:18:01.752+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:18:00+00:00, run_after=2024-04-28T02:20:00+00:00 2024-04-28T02:18:01.841645645Z [2024-04-28T02:18:01.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:16:00+00:00 exited with status success for try_number 1 2024-04-28T02:18:01.846836327Z [2024-04-28T02:18:01.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:16:00+00:00, map_index=-1, run_start_date=2024-04-28 02:18:01.104716+00:00, run_end_date=2024-04-28 02:18:01.471028+00:00, run_duration=0.366312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:18:00.163319+00:00, queued_by_job_id=1, pid=3819 2024-04-28T02:18:03.994241051Z [2024-04-28T02:18:03.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:18:03.995327480Z [2024-04-28T02:18:03.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:17:00+00:00, run_id=scheduled__2024-04-28T02:17:00+00:00, run_start_date=2024-04-28 02:18:00.095445+00:00, run_end_date=2024-04-28 02:18:03.994838+00:00, run_duration=3.899393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:17:00+00:00, data_interval_end=2024-04-28 02:18:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:18:04.006654939Z [2024-04-28T02:18:04.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:18:00+00:00, run_after=2024-04-28T02:19:00+00:00 2024-04-28T02:18:04.015276150Z [2024-04-28T02:18:04.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:18:04.015863458Z [2024-04-28T02:18:04.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:17:00+00:00, run_id=scheduled__2024-04-28T02:17:00+00:00, run_start_date=2024-04-28 02:18:00.093954+00:00, run_end_date=2024-04-28 02:18:04.015509+00:00, run_duration=3.921555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:17:00+00:00, data_interval_end=2024-04-28 02:18:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:18:04.027458291Z [2024-04-28T02:18:04.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:18:00+00:00, run_after=2024-04-28T02:19:00+00:00 2024-04-28T02:18:04.054724946Z [2024-04-28T02:18:04.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:17:00+00:00 exited with status success for try_number 1 2024-04-28T02:18:04.055002681Z [2024-04-28T02:18:04.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:17:00+00:00 exited with status success for try_number 1 2024-04-28T02:18:04.061161795Z [2024-04-28T02:18:04.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:17:00+00:00, map_index=-1, run_start_date=2024-04-28 02:18:02.198361+00:00, run_end_date=2024-04-28 02:18:03.718597+00:00, run_duration=1.520236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:18:00.163319+00:00, queued_by_job_id=1, pid=3859 2024-04-28T02:18:04.061597691Z [2024-04-28T02:18:04.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:17:00+00:00, map_index=-1, run_start_date=2024-04-28 02:18:02.307353+00:00, run_end_date=2024-04-28 02:18:03.518209+00:00, run_duration=1.210856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:18:00.163319+00:00, queued_by_job_id=1, pid=3860 2024-04-28T02:19:00.379835795Z [2024-04-28T02:19:00.379+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:19:00.393687443Z [2024-04-28T02:19:00.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:19:00+00:00, run_after=2024-04-28T02:20:00+00:00 2024-04-28T02:19:00.437819684Z [2024-04-28T02:19:00.437+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:19:00.437846615Z 2024-04-28T02:19:00.437850898Z 2024-04-28T02:19:00.437903845Z [2024-04-28T02:19:00.437+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:19:00.437916426Z [2024-04-28T02:19:00.437+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:19:00.438418071Z [2024-04-28T02:19:00.438+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:19:00.438435409Z 2024-04-28T02:19:00.438439100Z 2024-04-28T02:19:00.440732761Z [2024-04-28T02:19:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:19:00.441150954Z [2024-04-28T02:19:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:19:00.441578088Z [2024-04-28T02:19:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:19:00.441679900Z [2024-04-28T02:19:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:19:00.583982876Z [2024-04-28T02:19:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:18:00+00:00 exited with status queued for try_number 1 2024-04-28T02:19:00.584044725Z [2024-04-28T02:19:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:18:00+00:00 exited with status queued for try_number 1 2024-04-28T02:19:00.591867562Z [2024-04-28T02:19:00.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2422a561-a1a8-444e-9a3e-e949c43f0746 2024-04-28T02:19:00.592098675Z [2024-04-28T02:19:00.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to a22c2185-e201-4557-9557-55daa0b6a9b8 2024-04-28T02:19:03.642119887Z [2024-04-28T02:19:03.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:19:03.642508035Z [2024-04-28T02:19:03.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:18:00+00:00, run_id=scheduled__2024-04-28T02:18:00+00:00, run_start_date=2024-04-28 02:19:00.404320+00:00, run_end_date=2024-04-28 02:19:03.642136+00:00, run_duration=3.237816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:18:00+00:00, data_interval_end=2024-04-28 02:19:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:19:03.655489042Z [2024-04-28T02:19:03.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:19:00+00:00, run_after=2024-04-28T02:20:00+00:00 2024-04-28T02:19:04.752463369Z [2024-04-28T02:19:04.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:19:04.752924149Z [2024-04-28T02:19:04.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:18:00+00:00, run_id=scheduled__2024-04-28T02:18:00+00:00, run_start_date=2024-04-28 02:19:00.405537+00:00, run_end_date=2024-04-28 02:19:04.752563+00:00, run_duration=4.347026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:18:00+00:00, data_interval_end=2024-04-28 02:19:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:19:04.763897824Z [2024-04-28T02:19:04.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:19:00+00:00, run_after=2024-04-28T02:20:00+00:00 2024-04-28T02:19:04.789862727Z [2024-04-28T02:19:04.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:18:00+00:00 exited with status success for try_number 1 2024-04-28T02:19:04.790143961Z [2024-04-28T02:19:04.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:18:00+00:00 exited with status success for try_number 1 2024-04-28T02:19:04.796216444Z [2024-04-28T02:19:04.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:18:00+00:00, map_index=-1, run_start_date=2024-04-28 02:19:02.118009+00:00, run_end_date=2024-04-28 02:19:03.576567+00:00, run_duration=1.458558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:19:00.438822+00:00, queued_by_job_id=1, pid=3914 2024-04-28T02:19:04.796645879Z [2024-04-28T02:19:04.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:18:00+00:00, map_index=-1, run_start_date=2024-04-28 02:19:02.197540+00:00, run_end_date=2024-04-28 02:19:03.875401+00:00, run_duration=1.677861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:19:00.438822+00:00, queued_by_job_id=1, pid=3915 2024-04-28T02:20:00.642646334Z [2024-04-28T02:20:00.642+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:20:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:20:00.652955577Z [2024-04-28T02:20:00.652+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:20:00.668295998Z [2024-04-28T02:20:00.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:20:00+00:00, run_after=2024-04-28T02:21:00+00:00 2024-04-28T02:20:00.676953732Z [2024-04-28T02:20:00.676+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:20:00.771289738Z [2024-04-28T02:20:00.770+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:20:00.771332940Z 2024-04-28T02:20:00.771344011Z 2024-04-28T02:20:00.771354870Z 2024-04-28T02:20:00.771363485Z 2024-04-28T02:20:00.771783912Z [2024-04-28T02:20:00.771+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:20:00.772276665Z [2024-04-28T02:20:00.771+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:20:00.772882284Z [2024-04-28T02:20:00.772+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:20:00.773407652Z [2024-04-28T02:20:00.773+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:20:00.775167206Z [2024-04-28T02:20:00.774+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:20:00.775182860Z 2024-04-28T02:20:00.775190149Z 2024-04-28T02:20:00.775197199Z 2024-04-28T02:20:00.775204127Z 2024-04-28T02:20:00.781309695Z [2024-04-28T02:20:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:20:00.781701682Z [2024-04-28T02:20:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:20:00.782264466Z [2024-04-28T02:20:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:20:00.782746197Z [2024-04-28T02:20:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:20:00.783365825Z [2024-04-28T02:20:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:20:00.783785156Z [2024-04-28T02:20:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:20:00.784244131Z [2024-04-28T02:20:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:20:00.784606124Z [2024-04-28T02:20:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:20:01.239415108Z [2024-04-28T02:20:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:01.240624040Z [2024-04-28T02:20:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:18:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:01.241051154Z [2024-04-28T02:20:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:19:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:01.241464435Z [2024-04-28T02:20:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:19:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:01.253168656Z [2024-04-28T02:20:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5808f2b-b15f-4f7f-9638-1b21d7e4a0ba 2024-04-28T02:20:01.253515713Z [2024-04-28T02:20:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccbda74e-51da-4427-8bf2-762c3331e975 2024-04-28T02:20:01.254093618Z [2024-04-28T02:20:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 605bf2c6-8587-40d0-abd9-36166c19e57e 2024-04-28T02:20:01.254968306Z [2024-04-28T02:20:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to a76b2e59-dafd-467b-a617-524789b7e5de 2024-04-28T02:20:02.321216380Z [2024-04-28T02:20:02.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:20:02.321814977Z [2024-04-28T02:20:02.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:18:00+00:00, run_id=scheduled__2024-04-28T02:18:00+00:00, run_start_date=2024-04-28 02:20:00.690512+00:00, run_end_date=2024-04-28 02:20:02.321439+00:00, run_duration=1.630927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:18:00+00:00, data_interval_end=2024-04-28 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:20:02.330979501Z [2024-04-28T02:20:02.330+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:20:00+00:00, run_after=2024-04-28T02:22:00+00:00 2024-04-28T02:20:02.374784207Z [2024-04-28T02:20:02.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:18:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:02.379618430Z [2024-04-28T02:20:02.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:18:00+00:00, map_index=-1, run_start_date=2024-04-28 02:20:01.547497+00:00, run_end_date=2024-04-28 02:20:01.875515+00:00, run_duration=0.328018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:00.776870+00:00, queued_by_job_id=1, pid=3941 2024-04-28T02:20:03.471008440Z [2024-04-28T02:20:03.470+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:20:03.471038807Z 2024-04-28T02:20:03.473542619Z [2024-04-28T02:20:03.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:20:03.474530852Z [2024-04-28T02:20:03.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:20:03.474547325Z 2024-04-28T02:20:03.478539552Z [2024-04-28T02:20:03.478+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:20:03.478711337Z [2024-04-28T02:20:03.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:20:03.552995816Z [2024-04-28T02:20:03.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:03.558898826Z [2024-04-28T02:20:03.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to d945dc0b-19f5-48e9-993d-05ec271dd351 2024-04-28T02:20:03.731976404Z [2024-04-28T02:20:03.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:03.751519161Z [2024-04-28T02:20:03.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:15:00+00:00, map_index=-1, run_start_date=2024-04-28 02:20:03.025196+00:00, run_end_date=2024-04-28 02:20:03.408766+00:00, run_duration=0.38357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:00.776870+00:00, queued_by_job_id=1, pid=3992 2024-04-28T02:20:04.843868221Z [2024-04-28T02:20:04.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:20:04.844028068Z [2024-04-28T02:20:04.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:19:00+00:00, run_id=scheduled__2024-04-28T02:19:00+00:00, run_start_date=2024-04-28 02:20:00.691678+00:00, run_end_date=2024-04-28 02:20:04.843781+00:00, run_duration=4.152103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:19:00+00:00, data_interval_end=2024-04-28 02:20:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:20:04.856110355Z [2024-04-28T02:20:04.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:20:00+00:00, run_after=2024-04-28T02:21:00+00:00 2024-04-28T02:20:04.929286710Z [2024-04-28T02:20:04.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:19:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:04.951916172Z [2024-04-28T02:20:04.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:19:00+00:00, map_index=-1, run_start_date=2024-04-28 02:20:02.848071+00:00, run_end_date=2024-04-28 02:20:04.329053+00:00, run_duration=1.480982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:00.776870+00:00, queued_by_job_id=1, pid=3982 2024-04-28T02:20:06.016538963Z [2024-04-28T02:20:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:20:06.018157898Z [2024-04-28T02:20:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:19:00+00:00, run_id=scheduled__2024-04-28T02:19:00+00:00, run_start_date=2024-04-28 02:20:00.692773+00:00, run_end_date=2024-04-28 02:20:06.016449+00:00, run_duration=5.323676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:19:00+00:00, data_interval_end=2024-04-28 02:20:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:20:06.031127233Z [2024-04-28T02:20:06.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:20:00+00:00, run_after=2024-04-28T02:21:00+00:00 2024-04-28T02:20:06.073486312Z [2024-04-28T02:20:06.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:19:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:06.082630092Z [2024-04-28T02:20:06.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:19:00+00:00, map_index=-1, run_start_date=2024-04-28 02:20:03.141152+00:00, run_end_date=2024-04-28 02:20:05.064468+00:00, run_duration=1.923316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:00.776870+00:00, queued_by_job_id=1, pid=3993 2024-04-28T02:20:07.154295752Z [2024-04-28T02:20:07.153+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:20:07.154336223Z 2024-04-28T02:20:07.154341162Z [2024-04-28T02:20:07.154+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:20:07.154923544Z [2024-04-28T02:20:07.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:20:07.154952176Z 2024-04-28T02:20:07.158421742Z [2024-04-28T02:20:07.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:20:07.158795140Z [2024-04-28T02:20:07.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:20:07.209272791Z [2024-04-28T02:20:07.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:07.209389707Z [2024-04-28T02:20:07.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:07.215392218Z [2024-04-28T02:20:07.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to fad43596-0e34-4155-8ddb-139a3e82a2aa 2024-04-28T02:20:07.215909901Z [2024-04-28T02:20:07.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:15:00+00:00, map_index=-1, run_start_date=2024-04-28 02:20:05.721318+00:00, run_end_date=2024-04-28 02:20:06.037385+00:00, run_duration=0.316067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:03.475107+00:00, queued_by_job_id=1, pid=4035 2024-04-28T02:20:10.083741787Z [2024-04-28T02:20:10.083+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:20:10.083793997Z 2024-04-28T02:20:10.084115414Z [2024-04-28T02:20:10.083+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:20:10.085385417Z [2024-04-28T02:20:10.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:20:10.085430334Z 2024-04-28T02:20:10.090612095Z [2024-04-28T02:20:10.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:20:10.090639096Z [2024-04-28T02:20:10.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:20:10.170668762Z [2024-04-28T02:20:10.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status queued for try_number 1 2024-04-28T02:20:10.170896326Z [2024-04-28T02:20:10.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:10.178305899Z [2024-04-28T02:20:10.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3ac370c-f4bd-404a-a989-894efc10d141 2024-04-28T02:20:10.178547171Z [2024-04-28T02:20:10.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:15:00+00:00, map_index=0, run_start_date=2024-04-28 02:20:08.720344+00:00, run_end_date=2024-04-28 02:20:09.012531+00:00, run_duration=0.292187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:07.155492+00:00, queued_by_job_id=1, pid=4046 2024-04-28T02:20:12.402310071Z [2024-04-28T02:20:12.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:20:12.402339469Z [2024-04-28T02:20:12.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:15:00+00:00, run_id=scheduled__2024-04-28T02:15:00+00:00, run_start_date=2024-04-28 02:20:00.688881+00:00, run_end_date=2024-04-28 02:20:12.401164+00:00, run_duration=11.712283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:15:00+00:00, data_interval_end=2024-04-28 02:20:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:20:12.412990185Z [2024-04-28T02:20:12.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:20:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:20:12.465401904Z [2024-04-28T02:20:12.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:15:00+00:00 exited with status success for try_number 1 2024-04-28T02:20:12.471367082Z [2024-04-28T02:20:12.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:15:00+00:00, map_index=-1, run_start_date=2024-04-28 02:20:11.690997+00:00, run_end_date=2024-04-28 02:20:12.068667+00:00, run_duration=0.37767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:20:10.086095+00:00, queued_by_job_id=1, pid=4058 2024-04-28T02:21:00.886178092Z [2024-04-28T02:21:00.885+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:21:00.903248823Z [2024-04-28T02:21:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:21:00+00:00, run_after=2024-04-28T02:22:00+00:00 2024-04-28T02:21:00.978972396Z [2024-04-28T02:21:00.978+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:21:00.979015545Z 2024-04-28T02:21:00.979034440Z 2024-04-28T02:21:00.979508442Z [2024-04-28T02:21:00.979+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:21:00.979961426Z [2024-04-28T02:21:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:21:00.981506320Z [2024-04-28T02:21:00.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:21:00.981534434Z 2024-04-28T02:21:00.981544273Z 2024-04-28T02:21:00.985890344Z [2024-04-28T02:21:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:21:00.986049129Z [2024-04-28T02:21:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:21:00.986270859Z [2024-04-28T02:21:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:21:00.986397440Z [2024-04-28T02:21:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:21:01.135333255Z [2024-04-28T02:21:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:21:01.135363469Z [2024-04-28T02:21:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:21:01.144124621Z [2024-04-28T02:21:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to dedffa52-e6aa-41e2-8513-6cb40a97b935 2024-04-28T02:21:01.144155720Z [2024-04-28T02:21:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 521ce95a-720f-4dde-a9d6-acb71ff04293 2024-04-28T02:21:04.375053475Z [2024-04-28T02:21:04.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:21:04.375776092Z [2024-04-28T02:21:04.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:20:00+00:00, run_id=scheduled__2024-04-28T02:20:00+00:00, run_start_date=2024-04-28 02:21:00.923300+00:00, run_end_date=2024-04-28 02:21:04.375379+00:00, run_duration=3.452079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:20:00+00:00, data_interval_end=2024-04-28 02:21:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:21:04.385347490Z [2024-04-28T02:21:04.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:21:00+00:00, run_after=2024-04-28T02:22:00+00:00 2024-04-28T02:21:04.435682844Z [2024-04-28T02:21:04.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:21:04.447729395Z [2024-04-28T02:21:04.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=-1, run_start_date=2024-04-28 02:21:02.681758+00:00, run_end_date=2024-04-28 02:21:04.266676+00:00, run_duration=1.584918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:21:00.983049+00:00, queued_by_job_id=1, pid=4090 2024-04-28T02:21:05.497135381Z [2024-04-28T02:21:05.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:21:05.497865886Z [2024-04-28T02:21:05.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:20:00+00:00, run_id=scheduled__2024-04-28T02:20:00+00:00, run_start_date=2024-04-28 02:21:00.921051+00:00, run_end_date=2024-04-28 02:21:05.497266+00:00, run_duration=4.576215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:20:00+00:00, data_interval_end=2024-04-28 02:21:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:21:05.512664705Z [2024-04-28T02:21:05.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:21:00+00:00, run_after=2024-04-28T02:22:00+00:00 2024-04-28T02:21:05.634645025Z [2024-04-28T02:21:05.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:21:05.690485346Z [2024-04-28T02:21:05.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=-1, run_start_date=2024-04-28 02:21:02.878706+00:00, run_end_date=2024-04-28 02:21:04.499832+00:00, run_duration=1.621126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:21:00.983049+00:00, queued_by_job_id=1, pid=4091 2024-04-28T02:21:16.018966104Z [2024-04-28T02:21:16.018+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:22:01.067544159Z [2024-04-28T02:22:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:22:00+00:00, run_after=2024-04-28T02:23:00+00:00 2024-04-28T02:22:01.083134621Z [2024-04-28T02:22:01.082+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:22:01.108523171Z [2024-04-28T02:22:01.108+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:22:01.201091104Z [2024-04-28T02:22:01.200+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:22:01.201145814Z 2024-04-28T02:22:01.201162943Z 2024-04-28T02:22:01.201175726Z 2024-04-28T02:22:01.201586226Z [2024-04-28T02:22:01.201+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:22:01.202149651Z [2024-04-28T02:22:01.201+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:22:01.202796314Z [2024-04-28T02:22:01.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:22:01.204839370Z [2024-04-28T02:22:01.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:22:01.204858048Z 2024-04-28T02:22:01.204864256Z 2024-04-28T02:22:01.204870147Z 2024-04-28T02:22:01.210230709Z [2024-04-28T02:22:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:22:01.210653753Z [2024-04-28T02:22:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:22:01.211123275Z [2024-04-28T02:22:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:22:01.211415126Z [2024-04-28T02:22:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:22:01.212233941Z [2024-04-28T02:22:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:22:01.212605996Z [2024-04-28T02:22:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:22:01.488854247Z [2024-04-28T02:22:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:22:01.488921388Z [2024-04-28T02:22:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:21:00+00:00 exited with status queued for try_number 1 2024-04-28T02:22:01.488939948Z [2024-04-28T02:22:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:21:00+00:00 exited with status queued for try_number 1 2024-04-28T02:22:01.496816380Z [2024-04-28T02:22:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae30f20d-b2a9-4646-b03d-35473a035b9e 2024-04-28T02:22:01.497222587Z [2024-04-28T02:22:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1061af6-9204-4627-8e1f-2e6d6b9d8dbe 2024-04-28T02:22:01.497502220Z [2024-04-28T02:22:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c3b328e-4962-49ef-a708-e4e333619422 2024-04-28T02:22:02.655098221Z [2024-04-28T02:22:02.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:22:02.655604902Z [2024-04-28T02:22:02.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:20:00+00:00, run_id=scheduled__2024-04-28T02:20:00+00:00, run_start_date=2024-04-28 02:22:01.120666+00:00, run_end_date=2024-04-28 02:22:02.655047+00:00, run_duration=1.534381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:20:00+00:00, data_interval_end=2024-04-28 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:22:02.664220330Z [2024-04-28T02:22:02.663+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:22:00+00:00, run_after=2024-04-28T02:24:00+00:00 2024-04-28T02:22:02.709719685Z [2024-04-28T02:22:02.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:22:02.719653047Z [2024-04-28T02:22:02.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=-1, run_start_date=2024-04-28 02:22:02.052551+00:00, run_end_date=2024-04-28 02:22:02.518919+00:00, run_duration=0.466368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:22:01.206353+00:00, queued_by_job_id=1, pid=4125 2024-04-28T02:22:05.265794440Z [2024-04-28T02:22:05.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:22:05.266122526Z [2024-04-28T02:22:05.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:21:00+00:00, run_id=scheduled__2024-04-28T02:21:00+00:00, run_start_date=2024-04-28 02:22:01.122202+00:00, run_end_date=2024-04-28 02:22:05.265785+00:00, run_duration=4.143583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:21:00+00:00, data_interval_end=2024-04-28 02:22:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:22:05.281108984Z [2024-04-28T02:22:05.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:22:00+00:00, run_after=2024-04-28T02:23:00+00:00 2024-04-28T02:22:05.291907354Z [2024-04-28T02:22:05.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:22:05.292275490Z [2024-04-28T02:22:05.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:21:00+00:00, run_id=scheduled__2024-04-28T02:21:00+00:00, run_start_date=2024-04-28 02:22:01.123489+00:00, run_end_date=2024-04-28 02:22:05.291976+00:00, run_duration=4.168487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:21:00+00:00, data_interval_end=2024-04-28 02:22:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:22:05.305989679Z [2024-04-28T02:22:05.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:22:00+00:00, run_after=2024-04-28T02:23:00+00:00 2024-04-28T02:22:05.386909000Z [2024-04-28T02:22:05.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:21:00+00:00 exited with status success for try_number 1 2024-04-28T02:22:05.395426151Z [2024-04-28T02:22:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:21:00+00:00, map_index=-1, run_start_date=2024-04-28 02:22:03.200398+00:00, run_end_date=2024-04-28 02:22:04.461589+00:00, run_duration=1.261191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:22:01.206353+00:00, queued_by_job_id=1, pid=4156 2024-04-28T02:22:06.499049301Z [2024-04-28T02:22:06.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:21:00+00:00 exited with status success for try_number 1 2024-04-28T02:22:06.507393125Z [2024-04-28T02:22:06.506+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:21:00+00:00, map_index=-1, run_start_date=2024-04-28 02:22:03.192030+00:00, run_end_date=2024-04-28 02:22:05.189532+00:00, run_duration=1.997502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:22:01.206353+00:00, queued_by_job_id=1, pid=4155 2024-04-28T02:22:20.482465830Z [2024-04-28T02:22:20.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 to 2024-04-28T02:22:00+00:00, run_after=2024-04-28T02:23:00+00:00 2024-04-28T02:22:20.524041393Z [2024-04-28T02:22:20.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:22:20.524077969Z 2024-04-28T02:22:20.524358295Z [2024-04-28T02:22:20.523+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 has 0/16 running and queued tasks 2024-04-28T02:22:20.525199514Z [2024-04-28T02:22:20.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:22:20.525217019Z 2024-04-28T02:22:20.528137491Z [2024-04-28T02:22:20.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:22:20.528619388Z [2024-04-28T02:22:20.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-28T02:22:20.578190822Z [2024-04-28T02:22:20.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:21:00+00:00 exited with status queued for try_number 1 2024-04-28T02:22:20.586103987Z [2024-04-28T02:22:20.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb24abf9-9ab7-4ee0-927c-1bc9e2582c07 2024-04-28T02:22:21.728017468Z [2024-04-28T02:22:21.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:22:21.728940432Z [2024-04-28T02:22:21.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, execution_date=2024-04-28 02:21:00+00:00, run_id=scheduled__2024-04-28T02:21:00+00:00, run_start_date=2024-04-28 02:22:20.491862+00:00, run_end_date=2024-04-28 02:22:21.728170+00:00, run_duration=1.236308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:21:00+00:00, data_interval_end=2024-04-28 02:22:00+00:00, dag_hash=b892e9cb2e9b8dc95dd1bfdd52dd4d78 2024-04-28T02:22:21.742435645Z [2024-04-28T02:22:21.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 to 2024-04-28T02:22:00+00:00, run_after=2024-04-28T02:23:00+00:00 2024-04-28T02:22:21.778032729Z [2024-04-28T02:22:21.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:21:00+00:00 exited with status success for try_number 1 2024-04-28T02:22:21.784952372Z [2024-04-28T02:22:21.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:21:00+00:00, map_index=-1, run_start_date=2024-04-28 02:22:21.185473+00:00, run_end_date=2024-04-28 02:22:21.574545+00:00, run_duration=0.389072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:22:20.525707+00:00, queued_by_job_id=1, pid=4188 2024-04-28T02:23:00.117695153Z [2024-04-28T02:23:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 to 2024-04-28T02:23:00+00:00, run_after=2024-04-28T02:24:00+00:00 2024-04-28T02:23:00.127284061Z [2024-04-28T02:23:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:23:00.139556139Z [2024-04-28T02:23:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:23:00+00:00, run_after=2024-04-28T02:24:00+00:00 2024-04-28T02:23:00.229697379Z [2024-04-28T02:23:00.229+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:23:00.229711646Z 2024-04-28T02:23:00.229715208Z 2024-04-28T02:23:00.229718547Z 2024-04-28T02:23:00.229993229Z [2024-04-28T02:23:00.229+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:23:00.230013473Z [2024-04-28T02:23:00.229+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:23:00.232785080Z [2024-04-28T02:23:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 has 0/16 running and queued tasks 2024-04-28T02:23:00.232801415Z [2024-04-28T02:23:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:23:00.232806349Z 2024-04-28T02:23:00.232810761Z 2024-04-28T02:23:00.232832701Z 2024-04-28T02:23:00.233465487Z [2024-04-28T02:23:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:23:00.233581399Z [2024-04-28T02:23:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:23:00.233984674Z [2024-04-28T02:23:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:23:00.233993231Z [2024-04-28T02:23:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:23:00.234174400Z [2024-04-28T02:23:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:23:00.234224868Z [2024-04-28T02:23:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-28T02:23:00.577038844Z [2024-04-28T02:23:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status queued for try_number 1 2024-04-28T02:23:00.577917628Z [2024-04-28T02:23:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status queued for try_number 1 2024-04-28T02:23:00.578133238Z [2024-04-28T02:23:00.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status queued for try_number 1 2024-04-28T02:23:00.591398239Z [2024-04-28T02:23:00.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a48fbb8-9a63-4923-a112-6435f3e120b2 2024-04-28T02:23:00.591677559Z [2024-04-28T02:23:00.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64612abc-106d-46a0-b00f-a2a7bb616184 2024-04-28T02:23:00.591890680Z [2024-04-28T02:23:00.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd5aaf7d-f32b-4c7c-a5a0-bc1c289857f8 2024-04-28T02:23:01.734529598Z [2024-04-28T02:23:01.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:23:01.735247169Z [2024-04-28T02:23:01.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, execution_date=2024-04-28 02:22:00+00:00, run_id=scheduled__2024-04-28T02:22:00+00:00, run_start_date=2024-04-28 02:23:00.152562+00:00, run_end_date=2024-04-28 02:23:01.734826+00:00, run_duration=1.582264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:22:00+00:00, data_interval_end=2024-04-28 02:23:00+00:00, dag_hash=b892e9cb2e9b8dc95dd1bfdd52dd4d78 2024-04-28T02:23:01.745549120Z [2024-04-28T02:23:01.745+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 to 2024-04-28T02:23:00+00:00, run_after=2024-04-28T02:24:00+00:00 2024-04-28T02:23:01.834348924Z [2024-04-28T02:23:01.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status success for try_number 1 2024-04-28T02:23:01.844706496Z [2024-04-28T02:23:01.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:22:00+00:00, map_index=-1, run_start_date=2024-04-28 02:23:01.031836+00:00, run_end_date=2024-04-28 02:23:01.463235+00:00, run_duration=0.431399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:23:00.230944+00:00, queued_by_job_id=1, pid=4210 2024-04-28T02:23:03.988977598Z [2024-04-28T02:23:03.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:23:03.989797219Z [2024-04-28T02:23:03.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:22:00+00:00, run_id=scheduled__2024-04-28T02:22:00+00:00, run_start_date=2024-04-28 02:23:00.159823+00:00, run_end_date=2024-04-28 02:23:03.988838+00:00, run_duration=3.829015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:22:00+00:00, data_interval_end=2024-04-28 02:23:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:23:04.001417128Z [2024-04-28T02:23:04.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:23:00+00:00, run_after=2024-04-28T02:24:00+00:00 2024-04-28T02:23:04.011141382Z [2024-04-28T02:23:04.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:23:04.011463264Z [2024-04-28T02:23:04.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:22:00+00:00, run_id=scheduled__2024-04-28T02:22:00+00:00, run_start_date=2024-04-28 02:23:00.155457+00:00, run_end_date=2024-04-28 02:23:04.011027+00:00, run_duration=3.85557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:22:00+00:00, data_interval_end=2024-04-28 02:23:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:23:04.022737937Z [2024-04-28T02:23:04.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:23:00+00:00, run_after=2024-04-28T02:24:00+00:00 2024-04-28T02:23:04.060890915Z [2024-04-28T02:23:04.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status success for try_number 1 2024-04-28T02:23:04.072033528Z [2024-04-28T02:23:04.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:22:00+00:00, map_index=-1, run_start_date=2024-04-28 02:23:02.055993+00:00, run_end_date=2024-04-28 02:23:03.306102+00:00, run_duration=1.250109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:23:00.230944+00:00, queued_by_job_id=1, pid=4244 2024-04-28T02:23:05.171430144Z [2024-04-28T02:23:05.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status success for try_number 1 2024-04-28T02:23:05.176683370Z [2024-04-28T02:23:05.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:22:00+00:00, map_index=-1, run_start_date=2024-04-28 02:23:02.301110+00:00, run_end_date=2024-04-28 02:23:03.935062+00:00, run_duration=1.633952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:23:00.230944+00:00, queued_by_job_id=1, pid=4254 2024-04-28T02:24:00.341728679Z [2024-04-28T02:24:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:24:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:24:00.358251515Z [2024-04-28T02:24:00.357+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:24:00.376481987Z [2024-04-28T02:24:00.375+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:24:00.408019738Z [2024-04-28T02:24:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 to 2024-04-28T02:24:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:24:00.555542163Z [2024-04-28T02:24:00.555+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:24:00.555580168Z 2024-04-28T02:24:00.555584756Z 2024-04-28T02:24:00.555588277Z 2024-04-28T02:24:00.555591641Z 2024-04-28T02:24:00.555814758Z [2024-04-28T02:24:00.555+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:24:00.556015187Z [2024-04-28T02:24:00.555+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:24:00.556207288Z [2024-04-28T02:24:00.556+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:24:00.556386118Z [2024-04-28T02:24:00.556+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 has 0/16 running and queued tasks 2024-04-28T02:24:00.557156642Z [2024-04-28T02:24:00.556+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:24:00.557161019Z 2024-04-28T02:24:00.557164334Z 2024-04-28T02:24:00.557167460Z 2024-04-28T02:24:00.557170631Z 2024-04-28T02:24:00.562012254Z [2024-04-28T02:24:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:24:00.562192452Z [2024-04-28T02:24:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:24:00.562611452Z [2024-04-28T02:24:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:24:00.562788321Z [2024-04-28T02:24:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:24:00.563095310Z [2024-04-28T02:24:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:24:00.563280305Z [2024-04-28T02:24:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:24:00.563555001Z [2024-04-28T02:24:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:24:00.563748927Z [2024-04-28T02:24:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-28T02:24:00.868597526Z [2024-04-28T02:24:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status queued for try_number 1 2024-04-28T02:24:00.868922173Z [2024-04-28T02:24:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status queued for try_number 1 2024-04-28T02:24:00.869050749Z [2024-04-28T02:24:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status queued for try_number 1 2024-04-28T02:24:00.869257981Z [2024-04-28T02:24:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status queued for try_number 1 2024-04-28T02:24:00.880290544Z [2024-04-28T02:24:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa12b004-5870-4e54-904e-5adaef5589a3 2024-04-28T02:24:00.880657241Z [2024-04-28T02:24:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32803e5c-1559-4ea2-a468-08c512e14aa9 2024-04-28T02:24:00.880857219Z [2024-04-28T02:24:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78f3f5b4-2ab8-4070-b80e-77509b171749 2024-04-28T02:24:00.881031035Z [2024-04-28T02:24:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5df5cac4-e3c7-4089-af25-fe61ec6d0698 2024-04-28T02:24:01.612207706Z [2024-04-28T02:24:01.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status failed for try_number 1 2024-04-28T02:24:01.622958916Z [2024-04-28T02:24:01.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:23:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:24:00.558474+00:00, queued_by_job_id=1, pid=None 2024-04-28T02:24:01.623783045Z [2024-04-28T02:24:01.623+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:24:01.627023929Z [2024-04-28T02:24:01.626+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:24:01.643514884Z [2024-04-28T02:24:01.643+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240428T022300, start_date=, end_date=20240428T022401 2024-04-28T02:24:02.740808516Z [2024-04-28T02:24:02.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:24:02.741009755Z [2024-04-28T02:24:02.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:22:00+00:00, run_id=scheduled__2024-04-28T02:22:00+00:00, run_start_date=2024-04-28 02:24:00.431164+00:00, run_end_date=2024-04-28 02:24:02.740703+00:00, run_duration=2.309539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:22:00+00:00, data_interval_end=2024-04-28 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:24:02.751730783Z [2024-04-28T02:24:02.751+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:24:00+00:00, run_after=2024-04-28T02:26:00+00:00 2024-04-28T02:24:02.919466323Z [2024-04-28T02:24:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:22:00+00:00 exited with status success for try_number 1 2024-04-28T02:24:02.933999368Z [2024-04-28T02:24:02.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:22:00+00:00, map_index=-1, run_start_date=2024-04-28 02:24:01.365620+00:00, run_end_date=2024-04-28 02:24:01.833597+00:00, run_duration=0.467977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:24:00.558474+00:00, queued_by_job_id=1, pid=4280 2024-04-28T02:24:05.093020993Z [2024-04-28T02:24:05.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:24:05.093580492Z [2024-04-28T02:24:05.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:23:00+00:00, run_id=scheduled__2024-04-28T02:23:00+00:00, run_start_date=2024-04-28 02:24:00.435585+00:00, run_end_date=2024-04-28 02:24:05.093216+00:00, run_duration=4.657631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:23:00+00:00, data_interval_end=2024-04-28 02:24:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:24:05.103213556Z [2024-04-28T02:24:05.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:24:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:24:05.109906777Z [2024-04-28T02:24:05.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:24:05.110313221Z [2024-04-28T02:24:05.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:23:00+00:00, run_id=scheduled__2024-04-28T02:23:00+00:00, run_start_date=2024-04-28 02:24:00.437329+00:00, run_end_date=2024-04-28 02:24:05.110007+00:00, run_duration=4.672678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:23:00+00:00, data_interval_end=2024-04-28 02:24:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:24:05.119298586Z [2024-04-28T02:24:05.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:24:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:24:05.201475608Z [2024-04-28T02:24:05.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status success for try_number 1 2024-04-28T02:24:05.201618362Z [2024-04-28T02:24:05.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status success for try_number 1 2024-04-28T02:24:05.213364283Z [2024-04-28T02:24:05.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:23:00+00:00, map_index=-1, run_start_date=2024-04-28 02:24:02.667118+00:00, run_end_date=2024-04-28 02:24:04.195195+00:00, run_duration=1.528077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:24:00.558474+00:00, queued_by_job_id=1, pid=4336 2024-04-28T02:24:05.213961640Z [2024-04-28T02:24:05.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:23:00+00:00, map_index=-1, run_start_date=2024-04-28 02:24:02.695082+00:00, run_end_date=2024-04-28 02:24:04.483065+00:00, run_duration=1.787983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:24:00.558474+00:00, queued_by_job_id=1, pid=4337 2024-04-28T02:24:11.819966421Z [2024-04-28T02:24:11.819+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:24:11.820008102Z 2024-04-28T02:24:11.820158312Z [2024-04-28T02:24:11.819+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 has 0/16 running and queued tasks 2024-04-28T02:24:11.820903364Z [2024-04-28T02:24:11.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:24:11.820967177Z 2024-04-28T02:24:11.823846925Z [2024-04-28T02:24:11.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:23:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:24:11.824986632Z [2024-04-28T02:24:11.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-28T02:24:11.900053036Z [2024-04-28T02:24:11.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status queued for try_number 2 2024-04-28T02:24:11.909094212Z [2024-04-28T02:24:11.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea69b10f-efa3-4ca4-841f-639daeb14da0 2024-04-28T02:24:13.084133202Z [2024-04-28T02:24:13.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:23:00+00:00 exited with status failed for try_number 2 2024-04-28T02:24:13.092977853Z [2024-04-28T02:24:13.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:23:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 02:24:01.630061+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:24:11.821609+00:00, queued_by_job_id=1, pid=None 2024-04-28T02:24:13.093675774Z [2024-04-28T02:24:13.093+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:24:13.096357171Z [2024-04-28T02:24:13.096+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:24:13.113035402Z [2024-04-28T02:24:13.112+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240428T022300, start_date=, end_date=20240428T022413 2024-04-28T02:24:14.174026157Z [2024-04-28T02:24:14.173+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T02:24:14.174486587Z [2024-04-28T02:24:14.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719, execution_date=2024-04-28 02:23:00+00:00, run_id=scheduled__2024-04-28T02:23:00+00:00, run_start_date=2024-04-28 02:24:00.433382+00:00, run_end_date=2024-04-28 02:24:14.173838+00:00, run_duration=13.740456, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:23:00+00:00, data_interval_end=2024-04-28 02:24:00+00:00, dag_hash=b892e9cb2e9b8dc95dd1bfdd52dd4d78 2024-04-28T02:24:14.185183446Z [2024-04-28T02:24:14.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e3a23868-2924-4b68-afcd-aa1de818c719 to 2024-04-28T02:24:00+00:00, run_after=2024-04-28T02:25:00+00:00 2024-04-28T02:25:00.714544973Z [2024-04-28T02:25:00.714+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:25:00.724928287Z [2024-04-28T02:25:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:25:00+00:00, run_after=2024-04-28T02:30:00+00:00 2024-04-28T02:25:00.736852316Z [2024-04-28T02:25:00.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:25:00+00:00, run_after=2024-04-28T02:26:00+00:00 2024-04-28T02:25:00.805857039Z [2024-04-28T02:25:00.805+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:25:00.805888734Z 2024-04-28T02:25:00.805896750Z 2024-04-28T02:25:00.805917413Z 2024-04-28T02:25:00.805959467Z [2024-04-28T02:25:00.805+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:25:00.806275322Z [2024-04-28T02:25:00.806+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:25:00.806362679Z [2024-04-28T02:25:00.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:25:00.807068477Z [2024-04-28T02:25:00.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:25:00.807084284Z 2024-04-28T02:25:00.807088836Z 2024-04-28T02:25:00.807092510Z 2024-04-28T02:25:00.810663443Z [2024-04-28T02:25:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:25:00.810926884Z [2024-04-28T02:25:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:25:00.811263618Z [2024-04-28T02:25:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:25:00.811493048Z [2024-04-28T02:25:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:25:00.811883292Z [2024-04-28T02:25:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:25:00.812109670Z [2024-04-28T02:25:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:25:01.037646931Z [2024-04-28T02:25:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:25:01.037688999Z [2024-04-28T02:25:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:24:00+00:00 exited with status queued for try_number 1 2024-04-28T02:25:01.037749490Z [2024-04-28T02:25:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:24:00+00:00 exited with status queued for try_number 1 2024-04-28T02:25:01.045438931Z [2024-04-28T02:25:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0914889e-17a6-4685-8222-8563718a6a4d 2024-04-28T02:25:01.045610663Z [2024-04-28T02:25:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to f24f0389-6c12-4aba-a9a5-299c5f311a48 2024-04-28T02:25:01.045726517Z [2024-04-28T02:25:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c4cf470-996f-4a64-b7f8-1058be0be7ee 2024-04-28T02:25:03.883348377Z [2024-04-28T02:25:03.882+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:25:03.883376944Z 2024-04-28T02:25:03.883387469Z [2024-04-28T02:25:03.883+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:25:03.883861639Z [2024-04-28T02:25:03.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:25:03.883872232Z 2024-04-28T02:25:03.888240197Z [2024-04-28T02:25:03.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:25:03.888296275Z [2024-04-28T02:25:03.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:25:03.969981763Z [2024-04-28T02:25:03.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:25:03.970646304Z [2024-04-28T02:25:03.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:25:03.981512288Z [2024-04-28T02:25:03.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to afafee82-d1ce-4ae9-ba36-8b75a1caad29 2024-04-28T02:25:03.982018131Z [2024-04-28T02:25:03.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=-1, run_start_date=2024-04-28 02:25:02.733170+00:00, run_end_date=2024-04-28 02:25:03.291726+00:00, run_duration=0.558556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:25:00.807856+00:00, queued_by_job_id=1, pid=4412 2024-04-28T02:25:05.128562006Z [2024-04-28T02:25:05.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:25:05.131539453Z [2024-04-28T02:25:05.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:24:00+00:00, run_id=scheduled__2024-04-28T02:24:00+00:00, run_start_date=2024-04-28 02:25:00.750941+00:00, run_end_date=2024-04-28 02:25:05.131038+00:00, run_duration=4.380097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:24:00+00:00, data_interval_end=2024-04-28 02:25:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:25:05.145359154Z [2024-04-28T02:25:05.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:25:00+00:00, run_after=2024-04-28T02:26:00+00:00 2024-04-28T02:25:05.152457382Z [2024-04-28T02:25:05.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:25:05.152844946Z [2024-04-28T02:25:05.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:24:00+00:00, run_id=scheduled__2024-04-28T02:24:00+00:00, run_start_date=2024-04-28 02:25:00.749802+00:00, run_end_date=2024-04-28 02:25:05.152526+00:00, run_duration=4.402724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:24:00+00:00, data_interval_end=2024-04-28 02:25:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:25:05.163156207Z [2024-04-28T02:25:05.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:25:00+00:00, run_after=2024-04-28T02:26:00+00:00 2024-04-28T02:25:05.207796141Z [2024-04-28T02:25:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:24:00+00:00 exited with status success for try_number 1 2024-04-28T02:25:05.207973417Z [2024-04-28T02:25:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:24:00+00:00 exited with status success for try_number 1 2024-04-28T02:25:05.214121243Z [2024-04-28T02:25:05.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:24:00+00:00, map_index=-1, run_start_date=2024-04-28 02:25:02.765219+00:00, run_end_date=2024-04-28 02:25:04.702998+00:00, run_duration=1.937779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:25:00.807856+00:00, queued_by_job_id=1, pid=4413 2024-04-28T02:25:05.214648594Z [2024-04-28T02:25:05.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:24:00+00:00, map_index=-1, run_start_date=2024-04-28 02:25:03.161731+00:00, run_end_date=2024-04-28 02:25:04.687400+00:00, run_duration=1.525669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:25:00.807856+00:00, queued_by_job_id=1, pid=4432 2024-04-28T02:25:07.493592707Z [2024-04-28T02:25:07.493+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:25:07.493630626Z 2024-04-28T02:25:07.493809719Z [2024-04-28T02:25:07.493+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:25:07.494566780Z [2024-04-28T02:25:07.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:25:07.494579249Z 2024-04-28T02:25:07.496908606Z [2024-04-28T02:25:07.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:25:07.497216696Z [2024-04-28T02:25:07.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:25:07.548979684Z [2024-04-28T02:25:07.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:25:07.549110828Z [2024-04-28T02:25:07.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:25:07.555700765Z [2024-04-28T02:25:07.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ff5948-c9b4-4645-8508-9dedff1ec23c 2024-04-28T02:25:07.555926680Z [2024-04-28T02:25:07.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=-1, run_start_date=2024-04-28 02:25:06.345575+00:00, run_end_date=2024-04-28 02:25:06.852032+00:00, run_duration=0.506457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:25:03.884136+00:00, queued_by_job_id=1, pid=4465 2024-04-28T02:25:09.731702663Z [2024-04-28T02:25:09.731+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:25:09.731726976Z 2024-04-28T02:25:09.731975581Z [2024-04-28T02:25:09.731+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:25:09.732636756Z [2024-04-28T02:25:09.732+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:25:09.732665469Z 2024-04-28T02:25:09.736053806Z [2024-04-28T02:25:09.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:25:09.736348804Z [2024-04-28T02:25:09.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:25:09.792455351Z [2024-04-28T02:25:09.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status queued for try_number 1 2024-04-28T02:25:09.802710518Z [2024-04-28T02:25:09.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22b14870-4070-4497-b14c-5b42b9133a29 2024-04-28T02:25:09.909890406Z [2024-04-28T02:25:09.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:25:09.916891577Z [2024-04-28T02:25:09.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=0, run_start_date=2024-04-28 02:25:09.198915+00:00, run_end_date=2024-04-28 02:25:09.611907+00:00, run_duration=0.412992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:25:07.494950+00:00, queued_by_job_id=1, pid=4477 2024-04-28T02:25:12.078102415Z [2024-04-28T02:25:12.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:25:12.078922869Z [2024-04-28T02:25:12.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:20:00+00:00, run_id=scheduled__2024-04-28T02:20:00+00:00, run_start_date=2024-04-28 02:25:00.748662+00:00, run_end_date=2024-04-28 02:25:12.077927+00:00, run_duration=11.329265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:20:00+00:00, data_interval_end=2024-04-28 02:25:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:25:12.096046238Z [2024-04-28T02:25:12.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:25:00+00:00, run_after=2024-04-28T02:30:00+00:00 2024-04-28T02:25:12.143293525Z [2024-04-28T02:25:12.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:20:00+00:00 exited with status success for try_number 1 2024-04-28T02:25:12.149033061Z [2024-04-28T02:25:12.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:20:00+00:00, map_index=-1, run_start_date=2024-04-28 02:25:11.428678+00:00, run_end_date=2024-04-28 02:25:11.739318+00:00, run_duration=0.31064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:25:09.733785+00:00, queued_by_job_id=1, pid=4489 2024-04-28T02:26:00.110431770Z [2024-04-28T02:26:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:26:00+00:00, run_after=2024-04-28T02:27:00+00:00 2024-04-28T02:26:00.117909629Z [2024-04-28T02:26:00.117+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:26:00.127231086Z [2024-04-28T02:26:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:26:00.196347277Z [2024-04-28T02:26:00.196+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:26:00.196368668Z 2024-04-28T02:26:00.196382158Z 2024-04-28T02:26:00.196385799Z 2024-04-28T02:26:00.196395403Z [2024-04-28T02:26:00.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:26:00.196473957Z [2024-04-28T02:26:00.196+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:26:00.196552915Z [2024-04-28T02:26:00.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:26:00.197099465Z [2024-04-28T02:26:00.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:26:00.197112308Z 2024-04-28T02:26:00.197117898Z 2024-04-28T02:26:00.197124070Z 2024-04-28T02:26:00.199897393Z [2024-04-28T02:26:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:26:00.200018611Z [2024-04-28T02:26:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:26:00.200206390Z [2024-04-28T02:26:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:26:00.200278124Z [2024-04-28T02:26:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:26:00.200434860Z [2024-04-28T02:26:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:26:00.200506465Z [2024-04-28T02:26:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:26:00.485628716Z [2024-04-28T02:26:00.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:24:00+00:00 exited with status queued for try_number 1 2024-04-28T02:26:00.485897818Z [2024-04-28T02:26:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status queued for try_number 1 2024-04-28T02:26:00.486142039Z [2024-04-28T02:26:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status queued for try_number 1 2024-04-28T02:26:00.495921291Z [2024-04-28T02:26:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 105d24ce-e345-46af-9ddf-b49400ba626f 2024-04-28T02:26:00.496292658Z [2024-04-28T02:26:00.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 962e69f9-a79b-4600-8810-92f26dfde59c 2024-04-28T02:26:00.496773647Z [2024-04-28T02:26:00.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a8bf7de-99d0-4392-be49-ff68b7c76acb 2024-04-28T02:26:02.513188823Z [2024-04-28T02:26:02.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:26:02.514279314Z [2024-04-28T02:26:02.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:24:00+00:00, run_id=scheduled__2024-04-28T02:24:00+00:00, run_start_date=2024-04-28 02:26:00.144706+00:00, run_end_date=2024-04-28 02:26:02.513149+00:00, run_duration=2.368443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:24:00+00:00, data_interval_end=2024-04-28 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:26:02.524535200Z [2024-04-28T02:26:02.524+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:26:00+00:00, run_after=2024-04-28T02:28:00+00:00 2024-04-28T02:26:02.575681455Z [2024-04-28T02:26:02.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:24:00+00:00 exited with status success for try_number 1 2024-04-28T02:26:02.581075194Z [2024-04-28T02:26:02.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:24:00+00:00, map_index=-1, run_start_date=2024-04-28 02:26:01.025307+00:00, run_end_date=2024-04-28 02:26:01.440217+00:00, run_duration=0.41491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:26:00.197695+00:00, queued_by_job_id=1, pid=4493 2024-04-28T02:26:03.604982084Z [2024-04-28T02:26:03.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:26:03.605477111Z [2024-04-28T02:26:03.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:25:00+00:00, run_id=scheduled__2024-04-28T02:25:00+00:00, run_start_date=2024-04-28 02:26:00.146271+00:00, run_end_date=2024-04-28 02:26:03.604749+00:00, run_duration=3.458478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:25:00+00:00, data_interval_end=2024-04-28 02:26:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:26:03.617992664Z [2024-04-28T02:26:03.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:26:00+00:00, run_after=2024-04-28T02:27:00+00:00 2024-04-28T02:26:03.661555725Z [2024-04-28T02:26:03.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status success for try_number 1 2024-04-28T02:26:03.666933487Z [2024-04-28T02:26:03.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:25:00+00:00, map_index=-1, run_start_date=2024-04-28 02:26:02.149174+00:00, run_end_date=2024-04-28 02:26:03.418352+00:00, run_duration=1.269178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:26:00.197695+00:00, queued_by_job_id=1, pid=4535 2024-04-28T02:26:04.762480427Z [2024-04-28T02:26:04.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:26:04.762730962Z [2024-04-28T02:26:04.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:25:00+00:00, run_id=scheduled__2024-04-28T02:25:00+00:00, run_start_date=2024-04-28 02:26:00.148728+00:00, run_end_date=2024-04-28 02:26:04.762404+00:00, run_duration=4.613676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:25:00+00:00, data_interval_end=2024-04-28 02:26:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:26:04.775413403Z [2024-04-28T02:26:04.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:26:00+00:00, run_after=2024-04-28T02:27:00+00:00 2024-04-28T02:26:04.815528313Z [2024-04-28T02:26:04.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status success for try_number 1 2024-04-28T02:26:04.821038786Z [2024-04-28T02:26:04.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:25:00+00:00, map_index=-1, run_start_date=2024-04-28 02:26:02.085929+00:00, run_end_date=2024-04-28 02:26:03.674654+00:00, run_duration=1.588725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:26:00.197695+00:00, queued_by_job_id=1, pid=4534 2024-04-28T02:26:16.081287518Z [2024-04-28T02:26:16.080+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:27:00.559727119Z [2024-04-28T02:27:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:27:00+00:00, run_after=2024-04-28T02:28:00+00:00 2024-04-28T02:27:00.567131264Z [2024-04-28T02:27:00.566+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:27:00.631919497Z [2024-04-28T02:27:00.631+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:27:00.631944547Z 2024-04-28T02:27:00.631948761Z 2024-04-28T02:27:00.632150360Z [2024-04-28T02:27:00.631+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:27:00.632344389Z [2024-04-28T02:27:00.632+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:27:00.633098138Z [2024-04-28T02:27:00.632+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:27:00.633107985Z 2024-04-28T02:27:00.633111780Z 2024-04-28T02:27:00.637187351Z [2024-04-28T02:27:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:27:00.637504393Z [2024-04-28T02:27:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:27:00.637973255Z [2024-04-28T02:27:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:27:00.638194649Z [2024-04-28T02:27:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:27:00.851542419Z [2024-04-28T02:27:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:26:00+00:00 exited with status queued for try_number 1 2024-04-28T02:27:00.851579761Z [2024-04-28T02:27:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:26:00+00:00 exited with status queued for try_number 1 2024-04-28T02:27:00.862765090Z [2024-04-28T02:27:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to efea9a24-c188-4c85-8278-0c2e38c42e7e 2024-04-28T02:27:00.863293087Z [2024-04-28T02:27:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1db4a9b8-d611-4c46-b8a1-14b34d724b89 2024-04-28T02:27:03.876490146Z [2024-04-28T02:27:03.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:27:03.876928223Z [2024-04-28T02:27:03.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:26:00+00:00, run_id=scheduled__2024-04-28T02:26:00+00:00, run_start_date=2024-04-28 02:27:00.576242+00:00, run_end_date=2024-04-28 02:27:03.876558+00:00, run_duration=3.300316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:26:00+00:00, data_interval_end=2024-04-28 02:27:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:27:03.885770092Z [2024-04-28T02:27:03.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:27:00+00:00, run_after=2024-04-28T02:28:00+00:00 2024-04-28T02:27:03.920218189Z [2024-04-28T02:27:03.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:26:00+00:00 exited with status success for try_number 1 2024-04-28T02:27:03.924312767Z [2024-04-28T02:27:03.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:26:00+00:00, map_index=-1, run_start_date=2024-04-28 02:27:02.350782+00:00, run_end_date=2024-04-28 02:27:03.737340+00:00, run_duration=1.386558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:27:00.633927+00:00, queued_by_job_id=1, pid=4590 2024-04-28T02:27:05.667847611Z [2024-04-28T02:27:05.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:27:05.668027494Z [2024-04-28T02:27:05.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:26:00+00:00, run_id=scheduled__2024-04-28T02:26:00+00:00, run_start_date=2024-04-28 02:27:00.577417+00:00, run_end_date=2024-04-28 02:27:05.667797+00:00, run_duration=5.09038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:26:00+00:00, data_interval_end=2024-04-28 02:27:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:27:05.678922877Z [2024-04-28T02:27:05.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:27:00+00:00, run_after=2024-04-28T02:28:00+00:00 2024-04-28T02:27:05.715011466Z [2024-04-28T02:27:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:26:00+00:00 exited with status success for try_number 1 2024-04-28T02:27:05.726123408Z [2024-04-28T02:27:05.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:26:00+00:00, map_index=-1, run_start_date=2024-04-28 02:27:02.418824+00:00, run_end_date=2024-04-28 02:27:04.583277+00:00, run_duration=2.164453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:27:00.633927+00:00, queued_by_job_id=1, pid=4591 2024-04-28T02:28:00.414311534Z [2024-04-28T02:28:00.413+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:28:00.426269960Z [2024-04-28T02:28:00.425+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:28:00.445751199Z [2024-04-28T02:28:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:28:00+00:00, run_after=2024-04-28T02:29:00+00:00 2024-04-28T02:28:00.530363195Z [2024-04-28T02:28:00.529+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:28:00.530476838Z 2024-04-28T02:28:00.530488771Z 2024-04-28T02:28:00.530497636Z 2024-04-28T02:28:00.530529616Z [2024-04-28T02:28:00.530+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:28:00.531048102Z [2024-04-28T02:28:00.530+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:28:00.531118117Z [2024-04-28T02:28:00.530+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:28:00.532044219Z [2024-04-28T02:28:00.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:28:00.532065063Z 2024-04-28T02:28:00.532075567Z 2024-04-28T02:28:00.532084835Z 2024-04-28T02:28:00.537215307Z [2024-04-28T02:28:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:28:00.537246706Z [2024-04-28T02:28:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:28:00.537555663Z [2024-04-28T02:28:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:28:00.537639694Z [2024-04-28T02:28:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:28:00.537937083Z [2024-04-28T02:28:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:28:00.538014322Z [2024-04-28T02:28:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:28:00.829232927Z [2024-04-28T02:28:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:26:00+00:00 exited with status queued for try_number 1 2024-04-28T02:28:00.829393015Z [2024-04-28T02:28:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:27:00+00:00 exited with status queued for try_number 1 2024-04-28T02:28:00.829565502Z [2024-04-28T02:28:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:27:00+00:00 exited with status queued for try_number 1 2024-04-28T02:28:00.838799967Z [2024-04-28T02:28:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9f00bde-8bba-4160-b145-b42c351ffee1 2024-04-28T02:28:00.838917995Z [2024-04-28T02:28:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45fbe0ba-aa81-49d9-acc7-5d890cb8e8cc 2024-04-28T02:28:00.839096622Z [2024-04-28T02:28:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to be813032-ca7f-4c10-b0b3-925b7a159f30 2024-04-28T02:28:01.977683813Z [2024-04-28T02:28:01.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:28:01.978170052Z [2024-04-28T02:28:01.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:26:00+00:00, run_id=scheduled__2024-04-28T02:26:00+00:00, run_start_date=2024-04-28 02:28:00.464631+00:00, run_end_date=2024-04-28 02:28:01.977620+00:00, run_duration=1.512989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:26:00+00:00, data_interval_end=2024-04-28 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:28:01.992823403Z [2024-04-28T02:28:01.992+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:28:00+00:00, run_after=2024-04-28T02:30:00+00:00 2024-04-28T02:28:03.197604650Z [2024-04-28T02:28:03.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:26:00+00:00 exited with status success for try_number 1 2024-04-28T02:28:03.203744659Z [2024-04-28T02:28:03.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:26:00+00:00, map_index=-1, run_start_date=2024-04-28 02:28:01.421716+00:00, run_end_date=2024-04-28 02:28:01.887004+00:00, run_duration=0.465288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:28:00.533021+00:00, queued_by_job_id=1, pid=4616 2024-04-28T02:28:05.380577914Z [2024-04-28T02:28:05.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:28:05.380897798Z [2024-04-28T02:28:05.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:27:00+00:00, run_id=scheduled__2024-04-28T02:27:00+00:00, run_start_date=2024-04-28 02:28:00.468189+00:00, run_end_date=2024-04-28 02:28:05.380446+00:00, run_duration=4.912257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:27:00+00:00, data_interval_end=2024-04-28 02:28:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:28:05.389486660Z [2024-04-28T02:28:05.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:28:00+00:00, run_after=2024-04-28T02:29:00+00:00 2024-04-28T02:28:05.396037727Z [2024-04-28T02:28:05.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:28:05.396266876Z [2024-04-28T02:28:05.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:27:00+00:00, run_id=scheduled__2024-04-28T02:27:00+00:00, run_start_date=2024-04-28 02:28:00.466128+00:00, run_end_date=2024-04-28 02:28:05.395938+00:00, run_duration=4.92981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:27:00+00:00, data_interval_end=2024-04-28 02:28:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:28:05.406014147Z [2024-04-28T02:28:05.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:28:00+00:00, run_after=2024-04-28T02:29:00+00:00 2024-04-28T02:28:05.439918351Z [2024-04-28T02:28:05.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:27:00+00:00 exited with status success for try_number 1 2024-04-28T02:28:05.440158072Z [2024-04-28T02:28:05.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:27:00+00:00 exited with status success for try_number 1 2024-04-28T02:28:05.454006181Z [2024-04-28T02:28:05.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:27:00+00:00, map_index=-1, run_start_date=2024-04-28 02:28:02.757389+00:00, run_end_date=2024-04-28 02:28:04.800227+00:00, run_duration=2.042838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:28:00.533021+00:00, queued_by_job_id=1, pid=4656 2024-04-28T02:28:05.455211739Z [2024-04-28T02:28:05.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:27:00+00:00, map_index=-1, run_start_date=2024-04-28 02:28:02.663764+00:00, run_end_date=2024-04-28 02:28:04.342772+00:00, run_duration=1.679008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:28:00.533021+00:00, queued_by_job_id=1, pid=4655 2024-04-28T02:29:00.936599674Z [2024-04-28T02:29:00.935+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:29:00.962816257Z [2024-04-28T02:29:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:29:00+00:00, run_after=2024-04-28T02:30:00+00:00 2024-04-28T02:29:01.056893171Z [2024-04-28T02:29:01.056+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:29:01.056938496Z 2024-04-28T02:29:01.056945756Z 2024-04-28T02:29:01.057568475Z [2024-04-28T02:29:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:29:01.058756624Z [2024-04-28T02:29:01.058+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:29:01.060027956Z [2024-04-28T02:29:01.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:29:01.060078846Z 2024-04-28T02:29:01.060086591Z 2024-04-28T02:29:01.066241213Z [2024-04-28T02:29:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:29:01.067250940Z [2024-04-28T02:29:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:29:01.067824845Z [2024-04-28T02:29:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:29:01.068081828Z [2024-04-28T02:29:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:29:01.239705958Z [2024-04-28T02:29:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:28:00+00:00 exited with status queued for try_number 1 2024-04-28T02:29:01.240268517Z [2024-04-28T02:29:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:28:00+00:00 exited with status queued for try_number 1 2024-04-28T02:29:01.253128578Z [2024-04-28T02:29:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to a01ed9cd-22c4-4385-93fc-956f568135f4 2024-04-28T02:29:01.253551359Z [2024-04-28T02:29:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78a24354-9ee8-4e1d-bf4b-c26f2dfe84af 2024-04-28T02:29:04.499545785Z [2024-04-28T02:29:04.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:29:04.500116917Z [2024-04-28T02:29:04.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:28:00+00:00, run_id=scheduled__2024-04-28T02:28:00+00:00, run_start_date=2024-04-28 02:29:00.982077+00:00, run_end_date=2024-04-28 02:29:04.499733+00:00, run_duration=3.517656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:28:00+00:00, data_interval_end=2024-04-28 02:29:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:29:04.510323788Z [2024-04-28T02:29:04.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:29:00+00:00, run_after=2024-04-28T02:30:00+00:00 2024-04-28T02:29:05.610214363Z [2024-04-28T02:29:05.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:29:05.611712993Z [2024-04-28T02:29:05.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:28:00+00:00, run_id=scheduled__2024-04-28T02:28:00+00:00, run_start_date=2024-04-28 02:29:00.980241+00:00, run_end_date=2024-04-28 02:29:05.610285+00:00, run_duration=4.630044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:28:00+00:00, data_interval_end=2024-04-28 02:29:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:29:05.621813747Z [2024-04-28T02:29:05.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:29:00+00:00, run_after=2024-04-28T02:30:00+00:00 2024-04-28T02:29:05.700499886Z [2024-04-28T02:29:05.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:28:00+00:00 exited with status success for try_number 1 2024-04-28T02:29:05.700838063Z [2024-04-28T02:29:05.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:28:00+00:00 exited with status success for try_number 1 2024-04-28T02:29:05.711017669Z [2024-04-28T02:29:05.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:28:00+00:00, map_index=-1, run_start_date=2024-04-28 02:29:02.872277+00:00, run_end_date=2024-04-28 02:29:04.466191+00:00, run_duration=1.593914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:29:01.061469+00:00, queued_by_job_id=1, pid=4709 2024-04-28T02:29:05.711286161Z [2024-04-28T02:29:05.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:28:00+00:00, map_index=-1, run_start_date=2024-04-28 02:29:02.981273+00:00, run_end_date=2024-04-28 02:29:04.590063+00:00, run_duration=1.60879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:29:01.061469+00:00, queued_by_job_id=1, pid=4710 2024-04-28T02:30:00.834011778Z [2024-04-28T02:30:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:30:00.859031281Z [2024-04-28T02:30:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:30:00+00:00, run_after=2024-04-28T02:31:00+00:00 2024-04-28T02:30:00.881911412Z [2024-04-28T02:30:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:30:00+00:00, run_after=2024-04-28T02:35:00+00:00 2024-04-28T02:30:00.892107312Z [2024-04-28T02:30:00.891+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:30:01.010859335Z [2024-04-28T02:30:01.010+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:30:01.010948645Z 2024-04-28T02:30:01.010958686Z 2024-04-28T02:30:01.011074618Z 2024-04-28T02:30:01.011083659Z 2024-04-28T02:30:01.011223409Z [2024-04-28T02:30:01.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:30:01.011296588Z [2024-04-28T02:30:01.010+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:30:01.011304877Z [2024-04-28T02:30:01.011+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:30:01.011450036Z [2024-04-28T02:30:01.011+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:30:01.012594905Z [2024-04-28T02:30:01.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:30:01.012615405Z 2024-04-28T02:30:01.012682399Z 2024-04-28T02:30:01.012692072Z 2024-04-28T02:30:01.012699733Z 2024-04-28T02:30:01.018102607Z [2024-04-28T02:30:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:30:01.018174612Z [2024-04-28T02:30:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:30:01.018511975Z [2024-04-28T02:30:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:30:01.018532769Z [2024-04-28T02:30:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:30:01.018902252Z [2024-04-28T02:30:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:30:01.019114873Z [2024-04-28T02:30:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:30:01.019387722Z [2024-04-28T02:30:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:30:01.019400796Z [2024-04-28T02:30:01.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:30:01.439153737Z [2024-04-28T02:30:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:01.439212417Z [2024-04-28T02:30:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:28:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:01.439332256Z [2024-04-28T02:30:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:29:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:01.439341885Z [2024-04-28T02:30:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:29:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:01.454192499Z [2024-04-28T02:30:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b1eba6a-7a40-4a72-822a-7701f7788aea 2024-04-28T02:30:01.454289704Z [2024-04-28T02:30:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4910604-d077-47de-9d7b-eb78b1fe7484 2024-04-28T02:30:01.454365552Z [2024-04-28T02:30:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79bf5c65-527e-4ac2-a505-2a623611b102 2024-04-28T02:30:01.454548770Z [2024-04-28T02:30:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76c945ea-f5c5-4652-a231-8afb7dc65226 2024-04-28T02:30:03.824838501Z [2024-04-28T02:30:03.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:30:03.827386409Z [2024-04-28T02:30:03.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:28:00+00:00, run_id=scheduled__2024-04-28T02:28:00+00:00, run_start_date=2024-04-28 02:30:00.915352+00:00, run_end_date=2024-04-28 02:30:03.824751+00:00, run_duration=2.909399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:28:00+00:00, data_interval_end=2024-04-28 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:30:03.837979644Z [2024-04-28T02:30:03.835+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:30:00+00:00, run_after=2024-04-28T02:32:00+00:00 2024-04-28T02:30:03.921360359Z [2024-04-28T02:30:03.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:28:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:03.929626940Z [2024-04-28T02:30:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:28:00+00:00, map_index=-1, run_start_date=2024-04-28 02:30:02.262353+00:00, run_end_date=2024-04-28 02:30:02.740937+00:00, run_duration=0.478584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:01.013999+00:00, queued_by_job_id=1, pid=4746 2024-04-28T02:30:05.005994211Z [2024-04-28T02:30:05.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:30:05.008064949Z [2024-04-28T02:30:05.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:29:00+00:00, run_id=scheduled__2024-04-28T02:29:00+00:00, run_start_date=2024-04-28 02:30:00.918945+00:00, run_end_date=2024-04-28 02:30:05.005909+00:00, run_duration=4.086964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:29:00+00:00, data_interval_end=2024-04-28 02:30:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:30:05.024260713Z [2024-04-28T02:30:05.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:30:00+00:00, run_after=2024-04-28T02:31:00+00:00 2024-04-28T02:30:05.060752263Z [2024-04-28T02:30:05.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:30:05.060776296Z 2024-04-28T02:30:05.060786545Z [2024-04-28T02:30:05.060+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:30:05.061331489Z [2024-04-28T02:30:05.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:30:05.061345036Z 2024-04-28T02:30:05.066608627Z [2024-04-28T02:30:05.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:30:05.066663971Z [2024-04-28T02:30:05.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:30:05.163788662Z [2024-04-28T02:30:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:05.163835728Z [2024-04-28T02:30:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:05.163912573Z [2024-04-28T02:30:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:29:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:05.178448448Z [2024-04-28T02:30:05.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to d053c04d-1d50-4217-b379-a75281f4bd1f 2024-04-28T02:30:05.178602855Z [2024-04-28T02:30:05.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:25:00+00:00, map_index=-1, run_start_date=2024-04-28 02:30:03.853611+00:00, run_end_date=2024-04-28 02:30:04.391329+00:00, run_duration=0.537718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:01.013999+00:00, queued_by_job_id=1, pid=4796 2024-04-28T02:30:05.178745711Z [2024-04-28T02:30:05.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:29:00+00:00, map_index=-1, run_start_date=2024-04-28 02:30:03.500230+00:00, run_end_date=2024-04-28 02:30:04.837605+00:00, run_duration=1.337375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:01.013999+00:00, queued_by_job_id=1, pid=4770 2024-04-28T02:30:06.455052580Z [2024-04-28T02:30:06.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:30:06.455389834Z [2024-04-28T02:30:06.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:29:00+00:00, run_id=scheduled__2024-04-28T02:29:00+00:00, run_start_date=2024-04-28 02:30:00.922490+00:00, run_end_date=2024-04-28 02:30:06.454955+00:00, run_duration=5.532465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:29:00+00:00, data_interval_end=2024-04-28 02:30:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:30:06.464835574Z [2024-04-28T02:30:06.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:30:00+00:00, run_after=2024-04-28T02:31:00+00:00 2024-04-28T02:30:06.521513014Z [2024-04-28T02:30:06.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:29:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:06.529362578Z [2024-04-28T02:30:06.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:29:00+00:00, map_index=-1, run_start_date=2024-04-28 02:30:03.981575+00:00, run_end_date=2024-04-28 02:30:05.821618+00:00, run_duration=1.840043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:01.013999+00:00, queued_by_job_id=1, pid=4797 2024-04-28T02:30:07.838762823Z [2024-04-28T02:30:07.837+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:30:07.838797188Z 2024-04-28T02:30:07.839097087Z [2024-04-28T02:30:07.838+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:30:07.843466935Z [2024-04-28T02:30:07.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:30:07.843504143Z 2024-04-28T02:30:07.846865624Z [2024-04-28T02:30:07.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:30:07.847120328Z [2024-04-28T02:30:07.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:30:07.913974693Z [2024-04-28T02:30:07.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:07.914275518Z [2024-04-28T02:30:07.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:07.919862637Z [2024-04-28T02:30:07.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to abb681d0-db04-49f6-956e-72a656b1c35b 2024-04-28T02:30:07.920161878Z [2024-04-28T02:30:07.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:25:00+00:00, map_index=-1, run_start_date=2024-04-28 02:30:07.128619+00:00, run_end_date=2024-04-28 02:30:07.464358+00:00, run_duration=0.335739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:05.061689+00:00, queued_by_job_id=1, pid=4830 2024-04-28T02:30:10.174162297Z [2024-04-28T02:30:10.173+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:30:10.174188292Z 2024-04-28T02:30:10.174330098Z [2024-04-28T02:30:10.174+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:30:10.174952688Z [2024-04-28T02:30:10.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:30:10.174965068Z 2024-04-28T02:30:10.177076688Z [2024-04-28T02:30:10.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:30:10.177303395Z [2024-04-28T02:30:10.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:30:10.223003867Z [2024-04-28T02:30:10.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status queued for try_number 1 2024-04-28T02:30:10.223229394Z [2024-04-28T02:30:10.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:10.228989542Z [2024-04-28T02:30:10.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6e3f292-13c4-445e-97e6-27fa59fff2d7 2024-04-28T02:30:10.229272997Z [2024-04-28T02:30:10.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:25:00+00:00, map_index=0, run_start_date=2024-04-28 02:30:09.525816+00:00, run_end_date=2024-04-28 02:30:09.885498+00:00, run_duration=0.359682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:07.844130+00:00, queued_by_job_id=1, pid=4842 2024-04-28T02:30:12.407896535Z [2024-04-28T02:30:12.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:30:12.408032447Z [2024-04-28T02:30:12.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:25:00+00:00, run_id=scheduled__2024-04-28T02:25:00+00:00, run_start_date=2024-04-28 02:30:00.908719+00:00, run_end_date=2024-04-28 02:30:12.407786+00:00, run_duration=11.499067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:25:00+00:00, data_interval_end=2024-04-28 02:30:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:30:12.413780896Z [2024-04-28T02:30:12.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:30:00+00:00, run_after=2024-04-28T02:35:00+00:00 2024-04-28T02:30:12.437222677Z [2024-04-28T02:30:12.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:25:00+00:00 exited with status success for try_number 1 2024-04-28T02:30:12.441931501Z [2024-04-28T02:30:12.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:25:00+00:00, map_index=-1, run_start_date=2024-04-28 02:30:11.774099+00:00, run_end_date=2024-04-28 02:30:12.116922+00:00, run_duration=0.342823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:30:10.175335+00:00, queued_by_job_id=1, pid=4854 2024-04-28T02:31:00.758830829Z [2024-04-28T02:31:00.758+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:31:00.777574434Z [2024-04-28T02:31:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:31:00+00:00, run_after=2024-04-28T02:32:00+00:00 2024-04-28T02:31:00.851253212Z [2024-04-28T02:31:00.850+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:31:00.851285691Z 2024-04-28T02:31:00.851292309Z 2024-04-28T02:31:00.851803940Z [2024-04-28T02:31:00.851+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:31:00.852254675Z [2024-04-28T02:31:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:31:00.853643416Z [2024-04-28T02:31:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:31:00.853661473Z 2024-04-28T02:31:00.853668578Z 2024-04-28T02:31:00.858240521Z [2024-04-28T02:31:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:31:00.858689047Z [2024-04-28T02:31:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:31:00.859276120Z [2024-04-28T02:31:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:31:00.859644719Z [2024-04-28T02:31:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:31:01.059967226Z [2024-04-28T02:31:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:31:01.060138371Z [2024-04-28T02:31:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:31:01.067452970Z [2024-04-28T02:31:01.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to da6b8227-29b1-4cb5-b2e4-7aa068abde97 2024-04-28T02:31:01.067700850Z [2024-04-28T02:31:01.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8521b3b-6c06-4bf7-994b-e4530456b1c1 2024-04-28T02:31:04.788985445Z [2024-04-28T02:31:04.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:31:04.789458246Z [2024-04-28T02:31:04.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:30:00+00:00, run_id=scheduled__2024-04-28T02:30:00+00:00, run_start_date=2024-04-28 02:31:00.796622+00:00, run_end_date=2024-04-28 02:31:04.788864+00:00, run_duration=3.992242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:30:00+00:00, data_interval_end=2024-04-28 02:31:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:31:04.803572750Z [2024-04-28T02:31:04.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:31:00+00:00, run_after=2024-04-28T02:32:00+00:00 2024-04-28T02:31:04.846859852Z [2024-04-28T02:31:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:31:04.853720908Z [2024-04-28T02:31:04.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=-1, run_start_date=2024-04-28 02:31:02.740820+00:00, run_end_date=2024-04-28 02:31:04.313919+00:00, run_duration=1.573099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:31:00.855041+00:00, queued_by_job_id=1, pid=4887 2024-04-28T02:31:05.908610948Z [2024-04-28T02:31:05.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:31:05.908848608Z [2024-04-28T02:31:05.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:30:00+00:00, run_id=scheduled__2024-04-28T02:30:00+00:00, run_start_date=2024-04-28 02:31:00.798306+00:00, run_end_date=2024-04-28 02:31:05.908469+00:00, run_duration=5.110163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:30:00+00:00, data_interval_end=2024-04-28 02:31:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:31:05.919788394Z [2024-04-28T02:31:05.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:31:00+00:00, run_after=2024-04-28T02:32:00+00:00 2024-04-28T02:31:05.955281933Z [2024-04-28T02:31:05.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:31:05.963612244Z [2024-04-28T02:31:05.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=-1, run_start_date=2024-04-28 02:31:03.032177+00:00, run_end_date=2024-04-28 02:31:05.226184+00:00, run_duration=2.194007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:31:00.855041+00:00, queued_by_job_id=1, pid=4888 2024-04-28T02:31:16.151577064Z [2024-04-28T02:31:16.150+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:32:00.852042533Z [2024-04-28T02:32:00.851+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:32:00.858942623Z [2024-04-28T02:32:00.858+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:32:00.872584041Z [2024-04-28T02:32:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:32:00+00:00, run_after=2024-04-28T02:33:00+00:00 2024-04-28T02:32:00.960936381Z [2024-04-28T02:32:00.960+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:32:00.960963201Z 2024-04-28T02:32:00.960967915Z 2024-04-28T02:32:00.960971954Z 2024-04-28T02:32:00.961164815Z [2024-04-28T02:32:00.960+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:32:00.961449393Z [2024-04-28T02:32:00.961+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:32:00.961795808Z [2024-04-28T02:32:00.961+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:32:00.962942088Z [2024-04-28T02:32:00.962+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:32:00.962951281Z 2024-04-28T02:32:00.962955099Z 2024-04-28T02:32:00.962961747Z 2024-04-28T02:32:00.968854425Z [2024-04-28T02:32:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:32:00.968981387Z [2024-04-28T02:32:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:32:00.969378219Z [2024-04-28T02:32:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:32:00.969577511Z [2024-04-28T02:32:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:32:00.969856033Z [2024-04-28T02:32:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:32:00.970013715Z [2024-04-28T02:32:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:32:01.315578275Z [2024-04-28T02:32:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:32:01.316147730Z [2024-04-28T02:32:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:31:00+00:00 exited with status queued for try_number 1 2024-04-28T02:32:01.316886866Z [2024-04-28T02:32:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:31:00+00:00 exited with status queued for try_number 1 2024-04-28T02:32:01.342266541Z [2024-04-28T02:32:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a696255-408b-436e-b898-ff4aa9517e87 2024-04-28T02:32:01.343820494Z [2024-04-28T02:32:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b3825a7-a7eb-4c44-bebf-31c7fb1b57a3 2024-04-28T02:32:01.344137975Z [2024-04-28T02:32:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e4e1661-0ab4-4d70-87d7-48aeb2b79d8c 2024-04-28T02:32:02.548577897Z [2024-04-28T02:32:02.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:32:02.548963065Z [2024-04-28T02:32:02.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:30:00+00:00, run_id=scheduled__2024-04-28T02:30:00+00:00, run_start_date=2024-04-28 02:32:00.886167+00:00, run_end_date=2024-04-28 02:32:02.548492+00:00, run_duration=1.662325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:30:00+00:00, data_interval_end=2024-04-28 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:32:02.557900603Z [2024-04-28T02:32:02.557+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:32:00+00:00, run_after=2024-04-28T02:34:00+00:00 2024-04-28T02:32:02.613543648Z [2024-04-28T02:32:02.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:32:02.619744418Z [2024-04-28T02:32:02.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=-1, run_start_date=2024-04-28 02:32:01.880619+00:00, run_end_date=2024-04-28 02:32:02.281463+00:00, run_duration=0.400844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:32:00.964336+00:00, queued_by_job_id=1, pid=4923 2024-04-28T02:32:05.982116014Z [2024-04-28T02:32:05.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:32:05.982981675Z [2024-04-28T02:32:05.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:31:00+00:00, run_id=scheduled__2024-04-28T02:31:00+00:00, run_start_date=2024-04-28 02:32:00.887642+00:00, run_end_date=2024-04-28 02:32:05.981942+00:00, run_duration=5.0943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:31:00+00:00, data_interval_end=2024-04-28 02:32:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:32:05.994500778Z [2024-04-28T02:32:05.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:32:00+00:00, run_after=2024-04-28T02:33:00+00:00 2024-04-28T02:32:06.000975947Z [2024-04-28T02:32:06.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:32:06.003560155Z [2024-04-28T02:32:06.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:31:00+00:00, run_id=scheduled__2024-04-28T02:31:00+00:00, run_start_date=2024-04-28 02:32:00.888779+00:00, run_end_date=2024-04-28 02:32:06.000824+00:00, run_duration=5.112045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:31:00+00:00, data_interval_end=2024-04-28 02:32:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:32:06.013995149Z [2024-04-28T02:32:06.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:32:00+00:00, run_after=2024-04-28T02:33:00+00:00 2024-04-28T02:32:06.064088106Z [2024-04-28T02:32:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:31:00+00:00 exited with status success for try_number 1 2024-04-28T02:32:06.064278197Z [2024-04-28T02:32:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:31:00+00:00 exited with status success for try_number 1 2024-04-28T02:32:06.075540038Z [2024-04-28T02:32:06.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:31:00+00:00, map_index=-1, run_start_date=2024-04-28 02:32:03.055870+00:00, run_end_date=2024-04-28 02:32:05.167824+00:00, run_duration=2.111954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:32:00.964336+00:00, queued_by_job_id=1, pid=4953 2024-04-28T02:32:06.075977007Z [2024-04-28T02:32:06.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:31:00+00:00, map_index=-1, run_start_date=2024-04-28 02:32:03.194711+00:00, run_end_date=2024-04-28 02:32:05.512403+00:00, run_duration=2.317692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:32:00.964336+00:00, queued_by_job_id=1, pid=4954 2024-04-28T02:33:00.716930233Z [2024-04-28T02:33:00.716+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:33:00.734632545Z [2024-04-28T02:33:00.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:33:00+00:00, run_after=2024-04-28T02:34:00+00:00 2024-04-28T02:33:00.793926548Z [2024-04-28T02:33:00.793+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:33:00.793956044Z 2024-04-28T02:33:00.793960342Z 2024-04-28T02:33:00.794144330Z [2024-04-28T02:33:00.793+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:33:00.794328022Z [2024-04-28T02:33:00.794+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:33:00.795296637Z [2024-04-28T02:33:00.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:33:00.795322760Z 2024-04-28T02:33:00.795326523Z 2024-04-28T02:33:00.801345380Z [2024-04-28T02:33:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:33:00.801579500Z [2024-04-28T02:33:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:33:00.801828067Z [2024-04-28T02:33:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:33:00.801952002Z [2024-04-28T02:33:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:33:00.947067868Z [2024-04-28T02:33:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:32:00+00:00 exited with status queued for try_number 1 2024-04-28T02:33:00.947156251Z [2024-04-28T02:33:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:32:00+00:00 exited with status queued for try_number 1 2024-04-28T02:33:00.955991131Z [2024-04-28T02:33:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to e379deb6-5908-4d10-a4f4-cc5289535f8f 2024-04-28T02:33:00.956126337Z [2024-04-28T02:33:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 490f93b6-870b-4702-85f2-fc331fa90b5b 2024-04-28T02:33:04.857339541Z [2024-04-28T02:33:04.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:33:04.860455907Z [2024-04-28T02:33:04.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:32:00+00:00, run_id=scheduled__2024-04-28T02:32:00+00:00, run_start_date=2024-04-28 02:33:00.753156+00:00, run_end_date=2024-04-28 02:33:04.857257+00:00, run_duration=4.104101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:32:00+00:00, data_interval_end=2024-04-28 02:33:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:33:04.874258039Z [2024-04-28T02:33:04.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:33:00+00:00, run_after=2024-04-28T02:34:00+00:00 2024-04-28T02:33:04.948854684Z [2024-04-28T02:33:04.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:32:00+00:00 exited with status success for try_number 1 2024-04-28T02:33:04.972993203Z [2024-04-28T02:33:04.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:32:00+00:00, map_index=-1, run_start_date=2024-04-28 02:33:02.821868+00:00, run_end_date=2024-04-28 02:33:04.014888+00:00, run_duration=1.19302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:33:00.796330+00:00, queued_by_job_id=1, pid=5008 2024-04-28T02:33:06.025706343Z [2024-04-28T02:33:06.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:33:06.026116432Z [2024-04-28T02:33:06.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:32:00+00:00, run_id=scheduled__2024-04-28T02:32:00+00:00, run_start_date=2024-04-28 02:33:00.754801+00:00, run_end_date=2024-04-28 02:33:06.025623+00:00, run_duration=5.270822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:32:00+00:00, data_interval_end=2024-04-28 02:33:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:33:06.035642272Z [2024-04-28T02:33:06.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:33:00+00:00, run_after=2024-04-28T02:34:00+00:00 2024-04-28T02:33:06.061971567Z [2024-04-28T02:33:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:32:00+00:00 exited with status success for try_number 1 2024-04-28T02:33:06.068196548Z [2024-04-28T02:33:06.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:32:00+00:00, map_index=-1, run_start_date=2024-04-28 02:33:02.761309+00:00, run_end_date=2024-04-28 02:33:05.490627+00:00, run_duration=2.729318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:33:00.796330+00:00, queued_by_job_id=1, pid=5007 2024-04-28T02:34:00.963663061Z [2024-04-28T02:34:00.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:34:00+00:00, run_after=2024-04-28T02:35:00+00:00 2024-04-28T02:34:00.970030508Z [2024-04-28T02:34:00.969+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:34:00.976788623Z [2024-04-28T02:34:00.976+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:34:01.053950607Z [2024-04-28T02:34:01.053+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:34:01.053977810Z 2024-04-28T02:34:01.053983132Z 2024-04-28T02:34:01.054003597Z 2024-04-28T02:34:01.054327959Z [2024-04-28T02:34:01.054+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:34:01.055185385Z [2024-04-28T02:34:01.054+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:34:01.055552016Z [2024-04-28T02:34:01.055+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:34:01.056617266Z [2024-04-28T02:34:01.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:34:01.056645225Z 2024-04-28T02:34:01.056657479Z 2024-04-28T02:34:01.056663951Z 2024-04-28T02:34:01.061962597Z [2024-04-28T02:34:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:34:01.062748053Z [2024-04-28T02:34:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:34:01.063225425Z [2024-04-28T02:34:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:34:01.063589787Z [2024-04-28T02:34:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:34:01.064070798Z [2024-04-28T02:34:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:34:01.064348271Z [2024-04-28T02:34:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:34:01.291208038Z [2024-04-28T02:34:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:32:00+00:00 exited with status queued for try_number 1 2024-04-28T02:34:01.291244437Z [2024-04-28T02:34:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:33:00+00:00 exited with status queued for try_number 1 2024-04-28T02:34:01.291782801Z [2024-04-28T02:34:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:33:00+00:00 exited with status queued for try_number 1 2024-04-28T02:34:01.301784917Z [2024-04-28T02:34:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6360900-78a8-487a-bdd3-4f2613b31944 2024-04-28T02:34:01.302079372Z [2024-04-28T02:34:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67d83311-4d06-46a2-b979-1dfd6a9678cf 2024-04-28T02:34:01.302208692Z [2024-04-28T02:34:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f2d46eb-3aea-46ed-8f0c-042b4d42d4a7 2024-04-28T02:34:02.967483124Z [2024-04-28T02:34:02.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:34:02.967783854Z [2024-04-28T02:34:02.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:32:00+00:00, run_id=scheduled__2024-04-28T02:32:00+00:00, run_start_date=2024-04-28 02:34:00.986250+00:00, run_end_date=2024-04-28 02:34:02.967390+00:00, run_duration=1.98114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:32:00+00:00, data_interval_end=2024-04-28 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:34:02.975459417Z [2024-04-28T02:34:02.975+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:34:00+00:00, run_after=2024-04-28T02:36:00+00:00 2024-04-28T02:34:03.050278231Z [2024-04-28T02:34:03.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:32:00+00:00 exited with status success for try_number 1 2024-04-28T02:34:03.056491153Z [2024-04-28T02:34:03.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:32:00+00:00, map_index=-1, run_start_date=2024-04-28 02:34:01.797500+00:00, run_end_date=2024-04-28 02:34:02.231098+00:00, run_duration=0.433598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:34:01.058034+00:00, queued_by_job_id=1, pid=5040 2024-04-28T02:34:05.253922807Z [2024-04-28T02:34:05.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:34:05.254161473Z [2024-04-28T02:34:05.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:33:00+00:00, run_id=scheduled__2024-04-28T02:33:00+00:00, run_start_date=2024-04-28 02:34:00.987627+00:00, run_end_date=2024-04-28 02:34:05.253859+00:00, run_duration=4.266232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:33:00+00:00, data_interval_end=2024-04-28 02:34:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:34:05.268319465Z [2024-04-28T02:34:05.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:34:00+00:00, run_after=2024-04-28T02:35:00+00:00 2024-04-28T02:34:05.331318840Z [2024-04-28T02:34:05.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:33:00+00:00 exited with status success for try_number 1 2024-04-28T02:34:05.343988169Z [2024-04-28T02:34:05.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:33:00+00:00, map_index=-1, run_start_date=2024-04-28 02:34:03.144373+00:00, run_end_date=2024-04-28 02:34:05.021682+00:00, run_duration=1.877309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:34:01.058034+00:00, queued_by_job_id=1, pid=5074 2024-04-28T02:34:06.396002085Z [2024-04-28T02:34:06.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:34:06.396087011Z [2024-04-28T02:34:06.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:33:00+00:00, run_id=scheduled__2024-04-28T02:33:00+00:00, run_start_date=2024-04-28 02:34:00.988725+00:00, run_end_date=2024-04-28 02:34:06.395870+00:00, run_duration=5.407145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:33:00+00:00, data_interval_end=2024-04-28 02:34:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:34:06.406350805Z [2024-04-28T02:34:06.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:34:00+00:00, run_after=2024-04-28T02:35:00+00:00 2024-04-28T02:34:06.436035553Z [2024-04-28T02:34:06.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:33:00+00:00 exited with status success for try_number 1 2024-04-28T02:34:06.443645380Z [2024-04-28T02:34:06.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:33:00+00:00, map_index=-1, run_start_date=2024-04-28 02:34:03.111426+00:00, run_end_date=2024-04-28 02:34:05.405239+00:00, run_duration=2.293813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:34:01.058034+00:00, queued_by_job_id=1, pid=5073 2024-04-28T02:35:00.901791523Z [2024-04-28T02:35:00.901+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:35:00.918405386Z [2024-04-28T02:35:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:35:00+00:00, run_after=2024-04-28T02:40:00+00:00 2024-04-28T02:35:00.933625115Z [2024-04-28T02:35:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:35:00+00:00, run_after=2024-04-28T02:36:00+00:00 2024-04-28T02:35:01.005796607Z [2024-04-28T02:35:01.005+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:35:01.005837019Z 2024-04-28T02:35:01.005846749Z 2024-04-28T02:35:01.005873281Z 2024-04-28T02:35:01.006271372Z [2024-04-28T02:35:01.005+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:35:01.006796116Z [2024-04-28T02:35:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:35:01.007212238Z [2024-04-28T02:35:01.006+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:35:01.008491697Z [2024-04-28T02:35:01.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:35:01.008514787Z 2024-04-28T02:35:01.008521744Z 2024-04-28T02:35:01.008527610Z 2024-04-28T02:35:01.014073716Z [2024-04-28T02:35:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:35:01.014256709Z [2024-04-28T02:35:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:35:01.014558428Z [2024-04-28T02:35:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:35:01.014770650Z [2024-04-28T02:35:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:35:01.015171077Z [2024-04-28T02:35:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:35:01.015313218Z [2024-04-28T02:35:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:35:01.311856300Z [2024-04-28T02:35:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:35:01.312311383Z [2024-04-28T02:35:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:34:00+00:00 exited with status queued for try_number 1 2024-04-28T02:35:01.312484961Z [2024-04-28T02:35:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:34:00+00:00 exited with status queued for try_number 1 2024-04-28T02:35:01.321236052Z [2024-04-28T02:35:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to c29eb585-153b-45b5-b66c-baca7645b234 2024-04-28T02:35:01.321526123Z [2024-04-28T02:35:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to beb9bb31-3855-490a-8d36-b3f74f0835b7 2024-04-28T02:35:01.321743388Z [2024-04-28T02:35:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f52865f-3313-4b90-9806-0bbface78ff1 2024-04-28T02:35:04.112163452Z [2024-04-28T02:35:04.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:35:04.112193149Z 2024-04-28T02:35:04.112479450Z [2024-04-28T02:35:04.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:35:04.113250787Z [2024-04-28T02:35:04.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:35:04.113258811Z 2024-04-28T02:35:04.116583523Z [2024-04-28T02:35:04.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:35:04.116635048Z [2024-04-28T02:35:04.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:35:04.189301245Z [2024-04-28T02:35:04.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:35:04.189554524Z [2024-04-28T02:35:04.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:35:04.195366629Z [2024-04-28T02:35:04.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8acd0f42-9138-4851-a1b0-ebed669f1ff8 2024-04-28T02:35:04.195677895Z [2024-04-28T02:35:04.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=-1, run_start_date=2024-04-28 02:35:02.726490+00:00, run_end_date=2024-04-28 02:35:03.299398+00:00, run_duration=0.572908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:35:01.009937+00:00, queued_by_job_id=1, pid=5130 2024-04-28T02:35:05.595305660Z [2024-04-28T02:35:05.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:35:05.595581304Z [2024-04-28T02:35:05.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:34:00+00:00, run_id=scheduled__2024-04-28T02:34:00+00:00, run_start_date=2024-04-28 02:35:00.946061+00:00, run_end_date=2024-04-28 02:35:05.595230+00:00, run_duration=4.649169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:34:00+00:00, data_interval_end=2024-04-28 02:35:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:35:05.618530053Z [2024-04-28T02:35:05.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:35:00+00:00, run_after=2024-04-28T02:36:00+00:00 2024-04-28T02:35:05.629798038Z [2024-04-28T02:35:05.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:35:05.629821714Z [2024-04-28T02:35:05.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:34:00+00:00, run_id=scheduled__2024-04-28T02:34:00+00:00, run_start_date=2024-04-28 02:35:00.944920+00:00, run_end_date=2024-04-28 02:35:05.624762+00:00, run_duration=4.679842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:34:00+00:00, data_interval_end=2024-04-28 02:35:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:35:05.642856297Z [2024-04-28T02:35:05.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:35:00+00:00, run_after=2024-04-28T02:36:00+00:00 2024-04-28T02:35:05.726530976Z [2024-04-28T02:35:05.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:34:00+00:00 exited with status success for try_number 1 2024-04-28T02:35:05.726567894Z [2024-04-28T02:35:05.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:34:00+00:00 exited with status success for try_number 1 2024-04-28T02:35:05.742295788Z [2024-04-28T02:35:05.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:34:00+00:00, map_index=-1, run_start_date=2024-04-28 02:35:02.979344+00:00, run_end_date=2024-04-28 02:35:04.867111+00:00, run_duration=1.887767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:35:01.009937+00:00, queued_by_job_id=1, pid=5140 2024-04-28T02:35:05.742861743Z [2024-04-28T02:35:05.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:34:00+00:00, map_index=-1, run_start_date=2024-04-28 02:35:03.186445+00:00, run_end_date=2024-04-28 02:35:04.540880+00:00, run_duration=1.354435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:35:01.009937+00:00, queued_by_job_id=1, pid=5145 2024-04-28T02:35:07.995381902Z [2024-04-28T02:35:07.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:35:07.995456728Z 2024-04-28T02:35:07.995485635Z [2024-04-28T02:35:07.995+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:35:07.996588753Z [2024-04-28T02:35:07.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:35:07.996605571Z 2024-04-28T02:35:08.000644672Z [2024-04-28T02:35:08.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:35:08.000719969Z [2024-04-28T02:35:08.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:35:08.082917039Z [2024-04-28T02:35:08.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:35:08.082946765Z [2024-04-28T02:35:08.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:35:08.090710538Z [2024-04-28T02:35:08.090+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b46f509-020a-496e-9762-1231c649098f 2024-04-28T02:35:08.090814350Z [2024-04-28T02:35:08.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=-1, run_start_date=2024-04-28 02:35:06.849016+00:00, run_end_date=2024-04-28 02:35:07.246404+00:00, run_duration=0.397388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:35:04.113775+00:00, queued_by_job_id=1, pid=5183 2024-04-28T02:35:10.354836506Z [2024-04-28T02:35:10.354+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:35:10.354904071Z 2024-04-28T02:35:10.357037591Z [2024-04-28T02:35:10.354+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:35:10.357056514Z [2024-04-28T02:35:10.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:35:10.357074073Z 2024-04-28T02:35:10.358126126Z [2024-04-28T02:35:10.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:35:10.358328490Z [2024-04-28T02:35:10.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:35:10.410234919Z [2024-04-28T02:35:10.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status queued for try_number 1 2024-04-28T02:35:10.410607464Z [2024-04-28T02:35:10.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:35:10.417693010Z [2024-04-28T02:35:10.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 625d3672-9cd2-42bc-bc4b-17330601bf88 2024-04-28T02:35:10.418341392Z [2024-04-28T02:35:10.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=0, run_start_date=2024-04-28 02:35:09.560379+00:00, run_end_date=2024-04-28 02:35:09.949788+00:00, run_duration=0.389409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:35:07.997395+00:00, queued_by_job_id=1, pid=5195 2024-04-28T02:35:12.697512355Z [2024-04-28T02:35:12.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:35:12.698063575Z [2024-04-28T02:35:12.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:30:00+00:00, run_id=scheduled__2024-04-28T02:30:00+00:00, run_start_date=2024-04-28 02:35:00.943639+00:00, run_end_date=2024-04-28 02:35:12.697730+00:00, run_duration=11.754091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:30:00+00:00, data_interval_end=2024-04-28 02:35:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:35:12.705418780Z [2024-04-28T02:35:12.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:35:00+00:00, run_after=2024-04-28T02:40:00+00:00 2024-04-28T02:35:12.738849905Z [2024-04-28T02:35:12.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:30:00+00:00 exited with status success for try_number 1 2024-04-28T02:35:12.745033648Z [2024-04-28T02:35:12.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:30:00+00:00, map_index=-1, run_start_date=2024-04-28 02:35:12.099158+00:00, run_end_date=2024-04-28 02:35:12.502347+00:00, run_duration=0.403189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:35:10.355790+00:00, queued_by_job_id=1, pid=5207 2024-04-28T02:36:00.999242458Z [2024-04-28T02:36:00.998+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:36:01.010596591Z [2024-04-28T02:36:01.010+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:36:01.031954686Z [2024-04-28T02:36:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:36:00+00:00, run_after=2024-04-28T02:37:00+00:00 2024-04-28T02:36:01.104862871Z [2024-04-28T02:36:01.104+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:36:01.104904764Z 2024-04-28T02:36:01.104915642Z 2024-04-28T02:36:01.104924330Z 2024-04-28T02:36:01.106038459Z [2024-04-28T02:36:01.105+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:36:01.106875761Z [2024-04-28T02:36:01.106+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:36:01.107812081Z [2024-04-28T02:36:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:36:01.112001061Z [2024-04-28T02:36:01.110+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:36:01.112036132Z 2024-04-28T02:36:01.112065317Z 2024-04-28T02:36:01.112074398Z 2024-04-28T02:36:01.117457059Z [2024-04-28T02:36:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:36:01.117974903Z [2024-04-28T02:36:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:36:01.118723686Z [2024-04-28T02:36:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:36:01.119072810Z [2024-04-28T02:36:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:36:01.119630368Z [2024-04-28T02:36:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:36:01.120022501Z [2024-04-28T02:36:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:36:01.366593277Z [2024-04-28T02:36:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:34:00+00:00 exited with status queued for try_number 1 2024-04-28T02:36:01.366629718Z [2024-04-28T02:36:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status queued for try_number 1 2024-04-28T02:36:01.366922712Z [2024-04-28T02:36:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status queued for try_number 1 2024-04-28T02:36:01.375180313Z [2024-04-28T02:36:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to daa9cfdc-d089-487a-bff6-1c41a79e5ab5 2024-04-28T02:36:01.375233414Z [2024-04-28T02:36:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65bcdd81-1653-4b10-98da-57114d52192c 2024-04-28T02:36:01.375318946Z [2024-04-28T02:36:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25f05048-5827-43bf-a9b8-6fc961774f0d 2024-04-28T02:36:02.540583504Z [2024-04-28T02:36:02.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:36:02.541322588Z [2024-04-28T02:36:02.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:34:00+00:00, run_id=scheduled__2024-04-28T02:34:00+00:00, run_start_date=2024-04-28 02:36:01.047994+00:00, run_end_date=2024-04-28 02:36:02.540497+00:00, run_duration=1.492503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:34:00+00:00, data_interval_end=2024-04-28 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:36:02.549026838Z [2024-04-28T02:36:02.548+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:36:00+00:00, run_after=2024-04-28T02:38:00+00:00 2024-04-28T02:36:02.592397737Z [2024-04-28T02:36:02.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:34:00+00:00 exited with status success for try_number 1 2024-04-28T02:36:02.597757548Z [2024-04-28T02:36:02.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:34:00+00:00, map_index=-1, run_start_date=2024-04-28 02:36:01.841603+00:00, run_end_date=2024-04-28 02:36:02.206960+00:00, run_duration=0.365357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:36:01.113544+00:00, queued_by_job_id=1, pid=5221 2024-04-28T02:36:04.470180842Z [2024-04-28T02:36:04.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:36:04.470828867Z [2024-04-28T02:36:04.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:35:00+00:00, run_id=scheduled__2024-04-28T02:35:00+00:00, run_start_date=2024-04-28 02:36:01.049347+00:00, run_end_date=2024-04-28 02:36:04.470467+00:00, run_duration=3.42112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:35:00+00:00, data_interval_end=2024-04-28 02:36:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:36:04.482588763Z [2024-04-28T02:36:04.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:36:00+00:00, run_after=2024-04-28T02:37:00+00:00 2024-04-28T02:36:04.533368116Z [2024-04-28T02:36:04.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status success for try_number 1 2024-04-28T02:36:04.538627676Z [2024-04-28T02:36:04.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:35:00+00:00, map_index=-1, run_start_date=2024-04-28 02:36:03.047209+00:00, run_end_date=2024-04-28 02:36:04.256180+00:00, run_duration=1.208971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:36:01.113544+00:00, queued_by_job_id=1, pid=5251 2024-04-28T02:36:04.965541732Z [2024-04-28T02:36:04.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:36:04.965556616Z [2024-04-28T02:36:04.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:35:00+00:00, run_id=scheduled__2024-04-28T02:35:00+00:00, run_start_date=2024-04-28 02:36:01.050610+00:00, run_end_date=2024-04-28 02:36:04.955072+00:00, run_duration=3.904462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:35:00+00:00, data_interval_end=2024-04-28 02:36:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:36:04.968126698Z [2024-04-28T02:36:04.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:36:00+00:00, run_after=2024-04-28T02:37:00+00:00 2024-04-28T02:36:05.019723528Z [2024-04-28T02:36:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status success for try_number 1 2024-04-28T02:36:05.025448117Z [2024-04-28T02:36:05.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:35:00+00:00, map_index=-1, run_start_date=2024-04-28 02:36:03.064744+00:00, run_end_date=2024-04-28 02:36:04.712288+00:00, run_duration=1.647544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:36:01.113544+00:00, queued_by_job_id=1, pid=5252 2024-04-28T02:36:16.231196534Z [2024-04-28T02:36:16.230+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:37:00.903297944Z [2024-04-28T02:37:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:37:00+00:00, run_after=2024-04-28T02:38:00+00:00 2024-04-28T02:37:00.920986339Z [2024-04-28T02:37:00.920+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:37:00.986827836Z [2024-04-28T02:37:00.986+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:37:00.986874854Z 2024-04-28T02:37:00.986884859Z 2024-04-28T02:37:00.987104515Z [2024-04-28T02:37:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:37:00.987282304Z [2024-04-28T02:37:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:37:00.988280770Z [2024-04-28T02:37:00.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:37:00.988302014Z 2024-04-28T02:37:00.988311437Z 2024-04-28T02:37:00.992477536Z [2024-04-28T02:37:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:37:00.992688168Z [2024-04-28T02:37:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:37:00.993036343Z [2024-04-28T02:37:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:37:00.993240501Z [2024-04-28T02:37:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:37:01.193987070Z [2024-04-28T02:37:01.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:36:00+00:00 exited with status queued for try_number 1 2024-04-28T02:37:01.194223673Z [2024-04-28T02:37:01.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:36:00+00:00 exited with status queued for try_number 1 2024-04-28T02:37:01.204998537Z [2024-04-28T02:37:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to edb3b96b-6e61-4d6e-9767-c3d701a65fe0 2024-04-28T02:37:01.205222256Z [2024-04-28T02:37:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b0390c8-a69e-4cb6-9c1b-c0020337b68e 2024-04-28T02:37:05.024315019Z [2024-04-28T02:37:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:36:00+00:00 exited with status success for try_number 1 2024-04-28T02:37:05.034348909Z [2024-04-28T02:37:05.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:36:00+00:00, map_index=-1, run_start_date=2024-04-28 02:37:02.800275+00:00, run_end_date=2024-04-28 02:37:04.787071+00:00, run_duration=1.986796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:37:00.989264+00:00, queued_by_job_id=1, pid=5308 2024-04-28T02:37:05.431592274Z [2024-04-28T02:37:05.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:37:05.431970921Z [2024-04-28T02:37:05.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:36:00+00:00, run_id=scheduled__2024-04-28T02:36:00+00:00, run_start_date=2024-04-28 02:37:00.931779+00:00, run_end_date=2024-04-28 02:37:05.431498+00:00, run_duration=4.499719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:36:00+00:00, data_interval_end=2024-04-28 02:37:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:37:05.443111059Z [2024-04-28T02:37:05.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:37:00+00:00, run_after=2024-04-28T02:38:00+00:00 2024-04-28T02:37:05.452178730Z [2024-04-28T02:37:05.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:37:05.452506066Z [2024-04-28T02:37:05.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:36:00+00:00, run_id=scheduled__2024-04-28T02:36:00+00:00, run_start_date=2024-04-28 02:37:00.933328+00:00, run_end_date=2024-04-28 02:37:05.452098+00:00, run_duration=4.51877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:36:00+00:00, data_interval_end=2024-04-28 02:37:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:37:05.461288515Z [2024-04-28T02:37:05.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:37:00+00:00, run_after=2024-04-28T02:38:00+00:00 2024-04-28T02:37:05.497747103Z [2024-04-28T02:37:05.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:36:00+00:00 exited with status success for try_number 1 2024-04-28T02:37:05.502472928Z [2024-04-28T02:37:05.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:36:00+00:00, map_index=-1, run_start_date=2024-04-28 02:37:02.746680+00:00, run_end_date=2024-04-28 02:37:04.999677+00:00, run_duration=2.252997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:37:00.989264+00:00, queued_by_job_id=1, pid=5307 2024-04-28T02:38:00.086431087Z [2024-04-28T02:38:00.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:38:00.100273736Z [2024-04-28T02:38:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:38:00+00:00, run_after=2024-04-28T02:39:00+00:00 2024-04-28T02:38:00.194002168Z [2024-04-28T02:38:00.193+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:38:00.194033531Z 2024-04-28T02:38:00.194038123Z 2024-04-28T02:38:00.194122327Z [2024-04-28T02:38:00.193+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:38:00.194363881Z [2024-04-28T02:38:00.194+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:38:00.195285687Z [2024-04-28T02:38:00.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:38:00.195299565Z 2024-04-28T02:38:00.195307070Z 2024-04-28T02:38:00.198943069Z [2024-04-28T02:38:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:38:00.199142096Z [2024-04-28T02:38:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:38:00.199348687Z [2024-04-28T02:38:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:38:00.199509866Z [2024-04-28T02:38:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:38:00.371591301Z [2024-04-28T02:38:00.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:37:00+00:00 exited with status queued for try_number 1 2024-04-28T02:38:00.372503358Z [2024-04-28T02:38:00.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:37:00+00:00 exited with status queued for try_number 1 2024-04-28T02:38:00.379925781Z [2024-04-28T02:38:00.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75cc6902-c1e5-4743-a8b4-d1dd01f5eb0b 2024-04-28T02:38:00.380074184Z [2024-04-28T02:38:00.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 821c9852-fc26-4a73-b73e-4a72462bc740 2024-04-28T02:38:00.425297127Z [2024-04-28T02:38:00.424+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:38:00.483626955Z [2024-04-28T02:38:00.483+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:38:00.483712341Z 2024-04-28T02:38:00.483753864Z [2024-04-28T02:38:00.483+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:38:00.484202933Z [2024-04-28T02:38:00.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:38:00.484216575Z 2024-04-28T02:38:00.486086728Z [2024-04-28T02:38:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:38:00.486233326Z [2024-04-28T02:38:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:38:00.539305425Z [2024-04-28T02:38:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:36:00+00:00 exited with status queued for try_number 1 2024-04-28T02:38:00.546118613Z [2024-04-28T02:38:00.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 314112a0-6f4f-43e0-96ee-d9ed9bbddefc 2024-04-28T02:38:02.020744985Z [2024-04-28T02:38:02.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:38:02.021546003Z [2024-04-28T02:38:02.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:36:00+00:00, run_id=scheduled__2024-04-28T02:36:00+00:00, run_start_date=2024-04-28 02:38:00.437508+00:00, run_end_date=2024-04-28 02:38:02.019839+00:00, run_duration=1.582331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:36:00+00:00, data_interval_end=2024-04-28 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:38:02.028819579Z [2024-04-28T02:38:02.027+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:38:00+00:00, run_after=2024-04-28T02:40:00+00:00 2024-04-28T02:38:02.115439520Z [2024-04-28T02:38:02.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:36:00+00:00 exited with status success for try_number 1 2024-04-28T02:38:02.122248770Z [2024-04-28T02:38:02.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:36:00+00:00, map_index=-1, run_start_date=2024-04-28 02:38:01.233078+00:00, run_end_date=2024-04-28 02:38:01.620860+00:00, run_duration=0.387782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:38:00.484466+00:00, queued_by_job_id=1, pid=5335 2024-04-28T02:38:04.265273597Z [2024-04-28T02:38:04.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:38:04.265315005Z [2024-04-28T02:38:04.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:37:00+00:00, run_id=scheduled__2024-04-28T02:37:00+00:00, run_start_date=2024-04-28 02:38:00.129200+00:00, run_end_date=2024-04-28 02:38:04.262855+00:00, run_duration=4.133655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:37:00+00:00, data_interval_end=2024-04-28 02:38:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:38:04.277980485Z [2024-04-28T02:38:04.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:38:00+00:00, run_after=2024-04-28T02:39:00+00:00 2024-04-28T02:38:04.278187743Z [2024-04-28T02:38:04.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:38:04.278464508Z [2024-04-28T02:38:04.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:37:00+00:00, run_id=scheduled__2024-04-28T02:37:00+00:00, run_start_date=2024-04-28 02:38:00.127999+00:00, run_end_date=2024-04-28 02:38:04.278128+00:00, run_duration=4.150129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:37:00+00:00, data_interval_end=2024-04-28 02:38:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:38:04.289459451Z [2024-04-28T02:38:04.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:38:00+00:00, run_after=2024-04-28T02:39:00+00:00 2024-04-28T02:38:04.317910230Z [2024-04-28T02:38:04.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:37:00+00:00 exited with status success for try_number 1 2024-04-28T02:38:04.318050185Z [2024-04-28T02:38:04.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:37:00+00:00 exited with status success for try_number 1 2024-04-28T02:38:04.331913088Z [2024-04-28T02:38:04.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:37:00+00:00, map_index=-1, run_start_date=2024-04-28 02:38:02.055995+00:00, run_end_date=2024-04-28 02:38:03.698262+00:00, run_duration=1.642267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:38:00.196129+00:00, queued_by_job_id=1, pid=5373 2024-04-28T02:38:04.332408527Z [2024-04-28T02:38:04.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:37:00+00:00, map_index=-1, run_start_date=2024-04-28 02:38:01.946688+00:00, run_end_date=2024-04-28 02:38:03.245785+00:00, run_duration=1.299097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:38:00.196129+00:00, queued_by_job_id=1, pid=5372 2024-04-28T02:39:00.046192545Z [2024-04-28T02:39:00.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:39:00+00:00, run_after=2024-04-28T02:40:00+00:00 2024-04-28T02:39:00.066789167Z [2024-04-28T02:39:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:39:00.129991397Z [2024-04-28T02:39:00.129+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:39:00.130024574Z 2024-04-28T02:39:00.130028269Z 2024-04-28T02:39:00.130468303Z [2024-04-28T02:39:00.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:39:00.130682943Z [2024-04-28T02:39:00.130+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:39:00.131350403Z [2024-04-28T02:39:00.131+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:39:00.131362599Z 2024-04-28T02:39:00.131367723Z 2024-04-28T02:39:00.134018906Z [2024-04-28T02:39:00.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:39:00.134183641Z [2024-04-28T02:39:00.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:39:00.134478415Z [2024-04-28T02:39:00.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:39:00.134651073Z [2024-04-28T02:39:00.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:39:00.436113233Z [2024-04-28T02:39:00.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:38:00+00:00 exited with status queued for try_number 1 2024-04-28T02:39:00.462576371Z [2024-04-28T02:39:00.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:38:00+00:00 exited with status queued for try_number 1 2024-04-28T02:39:00.462598983Z [2024-04-28T02:39:00.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e8af210-07b3-4cfb-ba3f-89a89a63e3f3 2024-04-28T02:39:00.462602443Z [2024-04-28T02:39:00.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to b15bde25-e157-44a9-9777-5c4a7142a0b2 2024-04-28T02:39:04.187484935Z [2024-04-28T02:39:04.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:39:04.187839630Z [2024-04-28T02:39:04.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:38:00+00:00, run_id=scheduled__2024-04-28T02:38:00+00:00, run_start_date=2024-04-28 02:39:00.079993+00:00, run_end_date=2024-04-28 02:39:04.187420+00:00, run_duration=4.107427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:38:00+00:00, data_interval_end=2024-04-28 02:39:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:39:04.200894548Z [2024-04-28T02:39:04.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:39:00+00:00, run_after=2024-04-28T02:40:00+00:00 2024-04-28T02:39:04.220987885Z [2024-04-28T02:39:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:39:04.221639164Z [2024-04-28T02:39:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:38:00+00:00, run_id=scheduled__2024-04-28T02:38:00+00:00, run_start_date=2024-04-28 02:39:00.081312+00:00, run_end_date=2024-04-28 02:39:04.221123+00:00, run_duration=4.139811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:38:00+00:00, data_interval_end=2024-04-28 02:39:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:39:04.246506800Z [2024-04-28T02:39:04.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:39:00+00:00, run_after=2024-04-28T02:40:00+00:00 2024-04-28T02:39:04.290260221Z [2024-04-28T02:39:04.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:38:00+00:00 exited with status success for try_number 1 2024-04-28T02:39:04.291067256Z [2024-04-28T02:39:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:38:00+00:00 exited with status success for try_number 1 2024-04-28T02:39:04.309173407Z [2024-04-28T02:39:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:38:00+00:00, map_index=-1, run_start_date=2024-04-28 02:39:01.909076+00:00, run_end_date=2024-04-28 02:39:03.410143+00:00, run_duration=1.501067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:39:00.131924+00:00, queued_by_job_id=1, pid=5426 2024-04-28T02:39:04.309510064Z [2024-04-28T02:39:04.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:38:00+00:00, map_index=-1, run_start_date=2024-04-28 02:39:02.187330+00:00, run_end_date=2024-04-28 02:39:03.786935+00:00, run_duration=1.599605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:39:00.131924+00:00, queued_by_job_id=1, pid=5428 2024-04-28T02:40:01.074248344Z [2024-04-28T02:40:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:40:00+00:00, run_after=2024-04-28T02:41:00+00:00 2024-04-28T02:40:01.093386701Z [2024-04-28T02:40:01.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:40:00+00:00, run_after=2024-04-28T02:45:00+00:00 2024-04-28T02:40:01.101622660Z [2024-04-28T02:40:01.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:40:01.108263739Z [2024-04-28T02:40:01.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:40:01.256895347Z [2024-04-28T02:40:01.256+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:40:01.256977654Z 2024-04-28T02:40:01.256985602Z 2024-04-28T02:40:01.256992517Z 2024-04-28T02:40:01.256999332Z 2024-04-28T02:40:01.257018047Z [2024-04-28T02:40:01.256+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:40:01.257112627Z [2024-04-28T02:40:01.256+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:40:01.257256930Z [2024-04-28T02:40:01.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:40:01.257452030Z [2024-04-28T02:40:01.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:40:01.258011745Z [2024-04-28T02:40:01.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:40:01.258052383Z 2024-04-28T02:40:01.258060225Z 2024-04-28T02:40:01.258066694Z 2024-04-28T02:40:01.258072898Z 2024-04-28T02:40:01.261627246Z [2024-04-28T02:40:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:40:01.261750095Z [2024-04-28T02:40:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:40:01.262005828Z [2024-04-28T02:40:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:40:01.262235552Z [2024-04-28T02:40:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:40:01.262561008Z [2024-04-28T02:40:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:40:01.262585075Z [2024-04-28T02:40:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:40:01.262791759Z [2024-04-28T02:40:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:40:01.262970154Z [2024-04-28T02:40:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:40:01.541420693Z [2024-04-28T02:40:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:01.541799939Z [2024-04-28T02:40:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:38:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:01.541994342Z [2024-04-28T02:40:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:39:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:01.542233541Z [2024-04-28T02:40:01.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:39:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:01.552559101Z [2024-04-28T02:40:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56531613-910c-4f0e-8fe2-b2e119677e09 2024-04-28T02:40:01.552900767Z [2024-04-28T02:40:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to c57451bf-2923-46ee-9f3b-44b21a9e82d1 2024-04-28T02:40:01.553180922Z [2024-04-28T02:40:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to e39144e8-0c22-42e5-8c44-3fd2639e0177 2024-04-28T02:40:01.553563800Z [2024-04-28T02:40:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ca77ab2-b6cf-4e9b-ac67-0029efd9e8c3 2024-04-28T02:40:02.790009573Z [2024-04-28T02:40:02.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:40:02.790032384Z [2024-04-28T02:40:02.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:38:00+00:00, run_id=scheduled__2024-04-28T02:38:00+00:00, run_start_date=2024-04-28 02:40:01.122129+00:00, run_end_date=2024-04-28 02:40:02.784083+00:00, run_duration=1.661954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:38:00+00:00, data_interval_end=2024-04-28 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:40:02.832903358Z [2024-04-28T02:40:02.830+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:40:00+00:00, run_after=2024-04-28T02:42:00+00:00 2024-04-28T02:40:03.018019399Z [2024-04-28T02:40:03.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:38:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:03.026855976Z [2024-04-28T02:40:03.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:38:00+00:00, map_index=-1, run_start_date=2024-04-28 02:40:02.248481+00:00, run_end_date=2024-04-28 02:40:02.630703+00:00, run_duration=0.382222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:01.258963+00:00, queued_by_job_id=1, pid=5464 2024-04-28T02:40:05.390010478Z [2024-04-28T02:40:05.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:40:05.390041408Z 2024-04-28T02:40:05.390053273Z [2024-04-28T02:40:05.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:40:05.390769871Z [2024-04-28T02:40:05.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:40:05.390801443Z 2024-04-28T02:40:05.395161840Z [2024-04-28T02:40:05.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:40:05.395989818Z [2024-04-28T02:40:05.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:40:05.462579721Z [2024-04-28T02:40:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:05.462605763Z [2024-04-28T02:40:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:05.470169995Z [2024-04-28T02:40:05.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f2c24d4-5208-4e2d-9704-0d086bf0e498 2024-04-28T02:40:05.470273611Z [2024-04-28T02:40:05.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:35:00+00:00, map_index=-1, run_start_date=2024-04-28 02:40:03.868293+00:00, run_end_date=2024-04-28 02:40:04.580508+00:00, run_duration=0.712215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:01.258963+00:00, queued_by_job_id=1, pid=5486 2024-04-28T02:40:07.870052478Z [2024-04-28T02:40:07.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:40:07.870636436Z [2024-04-28T02:40:07.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:39:00+00:00, run_id=scheduled__2024-04-28T02:39:00+00:00, run_start_date=2024-04-28 02:40:01.137249+00:00, run_end_date=2024-04-28 02:40:07.869889+00:00, run_duration=6.73264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:39:00+00:00, data_interval_end=2024-04-28 02:40:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:40:07.879498995Z [2024-04-28T02:40:07.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:40:00+00:00, run_after=2024-04-28T02:41:00+00:00 2024-04-28T02:40:07.891091173Z [2024-04-28T02:40:07.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:40:07.891529855Z [2024-04-28T02:40:07.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:39:00+00:00, run_id=scheduled__2024-04-28T02:39:00+00:00, run_start_date=2024-04-28 02:40:01.124519+00:00, run_end_date=2024-04-28 02:40:07.891186+00:00, run_duration=6.766667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:39:00+00:00, data_interval_end=2024-04-28 02:40:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:40:07.901044972Z [2024-04-28T02:40:07.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:40:00+00:00, run_after=2024-04-28T02:41:00+00:00 2024-04-28T02:40:07.956315119Z [2024-04-28T02:40:07.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:39:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:07.956373249Z [2024-04-28T02:40:07.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:39:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:07.965060223Z [2024-04-28T02:40:07.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:39:00+00:00, map_index=-1, run_start_date=2024-04-28 02:40:04.204903+00:00, run_end_date=2024-04-28 02:40:06.679346+00:00, run_duration=2.474443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:01.258963+00:00, queued_by_job_id=1, pid=5505 2024-04-28T02:40:07.965158717Z [2024-04-28T02:40:07.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:39:00+00:00, map_index=-1, run_start_date=2024-04-28 02:40:04.778758+00:00, run_end_date=2024-04-28 02:40:06.602979+00:00, run_duration=1.824221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:01.258963+00:00, queued_by_job_id=1, pid=5515 2024-04-28T02:40:09.270010475Z [2024-04-28T02:40:09.269+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:40:09.270058447Z 2024-04-28T02:40:09.270677524Z [2024-04-28T02:40:09.270+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:40:09.272601241Z [2024-04-28T02:40:09.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:40:09.272617926Z 2024-04-28T02:40:09.277239272Z [2024-04-28T02:40:09.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:40:09.277564125Z [2024-04-28T02:40:09.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:40:09.352923034Z [2024-04-28T02:40:09.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:09.353334908Z [2024-04-28T02:40:09.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:09.360858008Z [2024-04-28T02:40:09.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfd8c6f8-869e-4dac-80a7-c7290103e22f 2024-04-28T02:40:09.361139918Z [2024-04-28T02:40:09.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:35:00+00:00, map_index=-1, run_start_date=2024-04-28 02:40:07.813722+00:00, run_end_date=2024-04-28 02:40:08.260893+00:00, run_duration=0.447171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:05.392625+00:00, queued_by_job_id=1, pid=5548 2024-04-28T02:40:11.662553433Z [2024-04-28T02:40:11.661+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:40:11.662585820Z 2024-04-28T02:40:11.663127787Z [2024-04-28T02:40:11.662+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:40:11.664833881Z [2024-04-28T02:40:11.664+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:40:11.664849463Z 2024-04-28T02:40:11.669582779Z [2024-04-28T02:40:11.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:40:11.670099274Z [2024-04-28T02:40:11.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:40:11.734995082Z [2024-04-28T02:40:11.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status queued for try_number 1 2024-04-28T02:40:11.735245037Z [2024-04-28T02:40:11.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:11.742165821Z [2024-04-28T02:40:11.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to b158c93f-9f7b-499b-a4c8-e2f9a3f7f246 2024-04-28T02:40:11.742565042Z [2024-04-28T02:40:11.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:35:00+00:00, map_index=0, run_start_date=2024-04-28 02:40:10.895208+00:00, run_end_date=2024-04-28 02:40:11.222831+00:00, run_duration=0.327623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:09.273104+00:00, queued_by_job_id=1, pid=5560 2024-04-28T02:40:14.327476346Z [2024-04-28T02:40:14.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:40:14.327873792Z [2024-04-28T02:40:14.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:35:00+00:00, run_id=scheduled__2024-04-28T02:35:00+00:00, run_start_date=2024-04-28 02:40:01.120269+00:00, run_end_date=2024-04-28 02:40:14.327489+00:00, run_duration=13.20722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:35:00+00:00, data_interval_end=2024-04-28 02:40:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:40:14.333878168Z [2024-04-28T02:40:14.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:40:00+00:00, run_after=2024-04-28T02:45:00+00:00 2024-04-28T02:40:14.368189584Z [2024-04-28T02:40:14.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:35:00+00:00 exited with status success for try_number 1 2024-04-28T02:40:14.379275929Z [2024-04-28T02:40:14.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:35:00+00:00, map_index=-1, run_start_date=2024-04-28 02:40:13.225275+00:00, run_end_date=2024-04-28 02:40:13.562262+00:00, run_duration=0.336987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:40:11.665952+00:00, queued_by_job_id=1, pid=5572 2024-04-28T02:41:00.071568495Z [2024-04-28T02:41:00.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:41:00.084700405Z [2024-04-28T02:41:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:41:00+00:00, run_after=2024-04-28T02:42:00+00:00 2024-04-28T02:41:00.161289312Z [2024-04-28T02:41:00.160+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:41:00.161334816Z 2024-04-28T02:41:00.161339171Z 2024-04-28T02:41:00.161692566Z [2024-04-28T02:41:00.161+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:41:00.162035959Z [2024-04-28T02:41:00.161+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:41:00.163198750Z [2024-04-28T02:41:00.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:41:00.163211448Z 2024-04-28T02:41:00.163214579Z 2024-04-28T02:41:00.168793214Z [2024-04-28T02:41:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:41:00.169259810Z [2024-04-28T02:41:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:41:00.169862567Z [2024-04-28T02:41:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:41:00.170118982Z [2024-04-28T02:41:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:41:00.437936750Z [2024-04-28T02:41:00.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:41:00.438098671Z [2024-04-28T02:41:00.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:41:00.451722561Z [2024-04-28T02:41:00.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2300e6ff-4826-4d74-85e4-98d899878e2b 2024-04-28T02:41:00.451984705Z [2024-04-28T02:41:00.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 391f90bf-ffe7-41a1-9e99-1e4bc204d391 2024-04-28T02:41:03.803491330Z [2024-04-28T02:41:03.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:41:03.803820843Z [2024-04-28T02:41:03.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:40:00+00:00, run_id=scheduled__2024-04-28T02:40:00+00:00, run_start_date=2024-04-28 02:41:00.114540+00:00, run_end_date=2024-04-28 02:41:03.803355+00:00, run_duration=3.688815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:40:00+00:00, data_interval_end=2024-04-28 02:41:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:41:03.812804623Z [2024-04-28T02:41:03.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:41:00+00:00, run_after=2024-04-28T02:42:00+00:00 2024-04-28T02:41:03.852528178Z [2024-04-28T02:41:03.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:41:03.857387014Z [2024-04-28T02:41:03.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=-1, run_start_date=2024-04-28 02:41:01.998579+00:00, run_end_date=2024-04-28 02:41:03.248959+00:00, run_duration=1.25038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:41:00.165569+00:00, queued_by_job_id=1, pid=5606 2024-04-28T02:41:04.073867888Z [2024-04-28T02:41:04.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:41:04.074051764Z [2024-04-28T02:41:04.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:40:00+00:00, run_id=scheduled__2024-04-28T02:40:00+00:00, run_start_date=2024-04-28 02:41:00.116381+00:00, run_end_date=2024-04-28 02:41:04.073758+00:00, run_duration=3.957377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:40:00+00:00, data_interval_end=2024-04-28 02:41:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:41:04.084740194Z [2024-04-28T02:41:04.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:41:00+00:00, run_after=2024-04-28T02:42:00+00:00 2024-04-28T02:41:04.128842769Z [2024-04-28T02:41:04.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:41:04.137746000Z [2024-04-28T02:41:04.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=-1, run_start_date=2024-04-28 02:41:02.240333+00:00, run_end_date=2024-04-28 02:41:03.923017+00:00, run_duration=1.682684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:41:00.165569+00:00, queued_by_job_id=1, pid=5607 2024-04-28T02:41:16.320218862Z [2024-04-28T02:41:16.319+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:42:01.093977101Z [2024-04-28T02:42:01.093+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:42:01.110582042Z [2024-04-28T02:42:01.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:42:00+00:00, run_after=2024-04-28T02:43:00+00:00 2024-04-28T02:42:01.120297531Z [2024-04-28T02:42:01.119+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:42:01.199718066Z [2024-04-28T02:42:01.199+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:42:01.199761283Z 2024-04-28T02:42:01.199771896Z 2024-04-28T02:42:01.199780729Z 2024-04-28T02:42:01.200428840Z [2024-04-28T02:42:01.199+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:42:01.201246866Z [2024-04-28T02:42:01.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:42:01.201707000Z [2024-04-28T02:42:01.201+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:42:01.204095110Z [2024-04-28T02:42:01.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:42:01.204105322Z 2024-04-28T02:42:01.204125542Z 2024-04-28T02:42:01.204129282Z 2024-04-28T02:42:01.210269300Z [2024-04-28T02:42:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:42:01.210807383Z [2024-04-28T02:42:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:42:01.211771271Z [2024-04-28T02:42:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:42:01.212079997Z [2024-04-28T02:42:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:42:01.212653070Z [2024-04-28T02:42:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:42:01.213057462Z [2024-04-28T02:42:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:42:01.446004804Z [2024-04-28T02:42:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:42:01.446036075Z [2024-04-28T02:42:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:41:00+00:00 exited with status queued for try_number 1 2024-04-28T02:42:01.446059281Z [2024-04-28T02:42:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:41:00+00:00 exited with status queued for try_number 1 2024-04-28T02:42:01.460451894Z [2024-04-28T02:42:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a2619af-eb35-46b8-b2e9-a3f8a717130c 2024-04-28T02:42:01.460700439Z [2024-04-28T02:42:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to c229d7ba-6b49-4cc3-88d6-2190b35756ce 2024-04-28T02:42:01.460982190Z [2024-04-28T02:42:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa0331a0-e114-4133-a2bd-2510d27f334b 2024-04-28T02:42:03.733724294Z [2024-04-28T02:42:03.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:42:03.737201383Z [2024-04-28T02:42:03.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:40:00+00:00, run_id=scheduled__2024-04-28T02:40:00+00:00, run_start_date=2024-04-28 02:42:01.134767+00:00, run_end_date=2024-04-28 02:42:03.733627+00:00, run_duration=2.59886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:40:00+00:00, data_interval_end=2024-04-28 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:42:03.745925400Z [2024-04-28T02:42:03.745+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:42:00+00:00, run_after=2024-04-28T02:44:00+00:00 2024-04-28T02:42:03.827846080Z [2024-04-28T02:42:03.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:42:03.834428526Z [2024-04-28T02:42:03.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=-1, run_start_date=2024-04-28 02:42:02.052851+00:00, run_end_date=2024-04-28 02:42:02.682268+00:00, run_duration=0.629417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:42:01.205881+00:00, queued_by_job_id=1, pid=5642 2024-04-28T02:42:04.896601354Z [2024-04-28T02:42:04.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:42:04.896947277Z [2024-04-28T02:42:04.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:41:00+00:00, run_id=scheduled__2024-04-28T02:41:00+00:00, run_start_date=2024-04-28 02:42:01.136389+00:00, run_end_date=2024-04-28 02:42:04.896543+00:00, run_duration=3.760154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:41:00+00:00, data_interval_end=2024-04-28 02:42:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:42:04.905101121Z [2024-04-28T02:42:04.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:42:00+00:00, run_after=2024-04-28T02:43:00+00:00 2024-04-28T02:42:04.970497884Z [2024-04-28T02:42:04.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:41:00+00:00 exited with status success for try_number 1 2024-04-28T02:42:04.975453382Z [2024-04-28T02:42:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:41:00+00:00, map_index=-1, run_start_date=2024-04-28 02:42:03.327262+00:00, run_end_date=2024-04-28 02:42:04.553930+00:00, run_duration=1.226668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:42:01.205881+00:00, queued_by_job_id=1, pid=5672 2024-04-28T02:42:06.198730953Z [2024-04-28T02:42:06.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:42:06.199122658Z [2024-04-28T02:42:06.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:41:00+00:00, run_id=scheduled__2024-04-28T02:41:00+00:00, run_start_date=2024-04-28 02:42:01.137850+00:00, run_end_date=2024-04-28 02:42:06.198723+00:00, run_duration=5.060873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:41:00+00:00, data_interval_end=2024-04-28 02:42:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:42:06.210300478Z [2024-04-28T02:42:06.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:42:00+00:00, run_after=2024-04-28T02:43:00+00:00 2024-04-28T02:42:06.252187272Z [2024-04-28T02:42:06.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:41:00+00:00 exited with status success for try_number 1 2024-04-28T02:42:06.262762870Z [2024-04-28T02:42:06.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:41:00+00:00, map_index=-1, run_start_date=2024-04-28 02:42:03.470301+00:00, run_end_date=2024-04-28 02:42:05.155607+00:00, run_duration=1.685306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:42:01.205881+00:00, queued_by_job_id=1, pid=5673 2024-04-28T02:43:00.236362397Z [2024-04-28T02:43:00.235+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:43:00.251260453Z [2024-04-28T02:43:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:43:00+00:00, run_after=2024-04-28T02:44:00+00:00 2024-04-28T02:43:00.313070498Z [2024-04-28T02:43:00.312+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:43:00.313105488Z 2024-04-28T02:43:00.313112185Z 2024-04-28T02:43:00.313125945Z [2024-04-28T02:43:00.312+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:43:00.313260463Z [2024-04-28T02:43:00.313+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:43:00.313803975Z [2024-04-28T02:43:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:43:00.313816736Z 2024-04-28T02:43:00.313820930Z 2024-04-28T02:43:00.317510740Z [2024-04-28T02:43:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:43:00.317573655Z [2024-04-28T02:43:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:43:00.317794993Z [2024-04-28T02:43:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:43:00.317853606Z [2024-04-28T02:43:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:43:00.498686177Z [2024-04-28T02:43:00.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:42:00+00:00 exited with status queued for try_number 1 2024-04-28T02:43:00.499066414Z [2024-04-28T02:43:00.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:42:00+00:00 exited with status queued for try_number 1 2024-04-28T02:43:00.508814885Z [2024-04-28T02:43:00.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 963490ae-c222-4122-b7b4-30c524848cd4 2024-04-28T02:43:00.510769132Z [2024-04-28T02:43:00.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 084f2ace-01b8-4050-8eaa-16007630e785 2024-04-28T02:43:04.272177150Z [2024-04-28T02:43:04.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:43:04.272347603Z [2024-04-28T02:43:04.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:42:00+00:00, run_id=scheduled__2024-04-28T02:42:00+00:00, run_start_date=2024-04-28 02:43:00.262865+00:00, run_end_date=2024-04-28 02:43:04.272013+00:00, run_duration=4.009148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:42:00+00:00, data_interval_end=2024-04-28 02:43:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:43:04.292019366Z [2024-04-28T02:43:04.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:43:00+00:00, run_after=2024-04-28T02:44:00+00:00 2024-04-28T02:43:04.295945023Z [2024-04-28T02:43:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:43:04.295979306Z [2024-04-28T02:43:04.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:42:00+00:00, run_id=scheduled__2024-04-28T02:42:00+00:00, run_start_date=2024-04-28 02:43:00.261530+00:00, run_end_date=2024-04-28 02:43:04.295558+00:00, run_duration=4.034028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:42:00+00:00, data_interval_end=2024-04-28 02:43:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:43:04.314037944Z [2024-04-28T02:43:04.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:43:00+00:00, run_after=2024-04-28T02:44:00+00:00 2024-04-28T02:43:04.351479333Z [2024-04-28T02:43:04.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:42:00+00:00 exited with status success for try_number 1 2024-04-28T02:43:04.352284436Z [2024-04-28T02:43:04.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:42:00+00:00 exited with status success for try_number 1 2024-04-28T02:43:04.360200482Z [2024-04-28T02:43:04.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:42:00+00:00, map_index=-1, run_start_date=2024-04-28 02:43:02.071364+00:00, run_end_date=2024-04-28 02:43:03.850028+00:00, run_duration=1.778664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:43:00.314429+00:00, queued_by_job_id=1, pid=5727 2024-04-28T02:43:04.360404043Z [2024-04-28T02:43:04.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:42:00+00:00, map_index=-1, run_start_date=2024-04-28 02:43:02.215073+00:00, run_end_date=2024-04-28 02:43:03.545065+00:00, run_duration=1.329992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:43:00.314429+00:00, queued_by_job_id=1, pid=5728 2024-04-28T02:44:00.670635063Z [2024-04-28T02:44:00.669+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:44:00.686936662Z [2024-04-28T02:44:00.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:44:00+00:00, run_after=2024-04-28T02:45:00+00:00 2024-04-28T02:44:00.695535553Z [2024-04-28T02:44:00.695+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:44:00.769994407Z [2024-04-28T02:44:00.769+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:44:00.770049404Z 2024-04-28T02:44:00.770070908Z 2024-04-28T02:44:00.770075796Z 2024-04-28T02:44:00.770101712Z [2024-04-28T02:44:00.769+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:44:00.770158808Z [2024-04-28T02:44:00.769+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:44:00.770408261Z [2024-04-28T02:44:00.770+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:44:00.771060593Z [2024-04-28T02:44:00.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:44:00.771071547Z 2024-04-28T02:44:00.771075190Z 2024-04-28T02:44:00.771078592Z 2024-04-28T02:44:00.775388641Z [2024-04-28T02:44:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:44:00.775588305Z [2024-04-28T02:44:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:44:00.775879544Z [2024-04-28T02:44:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:44:00.776162103Z [2024-04-28T02:44:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:44:00.776452284Z [2024-04-28T02:44:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:44:00.776607459Z [2024-04-28T02:44:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:44:01.008253398Z [2024-04-28T02:44:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:42:00+00:00 exited with status queued for try_number 1 2024-04-28T02:44:01.008311090Z [2024-04-28T02:44:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:43:00+00:00 exited with status queued for try_number 1 2024-04-28T02:44:01.008487320Z [2024-04-28T02:44:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:43:00+00:00 exited with status queued for try_number 1 2024-04-28T02:44:01.018687332Z [2024-04-28T02:44:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c4216f-891b-4629-a947-3979169bccc7 2024-04-28T02:44:01.018724966Z [2024-04-28T02:44:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac8a8dad-740f-4e79-8bf2-48b5331a175a 2024-04-28T02:44:01.018873842Z [2024-04-28T02:44:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a91b168-fd6c-4486-86cb-f4d55f1c6270 2024-04-28T02:44:03.039428649Z [2024-04-28T02:44:03.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:44:03.039946213Z [2024-04-28T02:44:03.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:42:00+00:00, run_id=scheduled__2024-04-28T02:42:00+00:00, run_start_date=2024-04-28 02:44:00.713981+00:00, run_end_date=2024-04-28 02:44:03.039306+00:00, run_duration=2.325325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:42:00+00:00, data_interval_end=2024-04-28 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:44:03.051697647Z [2024-04-28T02:44:03.051+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:44:00+00:00, run_after=2024-04-28T02:46:00+00:00 2024-04-28T02:44:03.128214865Z [2024-04-28T02:44:03.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:42:00+00:00 exited with status success for try_number 1 2024-04-28T02:44:03.136056755Z [2024-04-28T02:44:03.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:42:00+00:00, map_index=-1, run_start_date=2024-04-28 02:44:01.516120+00:00, run_end_date=2024-04-28 02:44:01.989788+00:00, run_duration=0.473668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:44:00.771845+00:00, queued_by_job_id=1, pid=5753 2024-04-28T02:44:05.340501294Z [2024-04-28T02:44:05.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:44:05.340882844Z [2024-04-28T02:44:05.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:43:00+00:00, run_id=scheduled__2024-04-28T02:43:00+00:00, run_start_date=2024-04-28 02:44:00.715148+00:00, run_end_date=2024-04-28 02:44:05.340416+00:00, run_duration=4.625268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:43:00+00:00, data_interval_end=2024-04-28 02:44:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:44:05.363467960Z [2024-04-28T02:44:05.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:44:00+00:00, run_after=2024-04-28T02:45:00+00:00 2024-04-28T02:44:05.379063979Z [2024-04-28T02:44:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:44:05.379580419Z [2024-04-28T02:44:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:43:00+00:00, run_id=scheduled__2024-04-28T02:43:00+00:00, run_start_date=2024-04-28 02:44:00.716122+00:00, run_end_date=2024-04-28 02:44:05.379002+00:00, run_duration=4.66288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:43:00+00:00, data_interval_end=2024-04-28 02:44:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:44:05.394885577Z [2024-04-28T02:44:05.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:44:00+00:00, run_after=2024-04-28T02:45:00+00:00 2024-04-28T02:44:05.451391844Z [2024-04-28T02:44:05.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:43:00+00:00 exited with status success for try_number 1 2024-04-28T02:44:05.452194168Z [2024-04-28T02:44:05.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:43:00+00:00 exited with status success for try_number 1 2024-04-28T02:44:05.471475381Z [2024-04-28T02:44:05.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:43:00+00:00, map_index=-1, run_start_date=2024-04-28 02:44:02.610891+00:00, run_end_date=2024-04-28 02:44:04.235136+00:00, run_duration=1.624245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:44:00.771845+00:00, queued_by_job_id=1, pid=5793 2024-04-28T02:44:05.474608108Z [2024-04-28T02:44:05.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:43:00+00:00, map_index=-1, run_start_date=2024-04-28 02:44:02.653482+00:00, run_end_date=2024-04-28 02:44:05.187902+00:00, run_duration=2.53442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:44:00.771845+00:00, queued_by_job_id=1, pid=5794 2024-04-28T02:45:01.101456029Z [2024-04-28T02:45:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:45:00+00:00, run_after=2024-04-28T02:46:00+00:00 2024-04-28T02:45:01.122332974Z [2024-04-28T02:45:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:45:00+00:00, run_after=2024-04-28T02:50:00+00:00 2024-04-28T02:45:01.130620126Z [2024-04-28T02:45:01.130+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:45:01.220021253Z [2024-04-28T02:45:01.219+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:45:01.220079478Z 2024-04-28T02:45:01.220087213Z 2024-04-28T02:45:01.220092914Z 2024-04-28T02:45:01.220562726Z [2024-04-28T02:45:01.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:45:01.221083447Z [2024-04-28T02:45:01.220+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:45:01.221256463Z [2024-04-28T02:45:01.220+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:45:01.222583130Z [2024-04-28T02:45:01.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:45:01.222615437Z 2024-04-28T02:45:01.222625906Z 2024-04-28T02:45:01.222666269Z 2024-04-28T02:45:01.227793359Z [2024-04-28T02:45:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:45:01.228021276Z [2024-04-28T02:45:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:45:01.228265096Z [2024-04-28T02:45:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:45:01.228454036Z [2024-04-28T02:45:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:45:01.228710829Z [2024-04-28T02:45:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:45:01.228912038Z [2024-04-28T02:45:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:45:01.489722698Z [2024-04-28T02:45:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:45:01.489812350Z [2024-04-28T02:45:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:44:00+00:00 exited with status queued for try_number 1 2024-04-28T02:45:01.489829793Z [2024-04-28T02:45:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:44:00+00:00 exited with status queued for try_number 1 2024-04-28T02:45:01.500744918Z [2024-04-28T02:45:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8c48cb8-74f8-4d40-840a-a54f9335e031 2024-04-28T02:45:01.500845277Z [2024-04-28T02:45:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87fd58a2-3736-4585-bbea-dc6f4a219b24 2024-04-28T02:45:01.500977200Z [2024-04-28T02:45:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb79ec11-2d90-4f25-bdaa-826bc14aa92f 2024-04-28T02:45:04.117129769Z [2024-04-28T02:45:04.116+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:45:04.117177242Z 2024-04-28T02:45:04.117726568Z [2024-04-28T02:45:04.117+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:45:04.118793160Z [2024-04-28T02:45:04.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:45:04.118826094Z 2024-04-28T02:45:04.122845436Z [2024-04-28T02:45:04.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:45:04.123240114Z [2024-04-28T02:45:04.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:45:04.196602761Z [2024-04-28T02:45:04.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:45:04.196698075Z [2024-04-28T02:45:04.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:45:04.208390998Z [2024-04-28T02:45:04.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2457efeb-b55a-402d-bcc0-d0a3eb84bf78 2024-04-28T02:45:04.208444392Z [2024-04-28T02:45:04.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=-1, run_start_date=2024-04-28 02:45:03.349875+00:00, run_end_date=2024-04-28 02:45:03.838436+00:00, run_duration=0.488561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:45:01.223583+00:00, queued_by_job_id=1, pid=5861 2024-04-28T02:45:05.484152729Z [2024-04-28T02:45:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:45:05.484545005Z [2024-04-28T02:45:05.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:44:00+00:00, run_id=scheduled__2024-04-28T02:44:00+00:00, run_start_date=2024-04-28 02:45:01.149396+00:00, run_end_date=2024-04-28 02:45:05.484206+00:00, run_duration=4.33481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:44:00+00:00, data_interval_end=2024-04-28 02:45:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:45:05.500363016Z [2024-04-28T02:45:05.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:45:00+00:00, run_after=2024-04-28T02:46:00+00:00 2024-04-28T02:45:05.508790812Z [2024-04-28T02:45:05.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:45:05.509044934Z [2024-04-28T02:45:05.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:44:00+00:00, run_id=scheduled__2024-04-28T02:44:00+00:00, run_start_date=2024-04-28 02:45:01.150943+00:00, run_end_date=2024-04-28 02:45:05.508758+00:00, run_duration=4.357815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:44:00+00:00, data_interval_end=2024-04-28 02:45:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:45:05.518956536Z [2024-04-28T02:45:05.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:45:00+00:00, run_after=2024-04-28T02:46:00+00:00 2024-04-28T02:45:05.564608137Z [2024-04-28T02:45:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:44:00+00:00 exited with status success for try_number 1 2024-04-28T02:45:05.564954391Z [2024-04-28T02:45:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:44:00+00:00 exited with status success for try_number 1 2024-04-28T02:45:05.578064673Z [2024-04-28T02:45:05.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:44:00+00:00, map_index=-1, run_start_date=2024-04-28 02:45:03.322225+00:00, run_end_date=2024-04-28 02:45:04.693500+00:00, run_duration=1.371275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:45:01.223583+00:00, queued_by_job_id=1, pid=5860 2024-04-28T02:45:05.578304551Z [2024-04-28T02:45:05.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:44:00+00:00, map_index=-1, run_start_date=2024-04-28 02:45:03.435235+00:00, run_end_date=2024-04-28 02:45:05.231053+00:00, run_duration=1.795818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:45:01.223583+00:00, queued_by_job_id=1, pid=5862 2024-04-28T02:45:07.095749123Z [2024-04-28T02:45:07.095+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:45:07.095782371Z 2024-04-28T02:45:07.095786796Z [2024-04-28T02:45:07.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:45:07.096283818Z [2024-04-28T02:45:07.096+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:45:07.096321856Z 2024-04-28T02:45:07.098350224Z [2024-04-28T02:45:07.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:45:07.098413574Z [2024-04-28T02:45:07.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:45:07.155587507Z [2024-04-28T02:45:07.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:45:07.165566498Z [2024-04-28T02:45:07.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51bbfce7-4fc5-4c6b-8269-d20705298b29 2024-04-28T02:45:07.248406563Z [2024-04-28T02:45:07.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:45:07.256747075Z [2024-04-28T02:45:07.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=-1, run_start_date=2024-04-28 02:45:06.601701+00:00, run_end_date=2024-04-28 02:45:07.013125+00:00, run_duration=0.411424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:45:04.119115+00:00, queued_by_job_id=1, pid=5904 2024-04-28T02:45:09.053602517Z [2024-04-28T02:45:09.052+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:45:09.053651276Z 2024-04-28T02:45:09.053662788Z [2024-04-28T02:45:09.053+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:45:09.054202891Z [2024-04-28T02:45:09.053+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:45:09.054229165Z 2024-04-28T02:45:09.056670472Z [2024-04-28T02:45:09.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:45:09.056702661Z [2024-04-28T02:45:09.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:45:09.115748681Z [2024-04-28T02:45:09.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status queued for try_number 1 2024-04-28T02:45:09.126162006Z [2024-04-28T02:45:09.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0fe1ebd-feca-4e91-9e18-2f4e9294ca66 2024-04-28T02:45:09.221902545Z [2024-04-28T02:45:09.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:45:09.229537075Z [2024-04-28T02:45:09.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=0, run_start_date=2024-04-28 02:45:08.656245+00:00, run_end_date=2024-04-28 02:45:08.994844+00:00, run_duration=0.338599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:45:07.096496+00:00, queued_by_job_id=1, pid=5916 2024-04-28T02:45:11.350104610Z [2024-04-28T02:45:11.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:45:11.350446302Z [2024-04-28T02:45:11.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:40:00+00:00, run_id=scheduled__2024-04-28T02:40:00+00:00, run_start_date=2024-04-28 02:45:01.147637+00:00, run_end_date=2024-04-28 02:45:11.350020+00:00, run_duration=10.202383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:40:00+00:00, data_interval_end=2024-04-28 02:45:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:45:11.356307506Z [2024-04-28T02:45:11.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:45:00+00:00, run_after=2024-04-28T02:50:00+00:00 2024-04-28T02:45:11.393161545Z [2024-04-28T02:45:11.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:40:00+00:00 exited with status success for try_number 1 2024-04-28T02:45:11.406905513Z [2024-04-28T02:45:11.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:40:00+00:00, map_index=-1, run_start_date=2024-04-28 02:45:10.822926+00:00, run_end_date=2024-04-28 02:45:11.161046+00:00, run_duration=0.33812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:45:09.054504+00:00, queued_by_job_id=1, pid=5928 2024-04-28T02:46:00.549543426Z [2024-04-28T02:46:00.548+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:46:00.560425965Z [2024-04-28T02:46:00.559+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:46:00.589297921Z [2024-04-28T02:46:00.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:46:00+00:00, run_after=2024-04-28T02:47:00+00:00 2024-04-28T02:46:00.668219342Z [2024-04-28T02:46:00.667+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:46:00.668253189Z 2024-04-28T02:46:00.668259673Z 2024-04-28T02:46:00.668264673Z 2024-04-28T02:46:00.668425460Z [2024-04-28T02:46:00.668+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:46:00.668661603Z [2024-04-28T02:46:00.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:46:00.668887150Z [2024-04-28T02:46:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:46:00.669555674Z [2024-04-28T02:46:00.669+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:46:00.669582766Z 2024-04-28T02:46:00.669589190Z 2024-04-28T02:46:00.669596025Z 2024-04-28T02:46:00.673667268Z [2024-04-28T02:46:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:46:00.674082656Z [2024-04-28T02:46:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:46:00.674477086Z [2024-04-28T02:46:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:46:00.674753056Z [2024-04-28T02:46:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:46:00.675136953Z [2024-04-28T02:46:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:46:00.675367314Z [2024-04-28T02:46:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:46:00.935797170Z [2024-04-28T02:46:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:44:00+00:00 exited with status queued for try_number 1 2024-04-28T02:46:00.935884638Z [2024-04-28T02:46:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status queued for try_number 1 2024-04-28T02:46:00.936018465Z [2024-04-28T02:46:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status queued for try_number 1 2024-04-28T02:46:00.947148192Z [2024-04-28T02:46:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05a62bfa-81ca-496e-9319-e13999e31e52 2024-04-28T02:46:00.947335792Z [2024-04-28T02:46:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1285c199-67be-4658-8108-a35df1309730 2024-04-28T02:46:00.947512377Z [2024-04-28T02:46:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to e35526d6-2fee-4776-8503-b29ec2e9a060 2024-04-28T02:46:02.110443692Z [2024-04-28T02:46:02.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:46:02.111012236Z [2024-04-28T02:46:02.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:44:00+00:00, run_id=scheduled__2024-04-28T02:44:00+00:00, run_start_date=2024-04-28 02:46:00.604801+00:00, run_end_date=2024-04-28 02:46:02.110364+00:00, run_duration=1.505563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:44:00+00:00, data_interval_end=2024-04-28 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:46:02.122441723Z [2024-04-28T02:46:02.122+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:46:00+00:00, run_after=2024-04-28T02:48:00+00:00 2024-04-28T02:46:02.172449146Z [2024-04-28T02:46:02.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:44:00+00:00 exited with status success for try_number 1 2024-04-28T02:46:02.185621373Z [2024-04-28T02:46:02.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:44:00+00:00, map_index=-1, run_start_date=2024-04-28 02:46:01.484376+00:00, run_end_date=2024-04-28 02:46:01.882410+00:00, run_duration=0.398034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:46:00.670574+00:00, queued_by_job_id=1, pid=5932 2024-04-28T02:46:04.991493893Z [2024-04-28T02:46:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:46:04.991515889Z [2024-04-28T02:46:04.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:45:00+00:00, run_id=scheduled__2024-04-28T02:45:00+00:00, run_start_date=2024-04-28 02:46:00.608108+00:00, run_end_date=2024-04-28 02:46:04.989569+00:00, run_duration=4.381461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:45:00+00:00, data_interval_end=2024-04-28 02:46:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:46:05.023097682Z [2024-04-28T02:46:05.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:46:00+00:00, run_after=2024-04-28T02:47:00+00:00 2024-04-28T02:46:05.023122006Z [2024-04-28T02:46:05.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:46:05.023127079Z [2024-04-28T02:46:05.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:45:00+00:00, run_id=scheduled__2024-04-28T02:45:00+00:00, run_start_date=2024-04-28 02:46:00.606632+00:00, run_end_date=2024-04-28 02:46:05.017454+00:00, run_duration=4.410822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:45:00+00:00, data_interval_end=2024-04-28 02:46:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:46:05.034738286Z [2024-04-28T02:46:05.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:46:00+00:00, run_after=2024-04-28T02:47:00+00:00 2024-04-28T02:46:05.081294999Z [2024-04-28T02:46:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status success for try_number 1 2024-04-28T02:46:05.081648907Z [2024-04-28T02:46:05.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status success for try_number 1 2024-04-28T02:46:05.096006075Z [2024-04-28T02:46:05.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:45:00+00:00, map_index=-1, run_start_date=2024-04-28 02:46:02.811647+00:00, run_end_date=2024-04-28 02:46:04.670314+00:00, run_duration=1.858667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:46:00.670574+00:00, queued_by_job_id=1, pid=5973 2024-04-28T02:46:05.096343227Z [2024-04-28T02:46:05.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:45:00+00:00, map_index=-1, run_start_date=2024-04-28 02:46:02.568917+00:00, run_end_date=2024-04-28 02:46:03.992794+00:00, run_duration=1.423877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:46:00.670574+00:00, queued_by_job_id=1, pid=5971 2024-04-28T02:46:16.396990283Z [2024-04-28T02:46:16.396+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:47:00.890853363Z [2024-04-28T02:47:00.890+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:47:00.912631009Z [2024-04-28T02:47:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:47:00+00:00, run_after=2024-04-28T02:48:00+00:00 2024-04-28T02:47:00.981248339Z [2024-04-28T02:47:00.980+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:47:00.981286101Z 2024-04-28T02:47:00.981291726Z 2024-04-28T02:47:00.981790874Z [2024-04-28T02:47:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:47:00.982216015Z [2024-04-28T02:47:00.981+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:47:00.983668270Z [2024-04-28T02:47:00.983+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:47:00.983691976Z 2024-04-28T02:47:00.983697581Z 2024-04-28T02:47:00.989177736Z [2024-04-28T02:47:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:47:00.989603694Z [2024-04-28T02:47:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:47:00.990136285Z [2024-04-28T02:47:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:47:00.990575482Z [2024-04-28T02:47:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:47:01.176173033Z [2024-04-28T02:47:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:46:00+00:00 exited with status queued for try_number 1 2024-04-28T02:47:01.176516788Z [2024-04-28T02:47:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:46:00+00:00 exited with status queued for try_number 1 2024-04-28T02:47:01.187331639Z [2024-04-28T02:47:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 258e6f58-e514-4c9a-9ba7-695e6a2adfe5 2024-04-28T02:47:01.187708853Z [2024-04-28T02:47:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa3a09c2-5a29-4875-a32a-f69d06fb7560 2024-04-28T02:47:04.543290282Z [2024-04-28T02:47:04.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:47:04.543718539Z [2024-04-28T02:47:04.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:46:00+00:00, run_id=scheduled__2024-04-28T02:46:00+00:00, run_start_date=2024-04-28 02:47:00.923883+00:00, run_end_date=2024-04-28 02:47:04.543351+00:00, run_duration=3.619468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:46:00+00:00, data_interval_end=2024-04-28 02:47:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:47:04.553932416Z [2024-04-28T02:47:04.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:47:00+00:00, run_after=2024-04-28T02:48:00+00:00 2024-04-28T02:47:04.880455175Z [2024-04-28T02:47:04.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:46:00+00:00 exited with status success for try_number 1 2024-04-28T02:47:04.887572141Z [2024-04-28T02:47:04.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:46:00+00:00, map_index=-1, run_start_date=2024-04-28 02:47:02.779383+00:00, run_end_date=2024-04-28 02:47:04.464394+00:00, run_duration=1.685011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:47:00.985297+00:00, queued_by_job_id=1, pid=6028 2024-04-28T02:47:05.947427581Z [2024-04-28T02:47:05.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:47:05.947717982Z [2024-04-28T02:47:05.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:46:00+00:00, run_id=scheduled__2024-04-28T02:46:00+00:00, run_start_date=2024-04-28 02:47:00.925244+00:00, run_end_date=2024-04-28 02:47:05.947275+00:00, run_duration=5.022031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:46:00+00:00, data_interval_end=2024-04-28 02:47:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:47:05.956679848Z [2024-04-28T02:47:05.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:47:00+00:00, run_after=2024-04-28T02:48:00+00:00 2024-04-28T02:47:06.005430579Z [2024-04-28T02:47:06.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:46:00+00:00 exited with status success for try_number 1 2024-04-28T02:47:06.012367136Z [2024-04-28T02:47:06.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:46:00+00:00, map_index=-1, run_start_date=2024-04-28 02:47:02.699198+00:00, run_end_date=2024-04-28 02:47:05.267209+00:00, run_duration=2.568011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:47:00.985297+00:00, queued_by_job_id=1, pid=6027 2024-04-28T02:48:00.219181559Z [2024-04-28T02:48:00.218+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:48:00.228702542Z [2024-04-28T02:48:00.227+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:48:00.244665766Z [2024-04-28T02:48:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:48:00+00:00, run_after=2024-04-28T02:49:00+00:00 2024-04-28T02:48:00.333201840Z [2024-04-28T02:48:00.332+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:48:00.333241552Z 2024-04-28T02:48:00.333256282Z 2024-04-28T02:48:00.333264790Z 2024-04-28T02:48:00.334300639Z [2024-04-28T02:48:00.333+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:48:00.335064803Z [2024-04-28T02:48:00.334+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:48:00.335541241Z [2024-04-28T02:48:00.335+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:48:00.338846877Z [2024-04-28T02:48:00.338+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:48:00.338924385Z 2024-04-28T02:48:00.338931270Z 2024-04-28T02:48:00.338936499Z 2024-04-28T02:48:00.343557115Z [2024-04-28T02:48:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:48:00.344060665Z [2024-04-28T02:48:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:48:00.344580711Z [2024-04-28T02:48:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:48:00.344925715Z [2024-04-28T02:48:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:48:00.345404213Z [2024-04-28T02:48:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:48:00.345726689Z [2024-04-28T02:48:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:48:00.617140438Z [2024-04-28T02:48:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:46:00+00:00 exited with status queued for try_number 1 2024-04-28T02:48:00.617962905Z [2024-04-28T02:48:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:47:00+00:00 exited with status queued for try_number 1 2024-04-28T02:48:00.618613530Z [2024-04-28T02:48:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:47:00+00:00 exited with status queued for try_number 1 2024-04-28T02:48:00.637449217Z [2024-04-28T02:48:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62ff544f-f7a9-4502-81ab-9631968dff70 2024-04-28T02:48:00.638029025Z [2024-04-28T02:48:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9774a262-3281-47fa-8bbf-07b068743ebe 2024-04-28T02:48:00.638590360Z [2024-04-28T02:48:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8fefd34-66d8-49dc-8bd0-e1dd29e74bf7 2024-04-28T02:48:01.816199263Z [2024-04-28T02:48:01.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:48:01.816233288Z [2024-04-28T02:48:01.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:46:00+00:00, run_id=scheduled__2024-04-28T02:46:00+00:00, run_start_date=2024-04-28 02:48:00.256704+00:00, run_end_date=2024-04-28 02:48:01.815540+00:00, run_duration=1.558836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:46:00+00:00, data_interval_end=2024-04-28 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:48:01.825538674Z [2024-04-28T02:48:01.823+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:48:00+00:00, run_after=2024-04-28T02:50:00+00:00 2024-04-28T02:48:01.873810069Z [2024-04-28T02:48:01.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:46:00+00:00 exited with status success for try_number 1 2024-04-28T02:48:01.889016224Z [2024-04-28T02:48:01.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:46:00+00:00, map_index=-1, run_start_date=2024-04-28 02:48:01.227694+00:00, run_end_date=2024-04-28 02:48:01.542523+00:00, run_duration=0.314829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:48:00.340227+00:00, queued_by_job_id=1, pid=6053 2024-04-28T02:48:04.010231901Z [2024-04-28T02:48:04.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:48:04.010669576Z [2024-04-28T02:48:04.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:47:00+00:00, run_id=scheduled__2024-04-28T02:47:00+00:00, run_start_date=2024-04-28 02:48:00.259480+00:00, run_end_date=2024-04-28 02:48:04.010160+00:00, run_duration=3.75068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:47:00+00:00, data_interval_end=2024-04-28 02:48:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:48:04.019470966Z [2024-04-28T02:48:04.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:48:00+00:00, run_after=2024-04-28T02:49:00+00:00 2024-04-28T02:48:04.025704141Z [2024-04-28T02:48:04.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:48:04.026090793Z [2024-04-28T02:48:04.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:47:00+00:00, run_id=scheduled__2024-04-28T02:47:00+00:00, run_start_date=2024-04-28 02:48:00.258171+00:00, run_end_date=2024-04-28 02:48:04.025632+00:00, run_duration=3.767461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:47:00+00:00, data_interval_end=2024-04-28 02:48:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:48:04.038859837Z [2024-04-28T02:48:04.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:48:00+00:00, run_after=2024-04-28T02:49:00+00:00 2024-04-28T02:48:04.079725038Z [2024-04-28T02:48:04.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:47:00+00:00 exited with status success for try_number 1 2024-04-28T02:48:04.079846882Z [2024-04-28T02:48:04.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:47:00+00:00 exited with status success for try_number 1 2024-04-28T02:48:04.089422496Z [2024-04-28T02:48:04.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:47:00+00:00, map_index=-1, run_start_date=2024-04-28 02:48:02.158145+00:00, run_end_date=2024-04-28 02:48:03.876605+00:00, run_duration=1.71846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:48:00.340227+00:00, queued_by_job_id=1, pid=6093 2024-04-28T02:48:04.089770884Z [2024-04-28T02:48:04.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:47:00+00:00, map_index=-1, run_start_date=2024-04-28 02:48:02.379916+00:00, run_end_date=2024-04-28 02:48:03.633833+00:00, run_duration=1.253917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:48:00.340227+00:00, queued_by_job_id=1, pid=6095 2024-04-28T02:49:00.818222984Z [2024-04-28T02:49:00.817+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:49:00.850369008Z [2024-04-28T02:49:00.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:49:00+00:00, run_after=2024-04-28T02:50:00+00:00 2024-04-28T02:49:00.922765487Z [2024-04-28T02:49:00.922+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:49:00.922800940Z 2024-04-28T02:49:00.922809006Z 2024-04-28T02:49:00.923319072Z [2024-04-28T02:49:00.922+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:49:00.923545032Z [2024-04-28T02:49:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:49:00.924960949Z [2024-04-28T02:49:00.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:49:00.924983851Z 2024-04-28T02:49:00.924991678Z 2024-04-28T02:49:00.934209370Z [2024-04-28T02:49:00.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:49:00.934272664Z [2024-04-28T02:49:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:49:00.935381216Z [2024-04-28T02:49:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:49:00.935709815Z [2024-04-28T02:49:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:49:01.108320251Z [2024-04-28T02:49:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:48:00+00:00 exited with status queued for try_number 1 2024-04-28T02:49:01.108583148Z [2024-04-28T02:49:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:48:00+00:00 exited with status queued for try_number 1 2024-04-28T02:49:01.116621738Z [2024-04-28T02:49:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 844ceff5-788d-4d5b-aad6-ad75678d24c2 2024-04-28T02:49:01.116811438Z [2024-04-28T02:49:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c016d93-b415-4e57-9c9a-efa3b0b6689a 2024-04-28T02:49:04.989651944Z [2024-04-28T02:49:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:49:04.989870403Z [2024-04-28T02:49:04.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:48:00+00:00, run_id=scheduled__2024-04-28T02:48:00+00:00, run_start_date=2024-04-28 02:49:00.864500+00:00, run_end_date=2024-04-28 02:49:04.989576+00:00, run_duration=4.125076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:48:00+00:00, data_interval_end=2024-04-28 02:49:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:49:05.000219574Z [2024-04-28T02:49:04.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:49:00+00:00, run_after=2024-04-28T02:50:00+00:00 2024-04-28T02:49:05.008767465Z [2024-04-28T02:49:05.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:49:05.009006783Z [2024-04-28T02:49:05.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:48:00+00:00, run_id=scheduled__2024-04-28T02:48:00+00:00, run_start_date=2024-04-28 02:49:00.863100+00:00, run_end_date=2024-04-28 02:49:05.008681+00:00, run_duration=4.145581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:48:00+00:00, data_interval_end=2024-04-28 02:49:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:49:05.021702440Z [2024-04-28T02:49:05.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:49:00+00:00, run_after=2024-04-28T02:50:00+00:00 2024-04-28T02:49:05.054122613Z [2024-04-28T02:49:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:48:00+00:00 exited with status success for try_number 1 2024-04-28T02:49:05.054388120Z [2024-04-28T02:49:05.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:48:00+00:00 exited with status success for try_number 1 2024-04-28T02:49:05.061518617Z [2024-04-28T02:49:05.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:48:00+00:00, map_index=-1, run_start_date=2024-04-28 02:49:02.816400+00:00, run_end_date=2024-04-28 02:49:04.697888+00:00, run_duration=1.881488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:49:00.926230+00:00, queued_by_job_id=1, pid=6148 2024-04-28T02:49:05.062025289Z [2024-04-28T02:49:05.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:48:00+00:00, map_index=-1, run_start_date=2024-04-28 02:49:02.919362+00:00, run_end_date=2024-04-28 02:49:04.388342+00:00, run_duration=1.46898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:49:00.926230+00:00, queued_by_job_id=1, pid=6149 2024-04-28T02:50:00.802776080Z [2024-04-28T02:50:00.802+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:50:00.830169610Z [2024-04-28T02:50:00.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:50:00+00:00, run_after=2024-04-28T02:51:00+00:00 2024-04-28T02:50:00.851404673Z [2024-04-28T02:50:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:50:00+00:00, run_after=2024-04-28T02:55:00+00:00 2024-04-28T02:50:00.859766275Z [2024-04-28T02:50:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:50:00.954833075Z [2024-04-28T02:50:00.954+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:50:00.954918840Z 2024-04-28T02:50:00.954923576Z 2024-04-28T02:50:00.954927255Z 2024-04-28T02:50:00.954930405Z 2024-04-28T02:50:00.955059560Z [2024-04-28T02:50:00.954+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:50:00.955299839Z [2024-04-28T02:50:00.955+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:50:00.955504145Z [2024-04-28T02:50:00.955+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:50:00.955715395Z [2024-04-28T02:50:00.955+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:50:00.957811332Z [2024-04-28T02:50:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:50:00.957840518Z 2024-04-28T02:50:00.957877859Z 2024-04-28T02:50:00.957881601Z 2024-04-28T02:50:00.957884698Z 2024-04-28T02:50:00.964109230Z [2024-04-28T02:50:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:50:00.964284380Z [2024-04-28T02:50:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:50:00.964866822Z [2024-04-28T02:50:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:50:00.965089000Z [2024-04-28T02:50:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:50:00.965436671Z [2024-04-28T02:50:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:50:00.965605388Z [2024-04-28T02:50:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:50:00.966021011Z [2024-04-28T02:50:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:50:00.966193584Z [2024-04-28T02:50:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:50:01.494930444Z [2024-04-28T02:50:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:01.495048236Z [2024-04-28T02:50:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:48:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:01.495140147Z [2024-04-28T02:50:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:49:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:01.495168579Z [2024-04-28T02:50:01.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:49:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:01.519807986Z [2024-04-28T02:50:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 038831b3-3144-46d6-bbe2-fda2f1a4a975 2024-04-28T02:50:01.519858945Z [2024-04-28T02:50:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79e43177-0858-44f1-940a-4647a72d78f9 2024-04-28T02:50:01.519894001Z [2024-04-28T02:50:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c476006-4222-4199-b464-23a0f5428df3 2024-04-28T02:50:01.520033747Z [2024-04-28T02:50:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a5d097e-8046-446d-9ad3-6fed080f9d5a 2024-04-28T02:50:03.952884039Z [2024-04-28T02:50:03.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:50:03.953296418Z [2024-04-28T02:50:03.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:48:00+00:00, run_id=scheduled__2024-04-28T02:48:00+00:00, run_start_date=2024-04-28 02:50:00.874138+00:00, run_end_date=2024-04-28 02:50:03.952785+00:00, run_duration=3.078647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:48:00+00:00, data_interval_end=2024-04-28 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:50:03.963704888Z [2024-04-28T02:50:03.963+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:50:00+00:00, run_after=2024-04-28T02:52:00+00:00 2024-04-28T02:50:04.046965932Z [2024-04-28T02:50:04.046+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:50:04.046990170Z 2024-04-28T02:50:04.047033853Z [2024-04-28T02:50:04.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:50:04.047680494Z [2024-04-28T02:50:04.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:50:04.047692336Z 2024-04-28T02:50:04.054348540Z [2024-04-28T02:50:04.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:50:04.054662742Z [2024-04-28T02:50:04.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:50:04.134587171Z [2024-04-28T02:50:04.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:04.134619910Z [2024-04-28T02:50:04.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:04.134716839Z [2024-04-28T02:50:04.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:48:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:04.148581406Z [2024-04-28T02:50:04.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:45:00+00:00, map_index=-1, run_start_date=2024-04-28 02:50:03.404562+00:00, run_end_date=2024-04-28 02:50:03.825235+00:00, run_duration=0.420673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:00.960083+00:00, queued_by_job_id=1, pid=6207 2024-04-28T02:50:04.148696516Z [2024-04-28T02:50:04.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:48:00+00:00, map_index=-1, run_start_date=2024-04-28 02:50:02.341122+00:00, run_end_date=2024-04-28 02:50:02.777658+00:00, run_duration=0.436536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:00.960083+00:00, queued_by_job_id=1, pid=6186 2024-04-28T02:50:04.148958300Z [2024-04-28T02:50:04.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17f5070c-5f54-4d0b-a0a7-b9cff0e7c6ab 2024-04-28T02:50:05.435824589Z [2024-04-28T02:50:05.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:50:05.436120084Z [2024-04-28T02:50:05.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:49:00+00:00, run_id=scheduled__2024-04-28T02:49:00+00:00, run_start_date=2024-04-28 02:50:00.875396+00:00, run_end_date=2024-04-28 02:50:05.435826+00:00, run_duration=4.56043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:49:00+00:00, data_interval_end=2024-04-28 02:50:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:50:05.458114587Z [2024-04-28T02:50:05.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:50:00+00:00, run_after=2024-04-28T02:51:00+00:00 2024-04-28T02:50:05.477671459Z [2024-04-28T02:50:05.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:50:05.490611050Z [2024-04-28T02:50:05.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:49:00+00:00, run_id=scheduled__2024-04-28T02:49:00+00:00, run_start_date=2024-04-28 02:50:00.876570+00:00, run_end_date=2024-04-28 02:50:05.490064+00:00, run_duration=4.613494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:49:00+00:00, data_interval_end=2024-04-28 02:50:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:50:05.513347802Z [2024-04-28T02:50:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:50:00+00:00, run_after=2024-04-28T02:51:00+00:00 2024-04-28T02:50:06.747303803Z [2024-04-28T02:50:06.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:50:06.747351879Z 2024-04-28T02:50:06.747362111Z [2024-04-28T02:50:06.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:50:06.747648783Z [2024-04-28T02:50:06.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:50:06.747670503Z 2024-04-28T02:50:06.750347644Z [2024-04-28T02:50:06.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:50:06.750367203Z [2024-04-28T02:50:06.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:50:06.804361518Z [2024-04-28T02:50:06.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:06.804760067Z [2024-04-28T02:50:06.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:49:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:06.805282253Z [2024-04-28T02:50:06.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:49:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:06.805744173Z [2024-04-28T02:50:06.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:06.816584267Z [2024-04-28T02:50:06.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 791a3bdf-e81e-46ed-92aa-7065411aa377 2024-04-28T02:50:06.817005783Z [2024-04-28T02:50:06.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:49:00+00:00, map_index=-1, run_start_date=2024-04-28 02:50:03.716749+00:00, run_end_date=2024-04-28 02:50:05.376602+00:00, run_duration=1.659853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:00.960083+00:00, queued_by_job_id=1, pid=6236 2024-04-28T02:50:06.817456687Z [2024-04-28T02:50:06.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:45:00+00:00, map_index=-1, run_start_date=2024-04-28 02:50:06.052122+00:00, run_end_date=2024-04-28 02:50:06.362036+00:00, run_duration=0.309914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:04.049818+00:00, queued_by_job_id=1, pid=6269 2024-04-28T02:50:06.817895274Z [2024-04-28T02:50:06.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:49:00+00:00, map_index=-1, run_start_date=2024-04-28 02:50:03.683003+00:00, run_end_date=2024-04-28 02:50:05.354434+00:00, run_duration=1.671431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:00.960083+00:00, queued_by_job_id=1, pid=6226 2024-04-28T02:50:09.607881507Z [2024-04-28T02:50:09.607+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:50:09.607912414Z 2024-04-28T02:50:09.607964854Z [2024-04-28T02:50:09.607+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:50:09.608503068Z [2024-04-28T02:50:09.608+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:50:09.608515081Z 2024-04-28T02:50:09.610724506Z [2024-04-28T02:50:09.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:50:09.610909303Z [2024-04-28T02:50:09.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:50:09.700422128Z [2024-04-28T02:50:09.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status queued for try_number 1 2024-04-28T02:50:09.700450714Z [2024-04-28T02:50:09.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:09.706774171Z [2024-04-28T02:50:09.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48d0dee1-da07-4ec5-a4ce-e313f26d603f 2024-04-28T02:50:09.706983353Z [2024-04-28T02:50:09.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:45:00+00:00, map_index=0, run_start_date=2024-04-28 02:50:08.538536+00:00, run_end_date=2024-04-28 02:50:08.933428+00:00, run_duration=0.394892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:06.748004+00:00, queued_by_job_id=1, pid=6281 2024-04-28T02:50:12.688705927Z [2024-04-28T02:50:12.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:50:12.689247176Z [2024-04-28T02:50:12.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:45:00+00:00, run_id=scheduled__2024-04-28T02:45:00+00:00, run_start_date=2024-04-28 02:50:00.872772+00:00, run_end_date=2024-04-28 02:50:12.688615+00:00, run_duration=11.815843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:45:00+00:00, data_interval_end=2024-04-28 02:50:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:50:12.698046953Z [2024-04-28T02:50:12.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:50:00+00:00, run_after=2024-04-28T02:55:00+00:00 2024-04-28T02:50:12.733777472Z [2024-04-28T02:50:12.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:45:00+00:00 exited with status success for try_number 1 2024-04-28T02:50:12.739303656Z [2024-04-28T02:50:12.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:45:00+00:00, map_index=-1, run_start_date=2024-04-28 02:50:11.424631+00:00, run_end_date=2024-04-28 02:50:11.812078+00:00, run_duration=0.387447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:50:09.608870+00:00, queued_by_job_id=1, pid=6293 2024-04-28T02:51:00.859557890Z [2024-04-28T02:51:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:51:00.871888614Z [2024-04-28T02:51:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:51:00+00:00, run_after=2024-04-28T02:52:00+00:00 2024-04-28T02:51:00.942257178Z [2024-04-28T02:51:00.941+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:51:00.942288910Z 2024-04-28T02:51:00.942294127Z 2024-04-28T02:51:00.942482593Z [2024-04-28T02:51:00.942+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:51:00.942759201Z [2024-04-28T02:51:00.942+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:51:00.943580836Z [2024-04-28T02:51:00.943+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:51:00.943592944Z 2024-04-28T02:51:00.943598044Z 2024-04-28T02:51:00.947750062Z [2024-04-28T02:51:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:51:00.947924818Z [2024-04-28T02:51:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:51:00.948274243Z [2024-04-28T02:51:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:51:00.948451273Z [2024-04-28T02:51:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:51:01.133424133Z [2024-04-28T02:51:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:51:01.133565837Z [2024-04-28T02:51:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:51:01.146714892Z [2024-04-28T02:51:01.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cd7eeca-5457-42cf-a605-d04ec090a4b2 2024-04-28T02:51:01.146865115Z [2024-04-28T02:51:01.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6839da6-ab12-47ce-94ce-0328a3fcc4b7 2024-04-28T02:51:04.968014998Z [2024-04-28T02:51:04.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:51:04.968033929Z [2024-04-28T02:51:04.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:50:00+00:00, run_id=scheduled__2024-04-28T02:50:00+00:00, run_start_date=2024-04-28 02:51:00.884446+00:00, run_end_date=2024-04-28 02:51:04.967077+00:00, run_duration=4.082631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:50:00+00:00, data_interval_end=2024-04-28 02:51:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:51:04.977722273Z [2024-04-28T02:51:04.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:51:00+00:00, run_after=2024-04-28T02:52:00+00:00 2024-04-28T02:51:04.988407225Z [2024-04-28T02:51:04.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:51:04.988813525Z [2024-04-28T02:51:04.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:50:00+00:00, run_id=scheduled__2024-04-28T02:50:00+00:00, run_start_date=2024-04-28 02:51:00.882877+00:00, run_end_date=2024-04-28 02:51:04.988518+00:00, run_duration=4.105641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:50:00+00:00, data_interval_end=2024-04-28 02:51:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:51:05.021670322Z [2024-04-28T02:51:05.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:51:00+00:00, run_after=2024-04-28T02:52:00+00:00 2024-04-28T02:51:05.131096189Z [2024-04-28T02:51:05.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:51:05.139609369Z [2024-04-28T02:51:05.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:51:02.908153+00:00, run_end_date=2024-04-28 02:51:04.656327+00:00, run_duration=1.748174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:51:00.944377+00:00, queued_by_job_id=1, pid=6327 2024-04-28T02:51:06.210433044Z [2024-04-28T02:51:06.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:51:06.216213500Z [2024-04-28T02:51:06.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:51:02.857331+00:00, run_end_date=2024-04-28 02:51:04.917802+00:00, run_duration=2.060471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:51:00.944377+00:00, queued_by_job_id=1, pid=6326 2024-04-28T02:51:16.479008649Z [2024-04-28T02:51:16.478+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:52:00.785112146Z [2024-04-28T02:52:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:52:00+00:00, run_after=2024-04-28T02:53:00+00:00 2024-04-28T02:52:00.792689755Z [2024-04-28T02:52:00.792+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:52:00.800623161Z [2024-04-28T02:52:00.800+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:52:00.861685798Z [2024-04-28T02:52:00.861+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:52:00.861720337Z 2024-04-28T02:52:00.861727645Z 2024-04-28T02:52:00.861733703Z 2024-04-28T02:52:00.861995688Z [2024-04-28T02:52:00.861+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:52:00.862304163Z [2024-04-28T02:52:00.862+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:52:00.862679296Z [2024-04-28T02:52:00.862+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:52:00.864132525Z [2024-04-28T02:52:00.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:52:00.864148167Z 2024-04-28T02:52:00.864167631Z 2024-04-28T02:52:00.864173555Z 2024-04-28T02:52:00.870207168Z [2024-04-28T02:52:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:52:00.870653190Z [2024-04-28T02:52:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:52:00.871264047Z [2024-04-28T02:52:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:52:00.871578098Z [2024-04-28T02:52:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:52:00.872040154Z [2024-04-28T02:52:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:52:00.872226507Z [2024-04-28T02:52:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:52:01.086745276Z [2024-04-28T02:52:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:52:01.086809575Z [2024-04-28T02:52:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:51:00+00:00 exited with status queued for try_number 1 2024-04-28T02:52:01.086889717Z [2024-04-28T02:52:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:51:00+00:00 exited with status queued for try_number 1 2024-04-28T02:52:01.098711719Z [2024-04-28T02:52:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to 739b095e-f25e-4cf7-9673-6f270d9a5b2a 2024-04-28T02:52:01.098806412Z [2024-04-28T02:52:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f0e2ac6-02af-4e3e-bc10-c20612bdff5f 2024-04-28T02:52:01.098946021Z [2024-04-28T02:52:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f171690-7ee6-44e8-95f1-81b44a656aa5 2024-04-28T02:52:02.260851364Z [2024-04-28T02:52:02.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:52:02.261258561Z [2024-04-28T02:52:02.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:50:00+00:00, run_id=scheduled__2024-04-28T02:50:00+00:00, run_start_date=2024-04-28 02:52:00.810201+00:00, run_end_date=2024-04-28 02:52:02.260768+00:00, run_duration=1.450567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:50:00+00:00, data_interval_end=2024-04-28 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:52:02.268314317Z [2024-04-28T02:52:02.268+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:52:00+00:00, run_after=2024-04-28T02:54:00+00:00 2024-04-28T02:52:02.311625499Z [2024-04-28T02:52:02.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:52:02.317998599Z [2024-04-28T02:52:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:52:01.605307+00:00, run_end_date=2024-04-28 02:52:02.023324+00:00, run_duration=0.418017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:52:00.865670+00:00, queued_by_job_id=1, pid=6352 2024-04-28T02:52:04.700859733Z [2024-04-28T02:52:04.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:52:04.701141295Z [2024-04-28T02:52:04.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:51:00+00:00, run_id=scheduled__2024-04-28T02:51:00+00:00, run_start_date=2024-04-28 02:52:00.811491+00:00, run_end_date=2024-04-28 02:52:04.700742+00:00, run_duration=3.889251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:51:00+00:00, data_interval_end=2024-04-28 02:52:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:52:04.710259222Z [2024-04-28T02:52:04.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:52:00+00:00, run_after=2024-04-28T02:53:00+00:00 2024-04-28T02:52:04.754055459Z [2024-04-28T02:52:04.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:51:00+00:00 exited with status success for try_number 1 2024-04-28T02:52:04.761268767Z [2024-04-28T02:52:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:51:00+00:00, map_index=-1, run_start_date=2024-04-28 02:52:02.919922+00:00, run_end_date=2024-04-28 02:52:04.135799+00:00, run_duration=1.215877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:52:00.865670+00:00, queued_by_job_id=1, pid=6390 2024-04-28T02:52:05.824943764Z [2024-04-28T02:52:05.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:52:05.824989114Z [2024-04-28T02:52:05.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:51:00+00:00, run_id=scheduled__2024-04-28T02:51:00+00:00, run_start_date=2024-04-28 02:52:00.812512+00:00, run_end_date=2024-04-28 02:52:05.824310+00:00, run_duration=5.011798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:51:00+00:00, data_interval_end=2024-04-28 02:52:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:52:05.835760573Z [2024-04-28T02:52:05.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:52:00+00:00, run_after=2024-04-28T02:53:00+00:00 2024-04-28T02:52:05.877012052Z [2024-04-28T02:52:05.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:51:00+00:00 exited with status success for try_number 1 2024-04-28T02:52:05.885209130Z [2024-04-28T02:52:05.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:51:00+00:00, map_index=-1, run_start_date=2024-04-28 02:52:03.161474+00:00, run_end_date=2024-04-28 02:52:04.905643+00:00, run_duration=1.744169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:52:00.865670+00:00, queued_by_job_id=1, pid=6393 2024-04-28T02:53:00.565002423Z [2024-04-28T02:53:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:53:00.584823343Z [2024-04-28T02:53:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:53:00+00:00, run_after=2024-04-28T02:54:00+00:00 2024-04-28T02:53:00.649844164Z [2024-04-28T02:53:00.649+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:53:00.649875783Z 2024-04-28T02:53:00.649881402Z 2024-04-28T02:53:00.650075564Z [2024-04-28T02:53:00.649+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:53:00.650475345Z [2024-04-28T02:53:00.650+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:53:00.651966749Z [2024-04-28T02:53:00.651+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:53:00.651985594Z 2024-04-28T02:53:00.651991706Z 2024-04-28T02:53:00.656999666Z [2024-04-28T02:53:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:53:00.657421072Z [2024-04-28T02:53:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:53:00.658616399Z [2024-04-28T02:53:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:53:00.658903557Z [2024-04-28T02:53:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:53:00.817378415Z [2024-04-28T02:53:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:52:00+00:00 exited with status queued for try_number 1 2024-04-28T02:53:00.817521472Z [2024-04-28T02:53:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:52:00+00:00 exited with status queued for try_number 1 2024-04-28T02:53:00.829458719Z [2024-04-28T02:53:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6c3284c-bdfe-4fa7-9d07-02159119f597 2024-04-28T02:53:00.829530151Z [2024-04-28T02:53:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f00d465-80d0-4cbb-ba71-6111f60ebc31 2024-04-28T02:53:04.041695488Z [2024-04-28T02:53:04.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:53:04.042223938Z [2024-04-28T02:53:04.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:52:00+00:00, run_id=scheduled__2024-04-28T02:52:00+00:00, run_start_date=2024-04-28 02:53:00.601227+00:00, run_end_date=2024-04-28 02:53:04.041735+00:00, run_duration=3.440508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:52:00+00:00, data_interval_end=2024-04-28 02:53:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:53:04.052246491Z [2024-04-28T02:53:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:53:00+00:00, run_after=2024-04-28T02:54:00+00:00 2024-04-28T02:53:04.095385344Z [2024-04-28T02:53:04.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:52:00+00:00 exited with status success for try_number 1 2024-04-28T02:53:04.103126867Z [2024-04-28T02:53:04.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:52:00+00:00, map_index=-1, run_start_date=2024-04-28 02:53:02.451231+00:00, run_end_date=2024-04-28 02:53:03.878116+00:00, run_duration=1.426885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:53:00.653071+00:00, queued_by_job_id=1, pid=6447 2024-04-28T02:53:05.906736321Z [2024-04-28T02:53:05.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:53:05.907267321Z [2024-04-28T02:53:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:52:00+00:00, run_id=scheduled__2024-04-28T02:52:00+00:00, run_start_date=2024-04-28 02:53:00.602815+00:00, run_end_date=2024-04-28 02:53:05.906664+00:00, run_duration=5.303849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:52:00+00:00, data_interval_end=2024-04-28 02:53:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:53:05.923793891Z [2024-04-28T02:53:05.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:53:00+00:00, run_after=2024-04-28T02:54:00+00:00 2024-04-28T02:53:05.972389613Z [2024-04-28T02:53:05.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:52:00+00:00 exited with status success for try_number 1 2024-04-28T02:53:05.979579254Z [2024-04-28T02:53:05.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:52:00+00:00, map_index=-1, run_start_date=2024-04-28 02:53:02.539238+00:00, run_end_date=2024-04-28 02:53:05.181210+00:00, run_duration=2.641972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:53:00.653071+00:00, queued_by_job_id=1, pid=6448 2024-04-28T02:54:00.964574792Z [2024-04-28T02:54:00.964+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:54:00.978727236Z [2024-04-28T02:54:00.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:54:00+00:00, run_after=2024-04-28T02:55:00+00:00 2024-04-28T02:54:00.988761630Z [2024-04-28T02:54:00.988+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:54:01.080398846Z [2024-04-28T02:54:01.079+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:54:01.080449891Z 2024-04-28T02:54:01.080456106Z 2024-04-28T02:54:01.080477081Z 2024-04-28T02:54:01.080603241Z [2024-04-28T02:54:01.080+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:54:01.081011395Z [2024-04-28T02:54:01.080+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:54:01.081449239Z [2024-04-28T02:54:01.081+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:54:01.083983418Z [2024-04-28T02:54:01.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:54:01.084000291Z 2024-04-28T02:54:01.084005749Z 2024-04-28T02:54:01.084032538Z 2024-04-28T02:54:01.091007311Z [2024-04-28T02:54:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:54:01.091159095Z [2024-04-28T02:54:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:54:01.091453542Z [2024-04-28T02:54:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:54:01.091702115Z [2024-04-28T02:54:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:54:01.092026758Z [2024-04-28T02:54:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:54:01.092177320Z [2024-04-28T02:54:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:54:01.346580533Z [2024-04-28T02:54:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:52:00+00:00 exited with status queued for try_number 1 2024-04-28T02:54:01.346645934Z [2024-04-28T02:54:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:53:00+00:00 exited with status queued for try_number 1 2024-04-28T02:54:01.346704943Z [2024-04-28T02:54:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:53:00+00:00 exited with status queued for try_number 1 2024-04-28T02:54:01.370922444Z [2024-04-28T02:54:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 034bc1f1-cbff-4d33-9d23-b47458506bf9 2024-04-28T02:54:01.371526322Z [2024-04-28T02:54:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 905da852-1b9d-4632-8616-e36cda9b2974 2024-04-28T02:54:01.371815367Z [2024-04-28T02:54:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7b98e02-80bd-4945-ad5c-3d28e647503e 2024-04-28T02:54:03.026654793Z [2024-04-28T02:54:03.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:54:03.027826050Z [2024-04-28T02:54:03.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:52:00+00:00, run_id=scheduled__2024-04-28T02:52:00+00:00, run_start_date=2024-04-28 02:54:01.005862+00:00, run_end_date=2024-04-28 02:54:03.027390+00:00, run_duration=2.021528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:52:00+00:00, data_interval_end=2024-04-28 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:54:03.036996694Z [2024-04-28T02:54:03.036+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:54:00+00:00, run_after=2024-04-28T02:56:00+00:00 2024-04-28T02:54:03.104498032Z [2024-04-28T02:54:03.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:52:00+00:00 exited with status success for try_number 1 2024-04-28T02:54:03.114839357Z [2024-04-28T02:54:03.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:52:00+00:00, map_index=-1, run_start_date=2024-04-28 02:54:01.932555+00:00, run_end_date=2024-04-28 02:54:02.335966+00:00, run_duration=0.403411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:54:01.086669+00:00, queued_by_job_id=1, pid=6482 2024-04-28T02:54:05.644732251Z [2024-04-28T02:54:05.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:54:05.645113250Z [2024-04-28T02:54:05.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:53:00+00:00, run_id=scheduled__2024-04-28T02:53:00+00:00, run_start_date=2024-04-28 02:54:01.009488+00:00, run_end_date=2024-04-28 02:54:05.644816+00:00, run_duration=4.635328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:53:00+00:00, data_interval_end=2024-04-28 02:54:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:54:05.667323165Z [2024-04-28T02:54:05.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:54:00+00:00, run_after=2024-04-28T02:55:00+00:00 2024-04-28T02:54:05.683832001Z [2024-04-28T02:54:05.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:54:05.684413577Z [2024-04-28T02:54:05.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:53:00+00:00, run_id=scheduled__2024-04-28T02:53:00+00:00, run_start_date=2024-04-28 02:54:01.008171+00:00, run_end_date=2024-04-28 02:54:05.684088+00:00, run_duration=4.675917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:53:00+00:00, data_interval_end=2024-04-28 02:54:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:54:05.715465329Z [2024-04-28T02:54:05.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:54:00+00:00, run_after=2024-04-28T02:55:00+00:00 2024-04-28T02:54:05.759534261Z [2024-04-28T02:54:05.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:53:00+00:00 exited with status success for try_number 1 2024-04-28T02:54:05.759739928Z [2024-04-28T02:54:05.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:53:00+00:00 exited with status success for try_number 1 2024-04-28T02:54:05.768703072Z [2024-04-28T02:54:05.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:53:00+00:00, map_index=-1, run_start_date=2024-04-28 02:54:03.166089+00:00, run_end_date=2024-04-28 02:54:05.493565+00:00, run_duration=2.327476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:54:01.086669+00:00, queued_by_job_id=1, pid=6512 2024-04-28T02:54:05.769273054Z [2024-04-28T02:54:05.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:53:00+00:00, map_index=-1, run_start_date=2024-04-28 02:54:03.183132+00:00, run_end_date=2024-04-28 02:54:04.927368+00:00, run_duration=1.744236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:54:01.086669+00:00, queued_by_job_id=1, pid=6513 2024-04-28T02:55:01.036486175Z [2024-04-28T02:55:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:55:01.056016911Z [2024-04-28T02:55:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T02:56:00+00:00 2024-04-28T02:55:01.066020592Z [2024-04-28T02:55:01.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:55:01.140919170Z [2024-04-28T02:55:01.140+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:55:01.140999928Z 2024-04-28T02:55:01.141010900Z 2024-04-28T02:55:01.141019464Z 2024-04-28T02:55:01.141028459Z [2024-04-28T02:55:01.140+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:55:01.141036929Z [2024-04-28T02:55:01.140+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:55:01.141045197Z [2024-04-28T02:55:01.140+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:55:01.141587029Z [2024-04-28T02:55:01.141+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:55:01.141608502Z 2024-04-28T02:55:01.141623602Z 2024-04-28T02:55:01.141632349Z 2024-04-28T02:55:01.144629469Z [2024-04-28T02:55:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:55:01.144662855Z [2024-04-28T02:55:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:55:01.144891016Z [2024-04-28T02:55:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:55:01.144905234Z [2024-04-28T02:55:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:55:01.145123250Z [2024-04-28T02:55:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:55:01.145156550Z [2024-04-28T02:55:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:55:01.411898844Z [2024-04-28T02:55:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:55:01.412284606Z [2024-04-28T02:55:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:54:00+00:00 exited with status queued for try_number 1 2024-04-28T02:55:01.412507899Z [2024-04-28T02:55:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:54:00+00:00 exited with status queued for try_number 1 2024-04-28T02:55:01.422173738Z [2024-04-28T02:55:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73b7bd29-e7a2-449c-9c79-bad4d1f806bd 2024-04-28T02:55:01.423018471Z [2024-04-28T02:55:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fb68ba1-6cc7-4e88-9bc4-6bdf4feb59c8 2024-04-28T02:55:01.423288635Z [2024-04-28T02:55:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 740b15f3-dd3a-4e54-ba54-0ea1a166b7bd 2024-04-28T02:55:03.821772784Z [2024-04-28T02:55:03.821+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:55:03.821815410Z 2024-04-28T02:55:03.821894029Z [2024-04-28T02:55:03.821+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:55:03.822497464Z [2024-04-28T02:55:03.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:55:03.822517533Z 2024-04-28T02:55:03.825206998Z [2024-04-28T02:55:03.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:55:03.825456235Z [2024-04-28T02:55:03.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:55:03.885844543Z [2024-04-28T02:55:03.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:55:03.886136313Z [2024-04-28T02:55:03.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:55:03.892377795Z [2024-04-28T02:55:03.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 238d2169-7a81-4266-b3b5-5d4ef8111941 2024-04-28T02:55:03.892645580Z [2024-04-28T02:55:03.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:55:03.118131+00:00, run_end_date=2024-04-28 02:55:03.571918+00:00, run_duration=0.453787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:55:01.142013+00:00, queued_by_job_id=1, pid=6578 2024-04-28T02:55:05.074510718Z [2024-04-28T02:55:05.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:55:05.075047019Z [2024-04-28T02:55:05.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:54:00+00:00, run_id=scheduled__2024-04-28T02:54:00+00:00, run_start_date=2024-04-28 02:55:01.081416+00:00, run_end_date=2024-04-28 02:55:05.074684+00:00, run_duration=3.993268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:54:00+00:00, data_interval_end=2024-04-28 02:55:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:55:05.103454091Z [2024-04-28T02:55:05.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T02:56:00+00:00 2024-04-28T02:55:05.116200414Z [2024-04-28T02:55:05.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:55:05.116583150Z [2024-04-28T02:55:05.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:54:00+00:00, run_id=scheduled__2024-04-28T02:54:00+00:00, run_start_date=2024-04-28 02:55:01.080235+00:00, run_end_date=2024-04-28 02:55:05.116128+00:00, run_duration=4.035893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:54:00+00:00, data_interval_end=2024-04-28 02:55:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:55:05.127771535Z [2024-04-28T02:55:05.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T02:56:00+00:00 2024-04-28T02:55:05.195662411Z [2024-04-28T02:55:05.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:54:00+00:00 exited with status success for try_number 1 2024-04-28T02:55:05.196021263Z [2024-04-28T02:55:05.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:54:00+00:00 exited with status success for try_number 1 2024-04-28T02:55:05.203996002Z [2024-04-28T02:55:05.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:54:00+00:00, map_index=-1, run_start_date=2024-04-28 02:55:03.120076+00:00, run_end_date=2024-04-28 02:55:04.861788+00:00, run_duration=1.741712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:55:01.142013+00:00, queued_by_job_id=1, pid=6577 2024-04-28T02:55:05.204430799Z [2024-04-28T02:55:05.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:54:00+00:00, map_index=-1, run_start_date=2024-04-28 02:55:03.228345+00:00, run_end_date=2024-04-28 02:55:04.862888+00:00, run_duration=1.634543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:55:01.142013+00:00, queued_by_job_id=1, pid=6579 2024-04-28T02:55:07.369962989Z [2024-04-28T02:55:07.369+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:55:07.370002062Z 2024-04-28T02:55:07.370083560Z [2024-04-28T02:55:07.369+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:55:07.371085864Z [2024-04-28T02:55:07.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:55:07.371101803Z 2024-04-28T02:55:07.374093058Z [2024-04-28T02:55:07.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:55:07.374185715Z [2024-04-28T02:55:07.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:55:07.436127283Z [2024-04-28T02:55:07.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:55:07.436216526Z [2024-04-28T02:55:07.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:55:07.450084487Z [2024-04-28T02:55:07.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 940f1b98-b2a1-46fd-8dca-11730f8a60a4 2024-04-28T02:55:07.450550648Z [2024-04-28T02:55:07.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:55:05.937501+00:00, run_end_date=2024-04-28 02:55:06.267044+00:00, run_duration=0.329543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:55:03.822813+00:00, queued_by_job_id=1, pid=6621 2024-04-28T02:55:09.762660948Z [2024-04-28T02:55:09.762+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:55:09.762719627Z 2024-04-28T02:55:09.762752373Z [2024-04-28T02:55:09.762+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:55:09.763532072Z [2024-04-28T02:55:09.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:55:09.763554301Z 2024-04-28T02:55:09.766919431Z [2024-04-28T02:55:09.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:55:09.767248930Z [2024-04-28T02:55:09.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:55:09.827252149Z [2024-04-28T02:55:09.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:55:09.828007894Z [2024-04-28T02:55:09.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:55:09.835664289Z [2024-04-28T02:55:09.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4933557f-335c-467e-9eb5-4468799a96f6 2024-04-28T02:55:09.836493928Z [2024-04-28T02:55:09.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=0, run_start_date=2024-04-28 02:55:09.014645+00:00, run_end_date=2024-04-28 02:55:09.319775+00:00, run_duration=0.30513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:55:07.371571+00:00, queued_by_job_id=1, pid=6633 2024-04-28T02:55:12.058465637Z [2024-04-28T02:55:12.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:55:12.058809600Z [2024-04-28T02:55:12.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:50:00+00:00, run_id=scheduled__2024-04-28T02:50:00+00:00, run_start_date=2024-04-28 02:55:01.078887+00:00, run_end_date=2024-04-28 02:55:12.058324+00:00, run_duration=10.979437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:50:00+00:00, data_interval_end=2024-04-28 02:55:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T02:55:12.064662619Z [2024-04-28T02:55:12.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:55:12.097196773Z [2024-04-28T02:55:12.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:55:12.103356299Z [2024-04-28T02:55:12.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:55:11.484567+00:00, run_end_date=2024-04-28 02:55:11.837136+00:00, run_duration=0.352569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:55:09.764584+00:00, queued_by_job_id=1, pid=6645 2024-04-28T02:56:00.949053610Z [2024-04-28T02:56:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:56:00+00:00, run_after=2024-04-28T02:57:00+00:00 2024-04-28T02:56:00.961925434Z [2024-04-28T02:56:00.961+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:56:00.969076336Z [2024-04-28T02:56:00.968+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:56:01.051006466Z [2024-04-28T02:56:01.050+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T02:56:01.051039289Z 2024-04-28T02:56:01.051050914Z 2024-04-28T02:56:01.051056107Z 2024-04-28T02:56:01.051425538Z [2024-04-28T02:56:01.051+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:56:01.051838696Z [2024-04-28T02:56:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:56:01.052230677Z [2024-04-28T02:56:01.052+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:56:01.053226106Z [2024-04-28T02:56:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:56:01.053242181Z 2024-04-28T02:56:01.053259123Z 2024-04-28T02:56:01.053264175Z 2024-04-28T02:56:01.057792346Z [2024-04-28T02:56:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:56:01.058148167Z [2024-04-28T02:56:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:56:01.058591101Z [2024-04-28T02:56:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:56:01.058849467Z [2024-04-28T02:56:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:56:01.059207274Z [2024-04-28T02:56:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:56:01.059402937Z [2024-04-28T02:56:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:56:01.331448969Z [2024-04-28T02:56:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:54:00+00:00 exited with status queued for try_number 1 2024-04-28T02:56:01.331807201Z [2024-04-28T02:56:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status queued for try_number 1 2024-04-28T02:56:01.332030882Z [2024-04-28T02:56:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status queued for try_number 1 2024-04-28T02:56:01.341272562Z [2024-04-28T02:56:01.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb363dfe-2d6d-4f71-9df7-1f305dad65a3 2024-04-28T02:56:01.341564645Z [2024-04-28T02:56:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99993d2a-c552-461c-af3a-35fd53b1392c 2024-04-28T02:56:01.341758877Z [2024-04-28T02:56:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f61adf3-d246-46a0-a4d5-81bfface90fc 2024-04-28T02:56:02.531993275Z [2024-04-28T02:56:02.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:56:02.532674874Z [2024-04-28T02:56:02.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:54:00+00:00, run_id=scheduled__2024-04-28T02:54:00+00:00, run_start_date=2024-04-28 02:56:00.980621+00:00, run_end_date=2024-04-28 02:56:02.532145+00:00, run_duration=1.551524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:54:00+00:00, data_interval_end=2024-04-28 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:56:02.542893072Z [2024-04-28T02:56:02.542+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:56:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:56:02.590971491Z [2024-04-28T02:56:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:54:00+00:00 exited with status success for try_number 1 2024-04-28T02:56:02.612053835Z [2024-04-28T02:56:02.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:54:00+00:00, map_index=-1, run_start_date=2024-04-28 02:56:01.830840+00:00, run_end_date=2024-04-28 02:56:02.245787+00:00, run_duration=0.414947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:56:01.054530+00:00, queued_by_job_id=1, pid=6659 2024-04-28T02:56:05.474410928Z [2024-04-28T02:56:05.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:56:05.476433511Z [2024-04-28T02:56:05.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:55:00+00:00, run_id=scheduled__2024-04-28T02:55:00+00:00, run_start_date=2024-04-28 02:56:00.981935+00:00, run_end_date=2024-04-28 02:56:05.474318+00:00, run_duration=4.492383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:55:00+00:00, data_interval_end=2024-04-28 02:56:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:56:05.491476385Z [2024-04-28T02:56:05.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:56:00+00:00, run_after=2024-04-28T02:57:00+00:00 2024-04-28T02:56:05.505705533Z [2024-04-28T02:56:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:56:05.505992971Z [2024-04-28T02:56:05.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:55:00+00:00, run_id=scheduled__2024-04-28T02:55:00+00:00, run_start_date=2024-04-28 02:56:00.983250+00:00, run_end_date=2024-04-28 02:56:05.505617+00:00, run_duration=4.522367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:55:00+00:00, data_interval_end=2024-04-28 02:56:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:56:05.522184239Z [2024-04-28T02:56:05.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:56:00+00:00, run_after=2024-04-28T02:57:00+00:00 2024-04-28T02:56:05.557993931Z [2024-04-28T02:56:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status success for try_number 1 2024-04-28T02:56:05.558065313Z [2024-04-28T02:56:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status success for try_number 1 2024-04-28T02:56:05.567422036Z [2024-04-28T02:56:05.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:55:00+00:00, map_index=-1, run_start_date=2024-04-28 02:56:03.273666+00:00, run_end_date=2024-04-28 02:56:05.012762+00:00, run_duration=1.739096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:56:01.054530+00:00, queued_by_job_id=1, pid=6690 2024-04-28T02:56:05.567919500Z [2024-04-28T02:56:05.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:55:00+00:00, map_index=-1, run_start_date=2024-04-28 02:56:03.114519+00:00, run_end_date=2024-04-28 02:56:05.311104+00:00, run_duration=2.196585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:56:01.054530+00:00, queued_by_job_id=1, pid=6689 2024-04-28T02:56:16.559153061Z [2024-04-28T02:56:16.558+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T02:56:24.234184594Z [2024-04-28T02:56:24.233+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:56:24.234219326Z 2024-04-28T02:56:24.234292342Z [2024-04-28T02:56:24.234+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-28T02:56:24.234923402Z [2024-04-28T02:56:24.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:56:24.234935515Z 2024-04-28T02:56:24.237724695Z [2024-04-28T02:56:24.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240428025623_467522', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:56:24.237919147Z [2024-04-28T02:56:24.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240428025623_467522', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-28T02:56:24.326206904Z [2024-04-28T02:56:24.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240428025623_467522 exited with status queued for try_number 1 2024-04-28T02:56:24.332296637Z [2024-04-28T02:56:24.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fbbe05e-b6be-4635-86d0-8dbb7ff06161 2024-04-28T02:56:26.261938352Z [2024-04-28T02:56:26.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:56:26.262883332Z [2024-04-28T02:56:26.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-28 02:56:23.819521+00:00, run_id=vdu_down_20240428025623_467522, run_start_date=2024-04-28 02:56:24.185099+00:00, run_end_date=2024-04-28 02:56:26.262191+00:00, run_duration=2.077092, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 02:56:23.819521+00:00, data_interval_end=2024-04-28 02:56:23.819521+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-28T02:56:26.270755280Z [2024-04-28T02:56:26.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-28T02:56:26.347983889Z [2024-04-28T02:56:26.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240428025623_467522 exited with status success for try_number 1 2024-04-28T02:56:26.375292415Z [2024-04-28T02:56:26.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240428025623_467522, map_index=-1, run_start_date=2024-04-28 02:56:25.118671+00:00, run_end_date=2024-04-28 02:56:25.640942+00:00, run_duration=0.522271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:56:24.235213+00:00, queued_by_job_id=1, pid=6713 2024-04-28T02:57:00.880702690Z [2024-04-28T02:57:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:57:00.894256425Z [2024-04-28T02:57:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:57:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:57:00.944019974Z [2024-04-28T02:57:00.943+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T02:57:00.944074328Z 2024-04-28T02:57:00.944102723Z 2024-04-28T02:57:00.944112781Z [2024-04-28T02:57:00.943+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:57:00.944150143Z [2024-04-28T02:57:00.943+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:57:00.944721831Z [2024-04-28T02:57:00.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:57:00.944745177Z 2024-04-28T02:57:00.944749236Z 2024-04-28T02:57:00.947487764Z [2024-04-28T02:57:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:57:00.947733088Z [2024-04-28T02:57:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:57:00.948062998Z [2024-04-28T02:57:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:57:00.948308544Z [2024-04-28T02:57:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:57:01.143489981Z [2024-04-28T02:57:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status queued for try_number 1 2024-04-28T02:57:01.143543615Z [2024-04-28T02:57:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status queued for try_number 1 2024-04-28T02:57:01.152292225Z [2024-04-28T02:57:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9ccdaa7-ad4d-4401-bbeb-e95f775ff3b2 2024-04-28T02:57:01.152417221Z [2024-04-28T02:57:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54cce039-32eb-45ed-8577-a2f469c6c5cb 2024-04-28T02:57:06.071959771Z [2024-04-28T02:57:06.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:57:06.072507749Z [2024-04-28T02:57:06.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:56:00+00:00, run_id=scheduled__2024-04-28T02:56:00+00:00, run_start_date=2024-04-28 02:57:00.906263+00:00, run_end_date=2024-04-28 02:57:06.071875+00:00, run_duration=5.165612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:56:00+00:00, data_interval_end=2024-04-28 02:57:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:57:06.081830297Z [2024-04-28T02:57:06.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:57:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:57:06.088676909Z [2024-04-28T02:57:06.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:57:06.089015847Z [2024-04-28T02:57:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:56:00+00:00, run_id=scheduled__2024-04-28T02:56:00+00:00, run_start_date=2024-04-28 02:57:00.905081+00:00, run_end_date=2024-04-28 02:57:06.088589+00:00, run_duration=5.183508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:56:00+00:00, data_interval_end=2024-04-28 02:57:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:57:06.098487616Z [2024-04-28T02:57:06.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:57:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:57:06.128833363Z [2024-04-28T02:57:06.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status success for try_number 1 2024-04-28T02:57:06.128962297Z [2024-04-28T02:57:06.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status success for try_number 1 2024-04-28T02:57:06.135849784Z [2024-04-28T02:57:06.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:56:00+00:00, map_index=-1, run_start_date=2024-04-28 02:57:02.894052+00:00, run_end_date=2024-04-28 02:57:05.286762+00:00, run_duration=2.39271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:57:00.945237+00:00, queued_by_job_id=1, pid=6757 2024-04-28T02:57:06.136113310Z [2024-04-28T02:57:06.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:56:00+00:00, map_index=-1, run_start_date=2024-04-28 02:57:02.713545+00:00, run_end_date=2024-04-28 02:57:05.018200+00:00, run_duration=2.304655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:57:00.945237+00:00, queued_by_job_id=1, pid=6756 2024-04-28T02:57:54.982340741Z [2024-04-28T02:57:54.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:57:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:57:55.032471271Z [2024-04-28T02:57:55.032+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:57:55.032495218Z 2024-04-28T02:57:55.032778708Z [2024-04-28T02:57:55.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:57:55.033686391Z [2024-04-28T02:57:55.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:57:55.033701256Z 2024-04-28T02:57:55.036953781Z [2024-04-28T02:57:55.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:57:55.037217714Z [2024-04-28T02:57:55.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:57:55.091266407Z [2024-04-28T02:57:55.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status queued for try_number 1 2024-04-28T02:57:55.102504313Z [2024-04-28T02:57:55.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to d27387b3-d7cf-4906-a763-0f368624c02f 2024-04-28T02:57:58.046454727Z [2024-04-28T02:57:58.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:57:58.046931005Z [2024-04-28T02:57:58.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:56:00+00:00, run_id=scheduled__2024-04-28T02:56:00+00:00, run_start_date=2024-04-28 02:57:54.992271+00:00, run_end_date=2024-04-28 02:57:58.046613+00:00, run_duration=3.054342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:56:00+00:00, data_interval_end=2024-04-28 02:57:00+00:00, dag_hash=6ef0a7200198398d36752a2e55a3c604 2024-04-28T02:57:58.055708875Z [2024-04-28T02:57:58.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:57:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:57:59.111566542Z [2024-04-28T02:57:59.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:57:59.167164383Z [2024-04-28T02:57:59.166+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:57:59.167189226Z 2024-04-28T02:57:59.167349212Z [2024-04-28T02:57:59.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:57:59.167902860Z [2024-04-28T02:57:59.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:57:59.167913035Z 2024-04-28T02:57:59.169949205Z [2024-04-28T02:57:59.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:57:59.170112987Z [2024-04-28T02:57:59.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:57:59.222973030Z [2024-04-28T02:57:59.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status queued for try_number 1 2024-04-28T02:57:59.223195717Z [2024-04-28T02:57:59.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status success for try_number 1 2024-04-28T02:57:59.230555786Z [2024-04-28T02:57:59.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:56:00+00:00, map_index=-1, run_start_date=2024-04-28 02:57:56.775887+00:00, run_end_date=2024-04-28 02:57:57.921007+00:00, run_duration=1.14512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:57:55.034637+00:00, queued_by_job_id=1, pid=6790 2024-04-28T02:57:59.230974564Z [2024-04-28T02:57:59.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7267da70-0153-49d2-8a67-2d977351c4f4 2024-04-28T02:58:00.352601771Z [2024-04-28T02:58:00.352+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:58:00.361754369Z [2024-04-28T02:58:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:58:00.376272340Z [2024-04-28T02:58:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T02:59:00+00:00 2024-04-28T02:58:00.393098977Z [2024-04-28T02:58:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T02:59:00+00:00 2024-04-28T02:58:00.491909978Z [2024-04-28T02:58:00.491+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:58:00.491955504Z 2024-04-28T02:58:00.491965973Z 2024-04-28T02:58:00.491974462Z 2024-04-28T02:58:00.491983082Z 2024-04-28T02:58:00.492079058Z [2024-04-28T02:58:00.491+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T02:58:00.492563021Z [2024-04-28T02:58:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:58:00.492934084Z [2024-04-28T02:58:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:58:00.493448216Z [2024-04-28T02:58:00.492+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:58:00.495524715Z [2024-04-28T02:58:00.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:58:00.495552430Z 2024-04-28T02:58:00.495562148Z 2024-04-28T02:58:00.495571256Z 2024-04-28T02:58:00.495579859Z 2024-04-28T02:58:00.503155264Z [2024-04-28T02:58:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:58:00.503576248Z [2024-04-28T02:58:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T02:58:00.504255222Z [2024-04-28T02:58:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:58:00.504531235Z [2024-04-28T02:58:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:58:00.505016045Z [2024-04-28T02:58:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:58:00.505156036Z [2024-04-28T02:58:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:58:00.505701712Z [2024-04-28T02:58:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:58:00.505990536Z [2024-04-28T02:58:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:58:00.890483099Z [2024-04-28T02:58:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:00.890745959Z [2024-04-28T02:58:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:00.891251005Z [2024-04-28T02:58:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:00.891470736Z [2024-04-28T02:58:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:00.911802350Z [2024-04-28T02:58:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f0073c3-a7e8-4011-878e-8d3f0e36c660 2024-04-28T02:58:00.912094995Z [2024-04-28T02:58:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05a9ed49-5239-41f6-a593-84fc0eeb1304 2024-04-28T02:58:00.912326079Z [2024-04-28T02:58:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a52b999-948c-460f-a819-b43a32f8de20 2024-04-28T02:58:00.912551021Z [2024-04-28T02:58:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ed403f-7eea-459e-8286-41a832f4d36e 2024-04-28T02:58:02.203432029Z [2024-04-28T02:58:02.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:02.203765952Z [2024-04-28T02:58:02.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:56:00+00:00, run_id=scheduled__2024-04-28T02:56:00+00:00, run_start_date=2024-04-28 02:58:00.406932+00:00, run_end_date=2024-04-28 02:58:02.203366+00:00, run_duration=1.796434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:56:00+00:00, data_interval_end=2024-04-28 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T02:58:02.215382011Z [2024-04-28T02:58:02.215+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:58:02.283947439Z [2024-04-28T02:58:02.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:02.289719096Z [2024-04-28T02:58:02.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:56:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:01.392285+00:00, run_end_date=2024-04-28 02:58:01.822520+00:00, run_duration=0.430235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:00.497939+00:00, queued_by_job_id=1, pid=6816 2024-04-28T02:58:03.371431485Z [2024-04-28T02:58:03.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:03.371707083Z [2024-04-28T02:58:03.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:56:00+00:00, run_id=scheduled__2024-04-28T02:56:00+00:00, run_start_date=2024-04-28 02:57:59.137060+00:00, run_end_date=2024-04-28 02:58:03.371382+00:00, run_duration=4.234322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:56:00+00:00, data_interval_end=2024-04-28 02:57:00+00:00, dag_hash=400fd2737af0557fa0ad7445aba2ec1c 2024-04-28T02:58:03.383131437Z [2024-04-28T02:58:03.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:57:00+00:00, run_after=2024-04-28T02:58:00+00:00 2024-04-28T02:58:03.454047883Z [2024-04-28T02:58:03.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:56:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:03.461762881Z [2024-04-28T02:58:03.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:56:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:01.259591+00:00, run_end_date=2024-04-28 02:58:03.018220+00:00, run_duration=1.758629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:57:59.168191+00:00, queued_by_job_id=1, pid=6815 2024-04-28T02:58:04.526327340Z [2024-04-28T02:58:04.523+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:58:04.595302366Z [2024-04-28T02:58:04.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:04.595536175Z [2024-04-28T02:58:04.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:57:00+00:00, run_id=scheduled__2024-04-28T02:57:00+00:00, run_start_date=2024-04-28 02:58:00.407518+00:00, run_end_date=2024-04-28 02:58:04.595301+00:00, run_duration=4.187783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:57:00+00:00, data_interval_end=2024-04-28 02:58:00+00:00, dag_hash=6ef0a7200198398d36752a2e55a3c604 2024-04-28T02:58:04.604300244Z [2024-04-28T02:58:04.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T02:59:00+00:00 2024-04-28T02:58:04.642493459Z [2024-04-28T02:58:04.642+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:58:04.642517191Z 2024-04-28T02:58:04.648348316Z [2024-04-28T02:58:04.648+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:58:04.648924305Z [2024-04-28T02:58:04.648+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:58:04.648952123Z 2024-04-28T02:58:04.653292820Z [2024-04-28T02:58:04.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:58:04.653919574Z [2024-04-28T02:58:04.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:58:04.778686557Z [2024-04-28T02:58:04.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:04.778814685Z [2024-04-28T02:58:04.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:04.785922665Z [2024-04-28T02:58:04.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:57:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:03.102498+00:00, run_end_date=2024-04-28 02:58:04.527413+00:00, run_duration=1.424915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:00.497939+00:00, queued_by_job_id=1, pid=6877 2024-04-28T02:58:04.786127468Z [2024-04-28T02:58:04.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6940e809-ffb8-47c9-9eda-0ee9abc39e96 2024-04-28T02:58:04.867847013Z [2024-04-28T02:58:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:04.868229228Z [2024-04-28T02:58:04.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:57:00+00:00, run_id=scheduled__2024-04-28T02:57:00+00:00, run_start_date=2024-04-28 02:58:00.409656+00:00, run_end_date=2024-04-28 02:58:04.867890+00:00, run_duration=4.458234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:57:00+00:00, data_interval_end=2024-04-28 02:58:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:58:04.882440956Z [2024-04-28T02:58:04.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T02:59:00+00:00 2024-04-28T02:58:04.919787649Z [2024-04-28T02:58:04.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:04.927633315Z [2024-04-28T02:58:04.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:57:00+00:00, run_id=scheduled__2024-04-28T02:57:00+00:00, run_start_date=2024-04-28 02:58:00.408646+00:00, run_end_date=2024-04-28 02:58:04.926490+00:00, run_duration=4.517844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:57:00+00:00, data_interval_end=2024-04-28 02:58:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:58:04.974632451Z [2024-04-28T02:58:04.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T02:59:00+00:00 2024-04-28T02:58:05.045183833Z [2024-04-28T02:58:05.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:05.063534071Z [2024-04-28T02:58:05.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:57:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:02.936469+00:00, run_end_date=2024-04-28 02:58:04.524015+00:00, run_duration=1.587546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:00.497939+00:00, queued_by_job_id=1, pid=6875 2024-04-28T02:58:05.312330215Z [2024-04-28T02:58:05.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:05.327762007Z [2024-04-28T02:58:05.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:57:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:02.939898+00:00, run_end_date=2024-04-28 02:58:04.786607+00:00, run_duration=1.846709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:00.497939+00:00, queued_by_job_id=1, pid=6876 2024-04-28T02:58:07.117359350Z [2024-04-28T02:58:07.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:58:07.212358700Z [2024-04-28T02:58:07.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:58:07.212387090Z 2024-04-28T02:58:07.212630981Z [2024-04-28T02:58:07.212+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:58:07.213312763Z [2024-04-28T02:58:07.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:58:07.213327170Z 2024-04-28T02:58:07.216045883Z [2024-04-28T02:58:07.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T02:58:07.216293391Z [2024-04-28T02:58:07.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:58:07.271051016Z [2024-04-28T02:58:07.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:07.279540893Z [2024-04-28T02:58:07.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to f111856c-1723-4a34-9ab1-2b6b0275e30a 2024-04-28T02:58:09.572302743Z [2024-04-28T02:58:09.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:09.573151518Z [2024-04-28T02:58:09.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:57:00+00:00, run_id=scheduled__2024-04-28T02:57:00+00:00, run_start_date=2024-04-28 02:58:04.557301+00:00, run_end_date=2024-04-28 02:58:09.572234+00:00, run_duration=5.014933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:57:00+00:00, data_interval_end=2024-04-28 02:58:00+00:00, dag_hash=400fd2737af0557fa0ad7445aba2ec1c 2024-04-28T02:58:09.583564520Z [2024-04-28T02:58:09.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:58:00+00:00, run_after=2024-04-28T02:59:00+00:00 2024-04-28T02:58:09.611669869Z [2024-04-28T02:58:09.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:58:09.611713358Z 2024-04-28T02:58:09.612240360Z [2024-04-28T02:58:09.611+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:58:09.613665037Z [2024-04-28T02:58:09.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:58:09.613706690Z 2024-04-28T02:58:09.617369555Z [2024-04-28T02:58:09.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='split_metrics', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T02:58:09.617733811Z [2024-04-28T02:58:09.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'split_metrics', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:58:09.685130194Z [2024-04-28T02:58:09.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.split_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:09.685189577Z [2024-04-28T02:58:09.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:57:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:09.685228740Z [2024-04-28T02:58:09.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:09.696865059Z [2024-04-28T02:58:09.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:08.970826+00:00, run_end_date=2024-04-28 02:58:09.334856+00:00, run_duration=0.36403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:07.213852+00:00, queued_by_job_id=1, pid=6940 2024-04-28T02:58:09.697170299Z [2024-04-28T02:58:09.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5026c93-976e-4135-b885-d234f1c7c059 2024-04-28T02:58:09.698278554Z [2024-04-28T02:58:09.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:57:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:07.026177+00:00, run_end_date=2024-04-28 02:58:08.700795+00:00, run_duration=1.674618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:04.649456+00:00, queued_by_job_id=1, pid=6919 2024-04-28T02:58:12.284434655Z [2024-04-28T02:58:12.283+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:58:12.284491113Z 2024-04-28T02:58:12.284584632Z [2024-04-28T02:58:12.284+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:58:12.285284735Z [2024-04-28T02:58:12.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:58:12.285300289Z 2024-04-28T02:58:12.288690851Z [2024-04-28T02:58:12.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T02:58:12.288828695Z [2024-04-28T02:58:12.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'collect_metrics', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T02:58:12.348467870Z [2024-04-28T02:58:12.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.collect_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:12.348684646Z [2024-04-28T02:58:12.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.split_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:12.355823436Z [2024-04-28T02:58:12.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b794b5b-687c-40c7-98ba-b69b6cd9f586 2024-04-28T02:58:12.356392421Z [2024-04-28T02:58:12.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=split_metrics, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:11.192923+00:00, run_end_date=2024-04-28 02:58:11.580261+00:00, run_duration=0.387338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:09.614427+00:00, queued_by_job_id=1, pid=6961 2024-04-28T02:58:15.411172692Z [2024-04-28T02:58:15.410+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:58:15.411201339Z 2024-04-28T02:58:15.411413503Z [2024-04-28T02:58:15.411+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:58:15.412185268Z [2024-04-28T02:58:15.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:58:15.412197873Z 2024-04-28T02:58:15.415057029Z [2024-04-28T02:58:15.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:58:15.415436750Z [2024-04-28T02:58:15.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'send_prometheus', 'scheduled__2024-04-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T02:58:15.485377118Z [2024-04-28T02:58:15.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.send_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status queued for try_number 1 2024-04-28T02:58:15.485648107Z [2024-04-28T02:58:15.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.collect_metrics run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:15.492187401Z [2024-04-28T02:58:15.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=0, run_start_date=2024-04-28 02:58:14.091085+00:00, run_end_date=2024-04-28 02:58:14.477857+00:00, run_duration=0.386772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:12.285821+00:00, queued_by_job_id=1, pid=6973 2024-04-28T02:58:15.492522411Z [2024-04-28T02:58:15.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1be6a452-8903-4b38-8182-f8d3ccb2b2b8 2024-04-28T02:58:18.436061710Z [2024-04-28T02:58:18.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:58:18.436577850Z [2024-04-28T02:58:18.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:50:00+00:00, run_id=scheduled__2024-04-28T02:50:00+00:00, run_start_date=2024-04-28 02:58:07.132230+00:00, run_end_date=2024-04-28 02:58:18.436158+00:00, run_duration=11.303928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:50:00+00:00, data_interval_end=2024-04-28 02:55:00+00:00, dag_hash=0908cd8e390ee81f5b1e3b6e624e35e3 2024-04-28T02:58:18.451595003Z [2024-04-28T02:58:18.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:55:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:58:18.491148942Z [2024-04-28T02:58:18.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.send_prometheus run_id=scheduled__2024-04-28T02:50:00+00:00 exited with status success for try_number 1 2024-04-28T02:58:18.498421066Z [2024-04-28T02:58:18.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:50:00+00:00, map_index=-1, run_start_date=2024-04-28 02:58:17.138254+00:00, run_end_date=2024-04-28 02:58:17.466323+00:00, run_duration=0.328069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:58:15.412603+00:00, queued_by_job_id=1, pid=6985 2024-04-28T02:59:01.052287761Z [2024-04-28T02:59:01.051+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:59:01.060704303Z [2024-04-28T02:59:01.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T02:59:01.086573811Z [2024-04-28T02:59:01.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:59:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:59:01.115300956Z [2024-04-28T02:59:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:59:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:59:01.245876660Z [2024-04-28T02:59:01.245+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T02:59:01.245904877Z 2024-04-28T02:59:01.245908635Z 2024-04-28T02:59:01.245927605Z 2024-04-28T02:59:01.245931079Z 2024-04-28T02:59:01.246135684Z [2024-04-28T02:59:01.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:59:01.246426762Z [2024-04-28T02:59:01.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:59:01.246654556Z [2024-04-28T02:59:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:59:01.246846256Z [2024-04-28T02:59:01.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T02:59:01.247534647Z [2024-04-28T02:59:01.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:59:01.247544122Z 2024-04-28T02:59:01.247547649Z 2024-04-28T02:59:01.247550827Z 2024-04-28T02:59:01.247554143Z 2024-04-28T02:59:01.251957385Z [2024-04-28T02:59:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:59:01.252224163Z [2024-04-28T02:59:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:59:01.252532597Z [2024-04-28T02:59:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:59:01.252798734Z [2024-04-28T02:59:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:59:01.253095692Z [2024-04-28T02:59:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:59:01.253327701Z [2024-04-28T02:59:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:59:01.253670028Z [2024-04-28T02:59:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:59:01.253894205Z [2024-04-28T02:59:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:59:01.631131058Z [2024-04-28T02:59:01.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 1 2024-04-28T02:59:01.632134634Z [2024-04-28T02:59:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 1 2024-04-28T02:59:01.632373701Z [2024-04-28T02:59:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 1 2024-04-28T02:59:01.633144400Z [2024-04-28T02:59:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 1 2024-04-28T02:59:01.653925861Z [2024-04-28T02:59:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfac60e8-ca0f-4226-a7c8-4a9bfc16a85b 2024-04-28T02:59:01.655683713Z [2024-04-28T02:59:01.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee323dfa-c0bd-439a-9360-96aa04975a9c 2024-04-28T02:59:01.656520980Z [2024-04-28T02:59:01.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to add6162f-757a-4f43-9036-afe6d3899787 2024-04-28T02:59:01.656810020Z [2024-04-28T02:59:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51b5bf48-3ad5-4ad2-83b0-c008c966279f 2024-04-28T02:59:04.115886259Z [2024-04-28T02:59:04.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status failed for try_number 1 2024-04-28T02:59:04.122757981Z [2024-04-28T02:59:04.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:59:01.248390+00:00, queued_by_job_id=1, pid=None 2024-04-28T02:59:04.123221473Z [2024-04-28T02:59:04.123+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:04.126078856Z [2024-04-28T02:59:04.125+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:04.141080236Z [2024-04-28T02:59:04.140+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T025800, start_date=, end_date=20240428T025904 2024-04-28T02:59:05.439201281Z [2024-04-28T02:59:05.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status failed for try_number 1 2024-04-28T02:59:05.454511878Z [2024-04-28T02:59:05.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:59:01.248390+00:00, queued_by_job_id=1, pid=None 2024-04-28T02:59:05.455093756Z [2024-04-28T02:59:05.454+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:05.463110588Z [2024-04-28T02:59:05.462+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:05.491991486Z [2024-04-28T02:59:05.491+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T025800, start_date=, end_date=20240428T025905 2024-04-28T02:59:05.882766082Z [2024-04-28T02:59:05.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:59:05.883138644Z [2024-04-28T02:59:05.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:58:00+00:00, run_id=scheduled__2024-04-28T02:58:00+00:00, run_start_date=2024-04-28 02:59:01.143425+00:00, run_end_date=2024-04-28 02:59:05.882693+00:00, run_duration=4.739268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:58:00+00:00, data_interval_end=2024-04-28 02:59:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T02:59:05.895770289Z [2024-04-28T02:59:05.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:59:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:59:05.929561296Z [2024-04-28T02:59:05.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T02:59:05.929804819Z [2024-04-28T02:59:05.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:58:00+00:00, run_id=scheduled__2024-04-28T02:58:00+00:00, run_start_date=2024-04-28 02:59:01.139353+00:00, run_end_date=2024-04-28 02:59:05.929483+00:00, run_duration=4.79013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:58:00+00:00, data_interval_end=2024-04-28 02:59:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T02:59:05.942328722Z [2024-04-28T02:59:05.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T02:59:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:59:05.986517867Z [2024-04-28T02:59:05.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status success for try_number 1 2024-04-28T02:59:05.986582813Z [2024-04-28T02:59:05.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status success for try_number 1 2024-04-28T02:59:05.993675598Z [2024-04-28T02:59:05.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=2024-04-28 02:59:03.562090+00:00, run_end_date=2024-04-28 02:59:05.494682+00:00, run_duration=1.932592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:59:01.248390+00:00, queued_by_job_id=1, pid=7013 2024-04-28T02:59:05.993865820Z [2024-04-28T02:59:05.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=2024-04-28 02:59:04.014001+00:00, run_end_date=2024-04-28 02:59:05.288544+00:00, run_duration=1.274543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:59:01.248390+00:00, queued_by_job_id=1, pid=7055 2024-04-28T02:59:14.216273554Z [2024-04-28T02:59:14.211+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:59:14.216298314Z 2024-04-28T02:59:14.216405472Z [2024-04-28T02:59:14.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:59:14.216912343Z [2024-04-28T02:59:14.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:59:14.216919065Z 2024-04-28T02:59:14.223812223Z [2024-04-28T02:59:14.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:59:14.223902048Z [2024-04-28T02:59:14.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T02:59:14.305062943Z [2024-04-28T02:59:14.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 2 2024-04-28T02:59:14.314134069Z [2024-04-28T02:59:14.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a3d6799-6d5f-41b7-863d-232819d6ff9a 2024-04-28T02:59:16.091088442Z [2024-04-28T02:59:16.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T02:59:16.091109197Z 2024-04-28T02:59:16.091313927Z [2024-04-28T02:59:16.091+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e has 0/16 running and queued tasks 2024-04-28T02:59:16.091909594Z [2024-04-28T02:59:16.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T02:59:16.091920270Z 2024-04-28T02:59:16.094075834Z [2024-04-28T02:59:16.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-28T02:59:16.094302007Z [2024-04-28T02:59:16.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T02:59:16.160260978Z [2024-04-28T02:59:16.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 2 2024-04-28T02:59:16.160387960Z [2024-04-28T02:59:16.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status failed for try_number 2 2024-04-28T02:59:16.170058390Z [2024-04-28T02:59:16.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 02:59:04.128687+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:59:14.217204+00:00, queued_by_job_id=1, pid=None 2024-04-28T02:59:16.171003997Z [2024-04-28T02:59:16.170+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:16.173788029Z [2024-04-28T02:59:16.173+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:16.185456621Z [2024-04-28T02:59:16.185+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240428T025800, start_date=, end_date=20240428T025916 2024-04-28T02:59:16.193225041Z [2024-04-28T02:59:16.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed98db9-f431-497e-b682-e00340dce726 2024-04-28T02:59:16.237073701Z [2024-04-28T02:59:16.236+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T02:59:16.237412760Z [2024-04-28T02:59:16.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:58:00+00:00, run_id=scheduled__2024-04-28T02:58:00+00:00, run_start_date=2024-04-28 02:59:01.137512+00:00, run_end_date=2024-04-28 02:59:16.237040+00:00, run_duration=15.099528, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:58:00+00:00, data_interval_end=2024-04-28 02:59:00+00:00, dag_hash=6ef0a7200198398d36752a2e55a3c604 2024-04-28T02:59:16.248100025Z [2024-04-28T02:59:16.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:59:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T02:59:18.272406074Z [2024-04-28T02:59:18.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status failed for try_number 2 2024-04-28T02:59:18.282107295Z [2024-04-28T02:59:18.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-28 02:59:05.471511+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 02:59:16.092351+00:00, queued_by_job_id=1, pid=None 2024-04-28T02:59:18.283213538Z [2024-04-28T02:59:18.282+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:18.285959476Z [2024-04-28T02:59:18.285+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-28T02:59:18.299617373Z [2024-04-28T02:59:18.299+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240428T025800, start_date=, end_date=20240428T025918 2024-04-28T02:59:19.373992146Z [2024-04-28T02:59:19.373+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-28T02:59:19.374617713Z [2024-04-28T02:59:19.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e, execution_date=2024-04-28 02:58:00+00:00, run_id=scheduled__2024-04-28T02:58:00+00:00, run_start_date=2024-04-28 02:59:01.140645+00:00, run_end_date=2024-04-28 02:59:19.373901+00:00, run_duration=18.233256, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:58:00+00:00, data_interval_end=2024-04-28 02:59:00+00:00, dag_hash=400fd2737af0557fa0ad7445aba2ec1c 2024-04-28T02:59:19.392339654Z [2024-04-28T02:59:19.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_187d2591-1a3b-4a2e-9673-020d8a47e14e to 2024-04-28T02:59:00+00:00, run_after=2024-04-28T03:00:00+00:00 2024-04-28T03:00:00.873828498Z [2024-04-28T03:00:00.873+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:00:00.890448558Z [2024-04-28T03:00:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:00:00+00:00, run_after=2024-04-28T03:01:00+00:00 2024-04-28T03:00:00.913643460Z [2024-04-28T03:00:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:00:00+00:00, run_after=2024-04-28T03:05:00+00:00 2024-04-28T03:00:00.923183824Z [2024-04-28T03:00:00.922+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:00:01.047689955Z [2024-04-28T03:00:01.047+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T03:00:01.047722949Z 2024-04-28T03:00:01.047728592Z 2024-04-28T03:00:01.047739039Z 2024-04-28T03:00:01.047744299Z 2024-04-28T03:00:01.047965831Z [2024-04-28T03:00:01.047+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:00:01.048257641Z [2024-04-28T03:00:01.048+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:00:01.048618585Z [2024-04-28T03:00:01.048+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:00:01.048899174Z [2024-04-28T03:00:01.048+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:00:01.050090316Z [2024-04-28T03:00:01.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:00:01.050117326Z 2024-04-28T03:00:01.050121711Z 2024-04-28T03:00:01.050124939Z 2024-04-28T03:00:01.050127960Z 2024-04-28T03:00:01.057531409Z [2024-04-28T03:00:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:00:01.057954396Z [2024-04-28T03:00:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:00:01.058456630Z [2024-04-28T03:00:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:00:01.058804047Z [2024-04-28T03:00:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:00:01.059272289Z [2024-04-28T03:00:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:00:01.059593860Z [2024-04-28T03:00:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:00:01.060039759Z [2024-04-28T03:00:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:00:01.060350753Z [2024-04-28T03:00:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:00:01.483586121Z [2024-04-28T03:00:01.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:01.483790059Z [2024-04-28T03:00:01.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:01.483952104Z [2024-04-28T03:00:01.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:59:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:01.484113142Z [2024-04-28T03:00:01.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:59:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:01.495059673Z [2024-04-28T03:00:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bfa614d-5208-4a6c-8b8d-574a1ef7ee30 2024-04-28T03:00:01.495208343Z [2024-04-28T03:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to f10ecde2-c874-48db-b386-8130be0e8858 2024-04-28T03:00:01.495365675Z [2024-04-28T03:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e7c16ca-7c7c-46ba-a9d4-6df67b65071a 2024-04-28T03:00:01.495504277Z [2024-04-28T03:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to e05f6b6a-bce7-4a63-b948-d807f820cdb3 2024-04-28T03:00:02.684316706Z [2024-04-28T03:00:02.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:00:02.686871346Z [2024-04-28T03:00:02.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 02:58:00+00:00, run_id=scheduled__2024-04-28T02:58:00+00:00, run_start_date=2024-04-28 03:00:00.936828+00:00, run_end_date=2024-04-28 03:00:02.684226+00:00, run_duration=1.747398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:58:00+00:00, data_interval_end=2024-04-28 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:00:02.699438429Z [2024-04-28T03:00:02.699+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:00:00+00:00, run_after=2024-04-28T03:02:00+00:00 2024-04-28T03:00:02.753455299Z [2024-04-28T03:00:02.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T02:58:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:02.759670990Z [2024-04-28T03:00:02.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T02:58:00+00:00, map_index=-1, run_start_date=2024-04-28 03:00:01.932088+00:00, run_end_date=2024-04-28 03:00:02.356182+00:00, run_duration=0.424094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:01.052001+00:00, queued_by_job_id=1, pid=7135 2024-04-28T03:00:03.875241768Z [2024-04-28T03:00:03.874+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:00:03.875289726Z 2024-04-28T03:00:03.875300345Z [2024-04-28T03:00:03.875+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:00:03.876056493Z [2024-04-28T03:00:03.875+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:00:03.876080466Z 2024-04-28T03:00:03.879756026Z [2024-04-28T03:00:03.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:00:03.879894002Z [2024-04-28T03:00:03.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:00:03.941682159Z [2024-04-28T03:00:03.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:03.941747657Z [2024-04-28T03:00:03.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:03.948954898Z [2024-04-28T03:00:03.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1f67921-6aab-4c14-a31b-338bec7c5862 2024-04-28T03:00:03.949076522Z [2024-04-28T03:00:03.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T02:55:00+00:00, map_index=-1, run_start_date=2024-04-28 03:00:03.224235+00:00, run_end_date=2024-04-28 03:00:03.571053+00:00, run_duration=0.346818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:01.052001+00:00, queued_by_job_id=1, pid=7159 2024-04-28T03:00:05.127926522Z [2024-04-28T03:00:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:00:05.128354646Z [2024-04-28T03:00:05.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:59:00+00:00, run_id=scheduled__2024-04-28T02:59:00+00:00, run_start_date=2024-04-28 03:00:00.937950+00:00, run_end_date=2024-04-28 03:00:05.128029+00:00, run_duration=4.190079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:59:00+00:00, data_interval_end=2024-04-28 03:00:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:00:05.152576318Z [2024-04-28T03:00:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:00:00+00:00, run_after=2024-04-28T03:01:00+00:00 2024-04-28T03:00:05.292047371Z [2024-04-28T03:00:05.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:59:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:05.311762139Z [2024-04-28T03:00:05.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:59:00+00:00, map_index=-1, run_start_date=2024-04-28 03:00:03.482735+00:00, run_end_date=2024-04-28 03:00:04.841862+00:00, run_duration=1.359127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:01.052001+00:00, queued_by_job_id=1, pid=7182 2024-04-28T03:00:06.378436253Z [2024-04-28T03:00:06.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:00:06.378459075Z [2024-04-28T03:00:06.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:59:00+00:00, run_id=scheduled__2024-04-28T02:59:00+00:00, run_start_date=2024-04-28 03:00:00.939121+00:00, run_end_date=2024-04-28 03:00:06.372201+00:00, run_duration=5.43308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:59:00+00:00, data_interval_end=2024-04-28 03:00:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:00:06.386146576Z [2024-04-28T03:00:06.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:00:00+00:00, run_after=2024-04-28T03:01:00+00:00 2024-04-28T03:00:06.508821528Z [2024-04-28T03:00:06.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T02:59:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:06.519372850Z [2024-04-28T03:00:06.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T02:59:00+00:00, map_index=-1, run_start_date=2024-04-28 03:00:03.554915+00:00, run_end_date=2024-04-28 03:00:05.129059+00:00, run_duration=1.574144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:01.052001+00:00, queued_by_job_id=1, pid=7185 2024-04-28T03:00:07.601180658Z [2024-04-28T03:00:07.600+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:00:07.601225131Z 2024-04-28T03:00:07.601603264Z [2024-04-28T03:00:07.601+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:00:07.602806548Z [2024-04-28T03:00:07.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:00:07.602824466Z 2024-04-28T03:00:07.605749361Z [2024-04-28T03:00:07.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:00:07.606229972Z [2024-04-28T03:00:07.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:00:07.665068523Z [2024-04-28T03:00:07.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:07.665525769Z [2024-04-28T03:00:07.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:07.673328854Z [2024-04-28T03:00:07.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fb6db40-7c6d-4642-b118-8ec6efd30313 2024-04-28T03:00:07.673718968Z [2024-04-28T03:00:07.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T02:55:00+00:00, map_index=-1, run_start_date=2024-04-28 03:00:06.627841+00:00, run_end_date=2024-04-28 03:00:06.955600+00:00, run_duration=0.327759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:03.876339+00:00, queued_by_job_id=1, pid=7218 2024-04-28T03:00:10.096846662Z [2024-04-28T03:00:10.096+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:00:10.096892126Z 2024-04-28T03:00:10.097198451Z [2024-04-28T03:00:10.096+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:00:10.102757366Z [2024-04-28T03:00:10.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:00:10.102776677Z 2024-04-28T03:00:10.106343607Z [2024-04-28T03:00:10.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:00:10.106605904Z [2024-04-28T03:00:10.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:00:10.161470199Z [2024-04-28T03:00:10.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status queued for try_number 1 2024-04-28T03:00:10.161727912Z [2024-04-28T03:00:10.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:10.168755855Z [2024-04-28T03:00:10.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to c16d2bfc-8aa2-4b0d-827c-e43d7d7dbafa 2024-04-28T03:00:10.169189325Z [2024-04-28T03:00:10.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T02:55:00+00:00, map_index=0, run_start_date=2024-04-28 03:00:09.143472+00:00, run_end_date=2024-04-28 03:00:09.449089+00:00, run_duration=0.305617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:07.603533+00:00, queued_by_job_id=1, pid=7230 2024-04-28T03:00:12.409811725Z [2024-04-28T03:00:12.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:00:12.409959921Z [2024-04-28T03:00:12.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 02:55:00+00:00, run_id=scheduled__2024-04-28T02:55:00+00:00, run_start_date=2024-04-28 03:00:00.935439+00:00, run_end_date=2024-04-28 03:00:12.409649+00:00, run_duration=11.47421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 02:55:00+00:00, data_interval_end=2024-04-28 03:00:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:00:12.416683524Z [2024-04-28T03:00:12.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:00:00+00:00, run_after=2024-04-28T03:05:00+00:00 2024-04-28T03:00:12.463562053Z [2024-04-28T03:00:12.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T02:55:00+00:00 exited with status success for try_number 1 2024-04-28T03:00:12.471290082Z [2024-04-28T03:00:12.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T02:55:00+00:00, map_index=-1, run_start_date=2024-04-28 03:00:11.799027+00:00, run_end_date=2024-04-28 03:00:12.195617+00:00, run_duration=0.39659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:10.103433+00:00, queued_by_job_id=1, pid=7242 2024-04-28T03:00:24.188887568Z [2024-04-28T03:00:24.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:00:24.188925504Z 2024-04-28T03:00:24.189371493Z [2024-04-28T03:00:24.188+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-28T03:00:24.190688070Z [2024-04-28T03:00:24.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:00:24.190712275Z 2024-04-28T03:00:24.194791701Z [2024-04-28T03:00:24.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240428030023_872594', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:00:24.195006217Z [2024-04-28T03:00:24.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240428030023_872594', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-28T03:00:24.283178666Z [2024-04-28T03:00:24.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240428030023_872594 exited with status queued for try_number 1 2024-04-28T03:00:24.289878249Z [2024-04-28T03:00:24.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e86bddf-ab59-4828-bf64-f03bd09746d4 2024-04-28T03:00:25.460254888Z [2024-04-28T03:00:25.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:00:25.460773143Z [2024-04-28T03:00:25.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-28 03:00:23.757016+00:00, run_id=vdu_down_20240428030023_872594, run_start_date=2024-04-28 03:00:24.148317+00:00, run_end_date=2024-04-28 03:00:25.460168+00:00, run_duration=1.311851, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 03:00:23.757016+00:00, data_interval_end=2024-04-28 03:00:23.757016+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-28T03:00:25.475256195Z [2024-04-28T03:00:25.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-28T03:00:25.558958135Z [2024-04-28T03:00:25.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240428030023_872594 exited with status success for try_number 1 2024-04-28T03:00:25.570787182Z [2024-04-28T03:00:25.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240428030023_872594, map_index=-1, run_start_date=2024-04-28 03:00:24.909615+00:00, run_end_date=2024-04-28 03:00:25.382427+00:00, run_duration=0.472812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:00:24.191562+00:00, queued_by_job_id=1, pid=7244 2024-04-28T03:01:00.784140505Z [2024-04-28T03:01:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:01:00+00:00, run_after=2024-04-28T03:02:00+00:00 2024-04-28T03:01:00.816580172Z [2024-04-28T03:01:00.807+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:01:00.882938112Z [2024-04-28T03:01:00.882+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:01:00.882963896Z 2024-04-28T03:01:00.882969937Z 2024-04-28T03:01:00.883218883Z [2024-04-28T03:01:00.882+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:01:00.883354766Z [2024-04-28T03:01:00.883+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:01:00.883918904Z [2024-04-28T03:01:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:01:00.883929142Z 2024-04-28T03:01:00.883934563Z 2024-04-28T03:01:00.886593955Z [2024-04-28T03:01:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:01:00.886700609Z [2024-04-28T03:01:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:01:00.886939422Z [2024-04-28T03:01:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:01:00.887038369Z [2024-04-28T03:01:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:01:01.031248316Z [2024-04-28T03:01:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:01:01.031491325Z [2024-04-28T03:01:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:01:01.040531954Z [2024-04-28T03:01:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to da4cc7fa-7a34-4053-85b6-01c642697152 2024-04-28T03:01:01.040853286Z [2024-04-28T03:01:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4fcaf2e-d6ec-4f4b-ad1f-6378376e9756 2024-04-28T03:01:04.798031399Z [2024-04-28T03:01:04.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:01:04.798542100Z [2024-04-28T03:01:04.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:00:00+00:00, run_id=scheduled__2024-04-28T03:00:00+00:00, run_start_date=2024-04-28 03:01:00.830664+00:00, run_end_date=2024-04-28 03:01:04.797943+00:00, run_duration=3.967279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:00:00+00:00, data_interval_end=2024-04-28 03:01:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:01:04.809066102Z [2024-04-28T03:01:04.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:01:00+00:00, run_after=2024-04-28T03:02:00+00:00 2024-04-28T03:01:04.815788610Z [2024-04-28T03:01:04.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:01:04.816169315Z [2024-04-28T03:01:04.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:00:00+00:00, run_id=scheduled__2024-04-28T03:00:00+00:00, run_start_date=2024-04-28 03:01:00.831907+00:00, run_end_date=2024-04-28 03:01:04.815704+00:00, run_duration=3.983797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:00:00+00:00, data_interval_end=2024-04-28 03:01:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:01:04.824740011Z [2024-04-28T03:01:04.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:01:00+00:00, run_after=2024-04-28T03:02:00+00:00 2024-04-28T03:01:04.870476197Z [2024-04-28T03:01:04.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:01:04.871308155Z [2024-04-28T03:01:04.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:01:04.880787883Z [2024-04-28T03:01:04.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=-1, run_start_date=2024-04-28 03:01:02.660849+00:00, run_end_date=2024-04-28 03:01:04.054889+00:00, run_duration=1.39404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:01:00.884448+00:00, queued_by_job_id=1, pid=7285 2024-04-28T03:01:04.881145712Z [2024-04-28T03:01:04.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=-1, run_start_date=2024-04-28 03:01:02.683794+00:00, run_end_date=2024-04-28 03:01:04.297311+00:00, run_duration=1.613517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:01:00.884448+00:00, queued_by_job_id=1, pid=7286 2024-04-28T03:01:16.634241057Z [2024-04-28T03:01:16.633+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:02:00.558709754Z [2024-04-28T03:02:00.558+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:02:00.570284241Z [2024-04-28T03:02:00.569+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:02:00.593457145Z [2024-04-28T03:02:00.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:02:00+00:00, run_after=2024-04-28T03:03:00+00:00 2024-04-28T03:02:00.686346542Z [2024-04-28T03:02:00.685+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:02:00.686402811Z 2024-04-28T03:02:00.686408595Z 2024-04-28T03:02:00.686412309Z 2024-04-28T03:02:00.686702830Z [2024-04-28T03:02:00.686+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:02:00.686934714Z [2024-04-28T03:02:00.686+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:02:00.687157927Z [2024-04-28T03:02:00.687+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:02:00.687833448Z [2024-04-28T03:02:00.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:02:00.687848459Z 2024-04-28T03:02:00.687852636Z 2024-04-28T03:02:00.687855775Z 2024-04-28T03:02:00.690975671Z [2024-04-28T03:02:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:02:00.691135921Z [2024-04-28T03:02:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:02:00.691357205Z [2024-04-28T03:02:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:02:00.691493424Z [2024-04-28T03:02:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:02:00.691732561Z [2024-04-28T03:02:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:02:00.691864180Z [2024-04-28T03:02:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:02:00.922974997Z [2024-04-28T03:02:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:02:00.923284162Z [2024-04-28T03:02:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:01:00+00:00 exited with status queued for try_number 1 2024-04-28T03:02:00.923547515Z [2024-04-28T03:02:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:01:00+00:00 exited with status queued for try_number 1 2024-04-28T03:02:00.935292090Z [2024-04-28T03:02:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to b43c7114-491a-436a-91b9-e31cf07b2f2d 2024-04-28T03:02:00.936128082Z [2024-04-28T03:02:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0242dea-caf6-4ca3-aab3-5100733e277a 2024-04-28T03:02:00.936986444Z [2024-04-28T03:02:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8989840-6c48-4593-9ba3-41cb1eeb8d67 2024-04-28T03:02:02.074523438Z [2024-04-28T03:02:02.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:02:02.074555992Z [2024-04-28T03:02:02.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:00:00+00:00, run_id=scheduled__2024-04-28T03:00:00+00:00, run_start_date=2024-04-28 03:02:00.609182+00:00, run_end_date=2024-04-28 03:02:02.071716+00:00, run_duration=1.462534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:00:00+00:00, data_interval_end=2024-04-28 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:02:02.080734173Z [2024-04-28T03:02:02.080+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:02:00+00:00, run_after=2024-04-28T03:04:00+00:00 2024-04-28T03:02:02.134892519Z [2024-04-28T03:02:02.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:02:02.140075913Z [2024-04-28T03:02:02.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=-1, run_start_date=2024-04-28 03:02:01.360124+00:00, run_end_date=2024-04-28 03:02:01.746186+00:00, run_duration=0.386062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:02:00.688522+00:00, queued_by_job_id=1, pid=7311 2024-04-28T03:02:04.554741920Z [2024-04-28T03:02:04.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:02:04.555162073Z [2024-04-28T03:02:04.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:01:00+00:00, run_id=scheduled__2024-04-28T03:01:00+00:00, run_start_date=2024-04-28 03:02:00.612670+00:00, run_end_date=2024-04-28 03:02:04.554635+00:00, run_duration=3.941965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:01:00+00:00, data_interval_end=2024-04-28 03:02:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:02:04.572122921Z [2024-04-28T03:02:04.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:02:00+00:00, run_after=2024-04-28T03:03:00+00:00 2024-04-28T03:02:04.615753562Z [2024-04-28T03:02:04.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:01:00+00:00 exited with status success for try_number 1 2024-04-28T03:02:04.620485806Z [2024-04-28T03:02:04.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:01:00+00:00, map_index=-1, run_start_date=2024-04-28 03:02:02.567093+00:00, run_end_date=2024-04-28 03:02:04.170820+00:00, run_duration=1.603727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:02:00.688522+00:00, queued_by_job_id=1, pid=7353 2024-04-28T03:02:05.672691738Z [2024-04-28T03:02:05.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:02:05.672709382Z [2024-04-28T03:02:05.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:01:00+00:00, run_id=scheduled__2024-04-28T03:01:00+00:00, run_start_date=2024-04-28 03:02:00.611001+00:00, run_end_date=2024-04-28 03:02:05.671835+00:00, run_duration=5.060834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:01:00+00:00, data_interval_end=2024-04-28 03:02:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:02:05.684708709Z [2024-04-28T03:02:05.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:02:00+00:00, run_after=2024-04-28T03:03:00+00:00 2024-04-28T03:02:05.714996252Z [2024-04-28T03:02:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:01:00+00:00 exited with status success for try_number 1 2024-04-28T03:02:05.725668822Z [2024-04-28T03:02:05.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:01:00+00:00, map_index=-1, run_start_date=2024-04-28 03:02:02.538969+00:00, run_end_date=2024-04-28 03:02:05.093968+00:00, run_duration=2.554999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:02:00.688522+00:00, queued_by_job_id=1, pid=7352 2024-04-28T03:03:00.495756877Z [2024-04-28T03:03:00.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:03:00+00:00, run_after=2024-04-28T03:04:00+00:00 2024-04-28T03:03:00.504174359Z [2024-04-28T03:03:00.503+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:03:00.558295813Z [2024-04-28T03:03:00.557+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:03:00.558328820Z 2024-04-28T03:03:00.558332886Z 2024-04-28T03:03:00.558575422Z [2024-04-28T03:03:00.558+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:03:00.558749837Z [2024-04-28T03:03:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:03:00.559416157Z [2024-04-28T03:03:00.559+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:03:00.559492194Z 2024-04-28T03:03:00.559502974Z 2024-04-28T03:03:00.562631948Z [2024-04-28T03:03:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:03:00.562754135Z [2024-04-28T03:03:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:03:00.563012807Z [2024-04-28T03:03:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:03:00.563145430Z [2024-04-28T03:03:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:03:00.728659630Z [2024-04-28T03:03:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:02:00+00:00 exited with status queued for try_number 1 2024-04-28T03:03:00.729171238Z [2024-04-28T03:03:00.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:02:00+00:00 exited with status queued for try_number 1 2024-04-28T03:03:00.741520686Z [2024-04-28T03:03:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1003470a-55f7-420b-9a00-777898e513f4 2024-04-28T03:03:00.741686089Z [2024-04-28T03:03:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30353c3e-ab52-4af9-baf0-ba51dfecc8bd 2024-04-28T03:03:04.141474792Z [2024-04-28T03:03:04.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:03:04.141854060Z [2024-04-28T03:03:04.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:02:00+00:00, run_id=scheduled__2024-04-28T03:02:00+00:00, run_start_date=2024-04-28 03:03:00.515054+00:00, run_end_date=2024-04-28 03:03:04.141354+00:00, run_duration=3.6263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:02:00+00:00, data_interval_end=2024-04-28 03:03:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:03:04.156419339Z [2024-04-28T03:03:04.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:03:00+00:00, run_after=2024-04-28T03:04:00+00:00 2024-04-28T03:03:04.166527554Z [2024-04-28T03:03:04.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:03:04.167025610Z [2024-04-28T03:03:04.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:02:00+00:00, run_id=scheduled__2024-04-28T03:02:00+00:00, run_start_date=2024-04-28 03:03:00.516425+00:00, run_end_date=2024-04-28 03:03:04.166447+00:00, run_duration=3.650022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:02:00+00:00, data_interval_end=2024-04-28 03:03:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:03:04.179296674Z [2024-04-28T03:03:04.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:03:00+00:00, run_after=2024-04-28T03:04:00+00:00 2024-04-28T03:03:04.240224566Z [2024-04-28T03:03:04.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:02:00+00:00 exited with status success for try_number 1 2024-04-28T03:03:04.240253692Z [2024-04-28T03:03:04.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:02:00+00:00 exited with status success for try_number 1 2024-04-28T03:03:04.255443415Z [2024-04-28T03:03:04.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:02:00+00:00, map_index=-1, run_start_date=2024-04-28 03:03:02.264204+00:00, run_end_date=2024-04-28 03:03:03.682987+00:00, run_duration=1.418783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:03:00.560054+00:00, queued_by_job_id=1, pid=7408 2024-04-28T03:03:04.255732027Z [2024-04-28T03:03:04.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:02:00+00:00, map_index=-1, run_start_date=2024-04-28 03:03:02.158129+00:00, run_end_date=2024-04-28 03:03:03.819764+00:00, run_duration=1.661635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:03:00.560054+00:00, queued_by_job_id=1, pid=7407 2024-04-28T03:04:00.165562083Z [2024-04-28T03:04:00.164+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:04:00.174794510Z [2024-04-28T03:04:00.174+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:04:00.192097608Z [2024-04-28T03:04:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:04:00+00:00, run_after=2024-04-28T03:05:00+00:00 2024-04-28T03:04:00.271673474Z [2024-04-28T03:04:00.271+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:04:00.271699455Z 2024-04-28T03:04:00.271707076Z 2024-04-28T03:04:00.271712213Z 2024-04-28T03:04:00.271928204Z [2024-04-28T03:04:00.271+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:04:00.272102707Z [2024-04-28T03:04:00.271+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:04:00.272303822Z [2024-04-28T03:04:00.272+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:04:00.273153146Z [2024-04-28T03:04:00.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:04:00.273165739Z 2024-04-28T03:04:00.273175683Z 2024-04-28T03:04:00.273182027Z 2024-04-28T03:04:00.278151598Z [2024-04-28T03:04:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:04:00.278563733Z [2024-04-28T03:04:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:04:00.278948110Z [2024-04-28T03:04:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:04:00.279106010Z [2024-04-28T03:04:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:04:00.279554030Z [2024-04-28T03:04:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:04:00.279739328Z [2024-04-28T03:04:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:04:00.558044836Z [2024-04-28T03:04:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:02:00+00:00 exited with status queued for try_number 1 2024-04-28T03:04:00.558244727Z [2024-04-28T03:04:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:03:00+00:00 exited with status queued for try_number 1 2024-04-28T03:04:00.558474044Z [2024-04-28T03:04:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:03:00+00:00 exited with status queued for try_number 1 2024-04-28T03:04:00.567999815Z [2024-04-28T03:04:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8a4dda9-ad8c-4e8c-b0de-1c82ddac0764 2024-04-28T03:04:00.568328826Z [2024-04-28T03:04:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to d25397d6-031c-496d-a011-6bb2a92586b2 2024-04-28T03:04:00.568465874Z [2024-04-28T03:04:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc03a2ba-a119-44b0-8fb5-a71745b06962 2024-04-28T03:04:01.609115620Z [2024-04-28T03:04:01.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:04:01.609449002Z [2024-04-28T03:04:01.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:02:00+00:00, run_id=scheduled__2024-04-28T03:02:00+00:00, run_start_date=2024-04-28 03:04:00.201115+00:00, run_end_date=2024-04-28 03:04:01.609013+00:00, run_duration=1.407898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:02:00+00:00, data_interval_end=2024-04-28 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:04:01.617467896Z [2024-04-28T03:04:01.617+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:04:00+00:00, run_after=2024-04-28T03:06:00+00:00 2024-04-28T03:04:01.677411844Z [2024-04-28T03:04:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:02:00+00:00 exited with status success for try_number 1 2024-04-28T03:04:01.685296883Z [2024-04-28T03:04:01.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:02:00+00:00, map_index=-1, run_start_date=2024-04-28 03:04:01.015393+00:00, run_end_date=2024-04-28 03:04:01.400244+00:00, run_duration=0.384851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:04:00.274202+00:00, queued_by_job_id=1, pid=7433 2024-04-28T03:04:04.977465337Z [2024-04-28T03:04:04.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:04:04.977934531Z [2024-04-28T03:04:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:03:00+00:00, run_id=scheduled__2024-04-28T03:03:00+00:00, run_start_date=2024-04-28 03:04:00.203922+00:00, run_end_date=2024-04-28 03:04:04.977394+00:00, run_duration=4.773472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:03:00+00:00, data_interval_end=2024-04-28 03:04:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:04:04.987162949Z [2024-04-28T03:04:04.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:04:00+00:00, run_after=2024-04-28T03:05:00+00:00 2024-04-28T03:04:04.993797895Z [2024-04-28T03:04:04.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:04:04.994213402Z [2024-04-28T03:04:04.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:03:00+00:00, run_id=scheduled__2024-04-28T03:03:00+00:00, run_start_date=2024-04-28 03:04:00.202454+00:00, run_end_date=2024-04-28 03:04:04.993879+00:00, run_duration=4.791425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:03:00+00:00, data_interval_end=2024-04-28 03:04:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:04:05.015735439Z [2024-04-28T03:04:05.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:04:00+00:00, run_after=2024-04-28T03:05:00+00:00 2024-04-28T03:04:05.046014581Z [2024-04-28T03:04:05.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:03:00+00:00 exited with status success for try_number 1 2024-04-28T03:04:05.046186639Z [2024-04-28T03:04:05.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:03:00+00:00 exited with status success for try_number 1 2024-04-28T03:04:05.053791252Z [2024-04-28T03:04:05.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:03:00+00:00, map_index=-1, run_start_date=2024-04-28 03:04:02.287220+00:00, run_end_date=2024-04-28 03:04:04.126572+00:00, run_duration=1.839352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:04:00.274202+00:00, queued_by_job_id=1, pid=7477 2024-04-28T03:04:05.057207764Z [2024-04-28T03:04:05.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:03:00+00:00, map_index=-1, run_start_date=2024-04-28 03:04:01.990709+00:00, run_end_date=2024-04-28 03:04:04.284024+00:00, run_duration=2.293315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:04:00.274202+00:00, queued_by_job_id=1, pid=7464 2024-04-28T03:05:00.611882338Z [2024-04-28T03:05:00.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:05:00+00:00, run_after=2024-04-28T03:10:00+00:00 2024-04-28T03:05:00.621102333Z [2024-04-28T03:05:00.620+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:05:00.634905781Z [2024-04-28T03:05:00.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:05:00+00:00, run_after=2024-04-28T03:06:00+00:00 2024-04-28T03:05:00.699721013Z [2024-04-28T03:05:00.699+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:05:00.699747825Z 2024-04-28T03:05:00.699753011Z 2024-04-28T03:05:00.699756612Z 2024-04-28T03:05:00.700151536Z [2024-04-28T03:05:00.699+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:05:00.700378052Z [2024-04-28T03:05:00.700+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:05:00.700642697Z [2024-04-28T03:05:00.700+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:05:00.702961819Z [2024-04-28T03:05:00.702+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:05:00.702974862Z 2024-04-28T03:05:00.702978364Z 2024-04-28T03:05:00.702981765Z 2024-04-28T03:05:00.710925627Z [2024-04-28T03:05:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:05:00.711198415Z [2024-04-28T03:05:00.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:05:00.711536156Z [2024-04-28T03:05:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:05:00.711810428Z [2024-04-28T03:05:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:05:00.712211204Z [2024-04-28T03:05:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:05:00.712495783Z [2024-04-28T03:05:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:05:00.939703402Z [2024-04-28T03:05:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:05:00.939989858Z [2024-04-28T03:05:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:04:00+00:00 exited with status queued for try_number 1 2024-04-28T03:05:00.940207994Z [2024-04-28T03:05:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:04:00+00:00 exited with status queued for try_number 1 2024-04-28T03:05:00.947419000Z [2024-04-28T03:05:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78d1b6ac-77e1-4c09-88e4-525b2a67bae7 2024-04-28T03:05:00.947705967Z [2024-04-28T03:05:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bd2dc4f-8ee4-4dd0-a8bf-9812b88822f0 2024-04-28T03:05:00.947919032Z [2024-04-28T03:05:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddc933b4-6e99-4988-a17d-759971102cc4 2024-04-28T03:05:03.906428787Z [2024-04-28T03:05:03.906+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:05:03.906490195Z 2024-04-28T03:05:03.906495479Z [2024-04-28T03:05:03.906+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:05:03.906954825Z [2024-04-28T03:05:03.906+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:05:03.906964474Z 2024-04-28T03:05:03.909159852Z [2024-04-28T03:05:03.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:05:03.909224150Z [2024-04-28T03:05:03.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:05:03.987262440Z [2024-04-28T03:05:03.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:05:03.987660343Z [2024-04-28T03:05:03.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:05:03.994799603Z [2024-04-28T03:05:03.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 538c5011-ae75-4f94-8a7c-26b090166f42 2024-04-28T03:05:03.995542168Z [2024-04-28T03:05:03.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=-1, run_start_date=2024-04-28 03:05:02.426965+00:00, run_end_date=2024-04-28 03:05:02.900320+00:00, run_duration=0.473355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:05:00.706813+00:00, queued_by_job_id=1, pid=7530 2024-04-28T03:05:05.202968485Z [2024-04-28T03:05:05.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:05:05.203206136Z [2024-04-28T03:05:05.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:04:00+00:00, run_id=scheduled__2024-04-28T03:04:00+00:00, run_start_date=2024-04-28 03:05:00.646079+00:00, run_end_date=2024-04-28 03:05:05.202880+00:00, run_duration=4.556801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:04:00+00:00, data_interval_end=2024-04-28 03:05:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:05:05.213027028Z [2024-04-28T03:05:05.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:05:00+00:00, run_after=2024-04-28T03:06:00+00:00 2024-04-28T03:05:05.220047332Z [2024-04-28T03:05:05.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:05:05.220189792Z [2024-04-28T03:05:05.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:04:00+00:00, run_id=scheduled__2024-04-28T03:04:00+00:00, run_start_date=2024-04-28 03:05:00.645071+00:00, run_end_date=2024-04-28 03:05:05.219961+00:00, run_duration=4.57489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:04:00+00:00, data_interval_end=2024-04-28 03:05:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:05:05.230660349Z [2024-04-28T03:05:05.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:05:00+00:00, run_after=2024-04-28T03:06:00+00:00 2024-04-28T03:05:05.282654863Z [2024-04-28T03:05:05.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:04:00+00:00 exited with status success for try_number 1 2024-04-28T03:05:05.282691234Z [2024-04-28T03:05:05.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:04:00+00:00 exited with status success for try_number 1 2024-04-28T03:05:05.294117396Z [2024-04-28T03:05:05.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:04:00+00:00, map_index=-1, run_start_date=2024-04-28 03:05:02.646316+00:00, run_end_date=2024-04-28 03:05:04.446811+00:00, run_duration=1.800495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:05:00.706813+00:00, queued_by_job_id=1, pid=7539 2024-04-28T03:05:05.296615158Z [2024-04-28T03:05:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:04:00+00:00, map_index=-1, run_start_date=2024-04-28 03:05:02.777043+00:00, run_end_date=2024-04-28 03:05:04.219612+00:00, run_duration=1.442569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:05:00.706813+00:00, queued_by_job_id=1, pid=7549 2024-04-28T03:05:07.501949353Z [2024-04-28T03:05:07.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:05:07.502001148Z 2024-04-28T03:05:07.502451105Z [2024-04-28T03:05:07.501+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:05:07.503411835Z [2024-04-28T03:05:07.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:05:07.503445683Z 2024-04-28T03:05:07.507238764Z [2024-04-28T03:05:07.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:05:07.507437646Z [2024-04-28T03:05:07.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:05:07.568826109Z [2024-04-28T03:05:07.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:05:07.569805007Z [2024-04-28T03:05:07.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:05:07.583465450Z [2024-04-28T03:05:07.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b92af26-6b16-428a-9975-afa391f7eda8 2024-04-28T03:05:07.583878371Z [2024-04-28T03:05:07.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=-1, run_start_date=2024-04-28 03:05:05.945135+00:00, run_end_date=2024-04-28 03:05:06.256026+00:00, run_duration=0.310891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:05:03.907230+00:00, queued_by_job_id=1, pid=7582 2024-04-28T03:05:09.693069355Z [2024-04-28T03:05:09.692+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:05:09.693110631Z 2024-04-28T03:05:09.693119247Z [2024-04-28T03:05:09.692+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:05:09.694224914Z [2024-04-28T03:05:09.693+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:05:09.694242620Z 2024-04-28T03:05:09.697691608Z [2024-04-28T03:05:09.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:05:09.697749007Z [2024-04-28T03:05:09.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:05:09.757922683Z [2024-04-28T03:05:09.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status queued for try_number 1 2024-04-28T03:05:09.758222203Z [2024-04-28T03:05:09.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:05:09.764621623Z [2024-04-28T03:05:09.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3bf9767-2766-48b7-a16d-1b3c55c9d2e3 2024-04-28T03:05:09.764856339Z [2024-04-28T03:05:09.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=0, run_start_date=2024-04-28 03:05:09.137974+00:00, run_end_date=2024-04-28 03:05:09.489671+00:00, run_duration=0.351697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:05:07.503914+00:00, queued_by_job_id=1, pid=7594 2024-04-28T03:05:12.018477464Z [2024-04-28T03:05:12.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:05:12.019056544Z [2024-04-28T03:05:12.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:00:00+00:00, run_id=scheduled__2024-04-28T03:00:00+00:00, run_start_date=2024-04-28 03:05:00.643920+00:00, run_end_date=2024-04-28 03:05:12.018623+00:00, run_duration=11.374703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:00:00+00:00, data_interval_end=2024-04-28 03:05:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:05:12.027004611Z [2024-04-28T03:05:12.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:05:00+00:00, run_after=2024-04-28T03:10:00+00:00 2024-04-28T03:05:12.069084885Z [2024-04-28T03:05:12.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:00:00+00:00 exited with status success for try_number 1 2024-04-28T03:05:12.080246429Z [2024-04-28T03:05:12.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:00:00+00:00, map_index=-1, run_start_date=2024-04-28 03:05:11.253248+00:00, run_end_date=2024-04-28 03:05:11.652606+00:00, run_duration=0.399358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:05:09.694735+00:00, queued_by_job_id=1, pid=7606 2024-04-28T03:06:01.069133830Z [2024-04-28T03:06:01.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:06:01.099097654Z [2024-04-28T03:06:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:06:00+00:00, run_after=2024-04-28T03:07:00+00:00 2024-04-28T03:06:01.113915015Z [2024-04-28T03:06:01.113+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:06:01.193884893Z [2024-04-28T03:06:01.193+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:06:01.193929837Z 2024-04-28T03:06:01.193940634Z 2024-04-28T03:06:01.193949284Z 2024-04-28T03:06:01.194333618Z [2024-04-28T03:06:01.194+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:06:01.194758789Z [2024-04-28T03:06:01.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:06:01.195099063Z [2024-04-28T03:06:01.194+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:06:01.196122143Z [2024-04-28T03:06:01.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:06:01.196133690Z 2024-04-28T03:06:01.196139067Z 2024-04-28T03:06:01.196144378Z 2024-04-28T03:06:01.201242434Z [2024-04-28T03:06:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:06:01.201509531Z [2024-04-28T03:06:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:06:01.201979591Z [2024-04-28T03:06:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:06:01.202181561Z [2024-04-28T03:06:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:06:01.202802005Z [2024-04-28T03:06:01.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:06:01.203043363Z [2024-04-28T03:06:01.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:06:01.500645343Z [2024-04-28T03:06:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:04:00+00:00 exited with status queued for try_number 1 2024-04-28T03:06:01.501012244Z [2024-04-28T03:06:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status queued for try_number 1 2024-04-28T03:06:01.501283129Z [2024-04-28T03:06:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status queued for try_number 1 2024-04-28T03:06:01.511250085Z [2024-04-28T03:06:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8220e4d-9682-4332-a61e-aa5937a06a03 2024-04-28T03:06:01.511622815Z [2024-04-28T03:06:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e90e424-839f-4932-a12e-1b8a6dcd0770 2024-04-28T03:06:01.511877762Z [2024-04-28T03:06:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba9f8625-6535-4b48-9c33-7a6106e7d48e 2024-04-28T03:06:02.693239102Z [2024-04-28T03:06:02.691+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:06:02.697959590Z [2024-04-28T03:06:02.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:04:00+00:00, run_id=scheduled__2024-04-28T03:04:00+00:00, run_start_date=2024-04-28 03:06:01.126942+00:00, run_end_date=2024-04-28 03:06:02.693161+00:00, run_duration=1.566219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:04:00+00:00, data_interval_end=2024-04-28 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:06:02.712008846Z [2024-04-28T03:06:02.711+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:06:00+00:00, run_after=2024-04-28T03:08:00+00:00 2024-04-28T03:06:02.783244532Z [2024-04-28T03:06:02.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:04:00+00:00 exited with status success for try_number 1 2024-04-28T03:06:02.788672386Z [2024-04-28T03:06:02.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:04:00+00:00, map_index=-1, run_start_date=2024-04-28 03:06:01.922530+00:00, run_end_date=2024-04-28 03:06:02.321953+00:00, run_duration=0.399423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:06:01.197361+00:00, queued_by_job_id=1, pid=7620 2024-04-28T03:06:04.921125826Z [2024-04-28T03:06:04.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:06:04.921533297Z [2024-04-28T03:06:04.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:05:00+00:00, run_id=scheduled__2024-04-28T03:05:00+00:00, run_start_date=2024-04-28 03:06:01.128445+00:00, run_end_date=2024-04-28 03:06:04.921049+00:00, run_duration=3.792604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:05:00+00:00, data_interval_end=2024-04-28 03:06:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:06:04.937490275Z [2024-04-28T03:06:04.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:06:00+00:00, run_after=2024-04-28T03:07:00+00:00 2024-04-28T03:06:05.010066029Z [2024-04-28T03:06:05.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status success for try_number 1 2024-04-28T03:06:05.017027389Z [2024-04-28T03:06:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:05:00+00:00, map_index=-1, run_start_date=2024-04-28 03:06:03.188252+00:00, run_end_date=2024-04-28 03:06:04.618144+00:00, run_duration=1.429892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:06:01.197361+00:00, queued_by_job_id=1, pid=7650 2024-04-28T03:06:06.083945427Z [2024-04-28T03:06:06.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:06:06.084656659Z [2024-04-28T03:06:06.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:05:00+00:00, run_id=scheduled__2024-04-28T03:05:00+00:00, run_start_date=2024-04-28 03:06:01.129533+00:00, run_end_date=2024-04-28 03:06:06.083840+00:00, run_duration=4.954307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:05:00+00:00, data_interval_end=2024-04-28 03:06:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:06:06.093750541Z [2024-04-28T03:06:06.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:06:00+00:00, run_after=2024-04-28T03:07:00+00:00 2024-04-28T03:06:06.131931076Z [2024-04-28T03:06:06.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status success for try_number 1 2024-04-28T03:06:06.141862094Z [2024-04-28T03:06:06.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:05:00+00:00, map_index=-1, run_start_date=2024-04-28 03:06:03.288572+00:00, run_end_date=2024-04-28 03:06:05.084551+00:00, run_duration=1.795979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:06:01.197361+00:00, queued_by_job_id=1, pid=7651 2024-04-28T03:06:16.724271509Z [2024-04-28T03:06:16.723+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:07:00.650429429Z [2024-04-28T03:07:00.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:07:00+00:00, run_after=2024-04-28T03:08:00+00:00 2024-04-28T03:07:00.664525616Z [2024-04-28T03:07:00.664+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:07:00.745799831Z [2024-04-28T03:07:00.745+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:07:00.745844928Z 2024-04-28T03:07:00.745850707Z 2024-04-28T03:07:00.746171260Z [2024-04-28T03:07:00.745+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:07:00.746450966Z [2024-04-28T03:07:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:07:00.747314885Z [2024-04-28T03:07:00.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:07:00.747378815Z 2024-04-28T03:07:00.747389960Z 2024-04-28T03:07:00.750647571Z [2024-04-28T03:07:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:07:00.751032930Z [2024-04-28T03:07:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:07:00.751436994Z [2024-04-28T03:07:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:07:00.751616474Z [2024-04-28T03:07:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:07:00.938966632Z [2024-04-28T03:07:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:06:00+00:00 exited with status queued for try_number 1 2024-04-28T03:07:00.939194422Z [2024-04-28T03:07:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:06:00+00:00 exited with status queued for try_number 1 2024-04-28T03:07:00.954918821Z [2024-04-28T03:07:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to c67e640c-7cee-459b-8baf-1bdc32acc182 2024-04-28T03:07:00.956346506Z [2024-04-28T03:07:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3945a3b-efa2-42f9-ac46-df09529128d8 2024-04-28T03:07:04.331270385Z [2024-04-28T03:07:04.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:07:04.331458404Z [2024-04-28T03:07:04.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:06:00+00:00, run_id=scheduled__2024-04-28T03:06:00+00:00, run_start_date=2024-04-28 03:07:00.682517+00:00, run_end_date=2024-04-28 03:07:04.331184+00:00, run_duration=3.648667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:06:00+00:00, data_interval_end=2024-04-28 03:07:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:07:04.361912646Z [2024-04-28T03:07:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:07:00+00:00, run_after=2024-04-28T03:08:00+00:00 2024-04-28T03:07:04.368661551Z [2024-04-28T03:07:04.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:07:04.368766854Z [2024-04-28T03:07:04.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:06:00+00:00, run_id=scheduled__2024-04-28T03:06:00+00:00, run_start_date=2024-04-28 03:07:00.683990+00:00, run_end_date=2024-04-28 03:07:04.368557+00:00, run_duration=3.684567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:06:00+00:00, data_interval_end=2024-04-28 03:07:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:07:04.377336120Z [2024-04-28T03:07:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:07:00+00:00, run_after=2024-04-28T03:08:00+00:00 2024-04-28T03:07:04.439950610Z [2024-04-28T03:07:04.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:06:00+00:00 exited with status success for try_number 1 2024-04-28T03:07:04.439980188Z [2024-04-28T03:07:04.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:06:00+00:00 exited with status success for try_number 1 2024-04-28T03:07:04.452700129Z [2024-04-28T03:07:04.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:06:00+00:00, map_index=-1, run_start_date=2024-04-28 03:07:02.730763+00:00, run_end_date=2024-04-28 03:07:03.944851+00:00, run_duration=1.214088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:07:00.747948+00:00, queued_by_job_id=1, pid=7706 2024-04-28T03:07:04.452791286Z [2024-04-28T03:07:04.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:06:00+00:00, map_index=-1, run_start_date=2024-04-28 03:07:02.543371+00:00, run_end_date=2024-04-28 03:07:04.153417+00:00, run_duration=1.610046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:07:00.747948+00:00, queued_by_job_id=1, pid=7705 2024-04-28T03:08:00.615537414Z [2024-04-28T03:08:00.614+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:08:00.628275411Z [2024-04-28T03:08:00.627+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:08:00.646759607Z [2024-04-28T03:08:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:08:00+00:00, run_after=2024-04-28T03:09:00+00:00 2024-04-28T03:08:00.716853173Z [2024-04-28T03:08:00.716+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:08:00.716884287Z 2024-04-28T03:08:00.716891282Z 2024-04-28T03:08:00.716895609Z 2024-04-28T03:08:00.716990964Z [2024-04-28T03:08:00.716+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:08:00.717222434Z [2024-04-28T03:08:00.717+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:08:00.717420094Z [2024-04-28T03:08:00.717+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:08:00.718045147Z [2024-04-28T03:08:00.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:08:00.718056949Z 2024-04-28T03:08:00.718061049Z 2024-04-28T03:08:00.718064167Z 2024-04-28T03:08:00.721344433Z [2024-04-28T03:08:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:08:00.721579243Z [2024-04-28T03:08:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:08:00.721899368Z [2024-04-28T03:08:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:08:00.722090990Z [2024-04-28T03:08:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:08:00.722434642Z [2024-04-28T03:08:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:08:00.722577326Z [2024-04-28T03:08:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:08:00.952995054Z [2024-04-28T03:08:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:06:00+00:00 exited with status queued for try_number 1 2024-04-28T03:08:00.955203762Z [2024-04-28T03:08:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:07:00+00:00 exited with status queued for try_number 1 2024-04-28T03:08:00.955322659Z [2024-04-28T03:08:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:07:00+00:00 exited with status queued for try_number 1 2024-04-28T03:08:00.963219549Z [2024-04-28T03:08:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97d06ae0-d061-46c6-9e76-860e419d04e5 2024-04-28T03:08:00.963348278Z [2024-04-28T03:08:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42417901-b456-4150-80ee-a0080e8d1d7d 2024-04-28T03:08:00.963495161Z [2024-04-28T03:08:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96767565-003c-4742-b088-30632086c3b7 2024-04-28T03:08:03.424443908Z [2024-04-28T03:08:03.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:08:03.425146121Z [2024-04-28T03:08:03.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:06:00+00:00, run_id=scheduled__2024-04-28T03:06:00+00:00, run_start_date=2024-04-28 03:08:00.657678+00:00, run_end_date=2024-04-28 03:08:03.424573+00:00, run_duration=2.766895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:06:00+00:00, data_interval_end=2024-04-28 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:08:03.449083857Z [2024-04-28T03:08:03.448+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:08:00+00:00, run_after=2024-04-28T03:10:00+00:00 2024-04-28T03:08:03.530557350Z [2024-04-28T03:08:03.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:06:00+00:00 exited with status success for try_number 1 2024-04-28T03:08:03.537270467Z [2024-04-28T03:08:03.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:06:00+00:00, map_index=-1, run_start_date=2024-04-28 03:08:01.514887+00:00, run_end_date=2024-04-28 03:08:02.191688+00:00, run_duration=0.676801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:08:00.718793+00:00, queued_by_job_id=1, pid=7731 2024-04-28T03:08:05.688043289Z [2024-04-28T03:08:05.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:08:05.688509782Z [2024-04-28T03:08:05.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:07:00+00:00, run_id=scheduled__2024-04-28T03:07:00+00:00, run_start_date=2024-04-28 03:08:00.660570+00:00, run_end_date=2024-04-28 03:08:05.688196+00:00, run_duration=5.027626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:07:00+00:00, data_interval_end=2024-04-28 03:08:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:08:05.699196386Z [2024-04-28T03:08:05.698+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:08:00+00:00, run_after=2024-04-28T03:09:00+00:00 2024-04-28T03:08:05.705816815Z [2024-04-28T03:08:05.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:08:05.706055942Z [2024-04-28T03:08:05.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:07:00+00:00, run_id=scheduled__2024-04-28T03:07:00+00:00, run_start_date=2024-04-28 03:08:00.659402+00:00, run_end_date=2024-04-28 03:08:05.705811+00:00, run_duration=5.046409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:07:00+00:00, data_interval_end=2024-04-28 03:08:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:08:05.720014319Z [2024-04-28T03:08:05.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:08:00+00:00, run_after=2024-04-28T03:09:00+00:00 2024-04-28T03:08:05.752232579Z [2024-04-28T03:08:05.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:07:00+00:00 exited with status success for try_number 1 2024-04-28T03:08:05.752389646Z [2024-04-28T03:08:05.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:07:00+00:00 exited with status success for try_number 1 2024-04-28T03:08:05.760238385Z [2024-04-28T03:08:05.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:07:00+00:00, map_index=-1, run_start_date=2024-04-28 03:08:02.967910+00:00, run_end_date=2024-04-28 03:08:05.034940+00:00, run_duration=2.06703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:08:00.718793+00:00, queued_by_job_id=1, pid=7771 2024-04-28T03:08:05.760695525Z [2024-04-28T03:08:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:07:00+00:00, map_index=-1, run_start_date=2024-04-28 03:08:03.043265+00:00, run_end_date=2024-04-28 03:08:04.792603+00:00, run_duration=1.749338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:08:00.718793+00:00, queued_by_job_id=1, pid=7772 2024-04-28T03:09:00.174213921Z [2024-04-28T03:09:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:09:00+00:00, run_after=2024-04-28T03:10:00+00:00 2024-04-28T03:09:00.185239941Z [2024-04-28T03:09:00.184+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:09:00.246298508Z [2024-04-28T03:09:00.245+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:09:00.246317257Z 2024-04-28T03:09:00.246320735Z 2024-04-28T03:09:00.246337386Z [2024-04-28T03:09:00.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:09:00.247836329Z [2024-04-28T03:09:00.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:09:00.247850174Z [2024-04-28T03:09:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:09:00.247853913Z 2024-04-28T03:09:00.247857709Z 2024-04-28T03:09:00.249430653Z [2024-04-28T03:09:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:09:00.251084377Z [2024-04-28T03:09:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:09:00.251311428Z [2024-04-28T03:09:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:09:00.251424101Z [2024-04-28T03:09:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:09:00.462284371Z [2024-04-28T03:09:00.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:08:00+00:00 exited with status queued for try_number 1 2024-04-28T03:09:00.462455048Z [2024-04-28T03:09:00.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:08:00+00:00 exited with status queued for try_number 1 2024-04-28T03:09:00.470307334Z [2024-04-28T03:09:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fa90047-52ad-4b2b-a07c-1d8576613c74 2024-04-28T03:09:00.471193410Z [2024-04-28T03:09:00.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95c51616-9efa-42c5-a956-d09a13df4b3c 2024-04-28T03:09:04.310506514Z [2024-04-28T03:09:04.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:09:04.310840865Z [2024-04-28T03:09:04.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:08:00+00:00, run_id=scheduled__2024-04-28T03:08:00+00:00, run_start_date=2024-04-28 03:09:00.197191+00:00, run_end_date=2024-04-28 03:09:04.310199+00:00, run_duration=4.113008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:08:00+00:00, data_interval_end=2024-04-28 03:09:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:09:04.320040018Z [2024-04-28T03:09:04.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:09:00+00:00, run_after=2024-04-28T03:10:00+00:00 2024-04-28T03:09:04.360331263Z [2024-04-28T03:09:04.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:08:00+00:00 exited with status success for try_number 1 2024-04-28T03:09:04.365661823Z [2024-04-28T03:09:04.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:08:00+00:00, map_index=-1, run_start_date=2024-04-28 03:09:02.014784+00:00, run_end_date=2024-04-28 03:09:03.624980+00:00, run_duration=1.610196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:09:00.247335+00:00, queued_by_job_id=1, pid=7826 2024-04-28T03:09:05.489145175Z [2024-04-28T03:09:05.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:09:05.489381849Z [2024-04-28T03:09:05.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:08:00+00:00, run_id=scheduled__2024-04-28T03:08:00+00:00, run_start_date=2024-04-28 03:09:00.198700+00:00, run_end_date=2024-04-28 03:09:05.489091+00:00, run_duration=5.290391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:08:00+00:00, data_interval_end=2024-04-28 03:09:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:09:05.507206808Z [2024-04-28T03:09:05.506+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:09:00+00:00, run_after=2024-04-28T03:10:00+00:00 2024-04-28T03:09:05.566528248Z [2024-04-28T03:09:05.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:08:00+00:00 exited with status success for try_number 1 2024-04-28T03:09:05.571910444Z [2024-04-28T03:09:05.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:08:00+00:00, map_index=-1, run_start_date=2024-04-28 03:09:02.144213+00:00, run_end_date=2024-04-28 03:09:05.271589+00:00, run_duration=3.127376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:09:00.247335+00:00, queued_by_job_id=1, pid=7827 2024-04-28T03:10:00.834188749Z [2024-04-28T03:10:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:10:00.862766784Z [2024-04-28T03:10:00.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:10:00+00:00, run_after=2024-04-28T03:11:00+00:00 2024-04-28T03:10:00.871537389Z [2024-04-28T03:10:00.871+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:10:00.883910334Z [2024-04-28T03:10:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:10:00+00:00, run_after=2024-04-28T03:15:00+00:00 2024-04-28T03:10:00.996704516Z [2024-04-28T03:10:00.996+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T03:10:00.996731976Z 2024-04-28T03:10:00.996736170Z 2024-04-28T03:10:00.996739986Z 2024-04-28T03:10:00.996743262Z 2024-04-28T03:10:00.996746403Z [2024-04-28T03:10:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:10:00.996992227Z [2024-04-28T03:10:00.996+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:10:00.997212551Z [2024-04-28T03:10:00.997+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:10:00.997423916Z [2024-04-28T03:10:00.997+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:10:00.998063987Z [2024-04-28T03:10:00.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:10:00.998097610Z 2024-04-28T03:10:00.998102763Z 2024-04-28T03:10:00.998106508Z 2024-04-28T03:10:00.998109844Z 2024-04-28T03:10:01.003326412Z [2024-04-28T03:10:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:10:01.003572260Z [2024-04-28T03:10:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:10:01.003895534Z [2024-04-28T03:10:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:10:01.004117281Z [2024-04-28T03:10:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:10:01.004432012Z [2024-04-28T03:10:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:10:01.005881464Z [2024-04-28T03:10:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:10:01.006291453Z [2024-04-28T03:10:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:10:01.006509114Z [2024-04-28T03:10:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:10:01.351135422Z [2024-04-28T03:10:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:01.351403010Z [2024-04-28T03:10:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:08:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:01.351525740Z [2024-04-28T03:10:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:09:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:01.351659281Z [2024-04-28T03:10:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:09:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:01.370634327Z [2024-04-28T03:10:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78d1aade-bc1f-4bb5-abdc-c3fe3537a10f 2024-04-28T03:10:01.370943503Z [2024-04-28T03:10:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to b36c0f5d-105c-4dc1-a934-846c5aa7254e 2024-04-28T03:10:01.371158211Z [2024-04-28T03:10:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1941e6c1-1c05-439c-ab2c-e35ca7b2ad75 2024-04-28T03:10:01.371719937Z [2024-04-28T03:10:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10c1cecc-9a26-4017-8804-85f80b05d7a1 2024-04-28T03:10:03.056135850Z [2024-04-28T03:10:03.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:10:03.058069951Z [2024-04-28T03:10:03.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:08:00+00:00, run_id=scheduled__2024-04-28T03:08:00+00:00, run_start_date=2024-04-28 03:10:00.909976+00:00, run_end_date=2024-04-28 03:10:03.056061+00:00, run_duration=2.146085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:08:00+00:00, data_interval_end=2024-04-28 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:10:03.068388930Z [2024-04-28T03:10:03.068+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:10:00+00:00, run_after=2024-04-28T03:12:00+00:00 2024-04-28T03:10:03.217014783Z [2024-04-28T03:10:03.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:08:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:03.233803776Z [2024-04-28T03:10:03.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:08:00+00:00, map_index=-1, run_start_date=2024-04-28 03:10:02.163630+00:00, run_end_date=2024-04-28 03:10:02.653803+00:00, run_duration=0.490173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:00.999045+00:00, queued_by_job_id=1, pid=7863 2024-04-28T03:10:05.449514005Z [2024-04-28T03:10:05.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:10:05.449655506Z [2024-04-28T03:10:05.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:09:00+00:00, run_id=scheduled__2024-04-28T03:09:00+00:00, run_start_date=2024-04-28 03:10:00.910996+00:00, run_end_date=2024-04-28 03:10:05.449376+00:00, run_duration=4.53838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:09:00+00:00, data_interval_end=2024-04-28 03:10:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:10:05.458485264Z [2024-04-28T03:10:05.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:10:00+00:00, run_after=2024-04-28T03:11:00+00:00 2024-04-28T03:10:05.490988329Z [2024-04-28T03:10:05.490+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:10:05.491025806Z 2024-04-28T03:10:05.491037173Z [2024-04-28T03:10:05.490+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:10:05.491491357Z [2024-04-28T03:10:05.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:10:05.491499990Z 2024-04-28T03:10:05.494174784Z [2024-04-28T03:10:05.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:10:05.494192664Z [2024-04-28T03:10:05.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:10:05.635989181Z [2024-04-28T03:10:05.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:05.636024444Z [2024-04-28T03:10:05.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:05.636028331Z [2024-04-28T03:10:05.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:09:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:05.638514531Z [2024-04-28T03:10:05.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:05:00+00:00, map_index=-1, run_start_date=2024-04-28 03:10:03.914653+00:00, run_end_date=2024-04-28 03:10:04.355579+00:00, run_duration=0.440926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:00.999045+00:00, queued_by_job_id=1, pid=7914 2024-04-28T03:10:05.638546089Z [2024-04-28T03:10:05.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:09:00+00:00, map_index=-1, run_start_date=2024-04-28 03:10:03.430249+00:00, run_end_date=2024-04-28 03:10:04.818092+00:00, run_duration=1.387843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:00.999045+00:00, queued_by_job_id=1, pid=7885 2024-04-28T03:10:05.638736183Z [2024-04-28T03:10:05.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5af96a4-e922-4494-95bf-4618a09cf82a 2024-04-28T03:10:06.906591311Z [2024-04-28T03:10:06.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:10:06.907180348Z [2024-04-28T03:10:06.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:09:00+00:00, run_id=scheduled__2024-04-28T03:09:00+00:00, run_start_date=2024-04-28 03:10:00.911887+00:00, run_end_date=2024-04-28 03:10:06.906502+00:00, run_duration=5.994615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:09:00+00:00, data_interval_end=2024-04-28 03:10:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:10:06.916476572Z [2024-04-28T03:10:06.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:10:00+00:00, run_after=2024-04-28T03:11:00+00:00 2024-04-28T03:10:06.965069737Z [2024-04-28T03:10:06.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:09:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:06.977246542Z [2024-04-28T03:10:06.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:09:00+00:00, map_index=-1, run_start_date=2024-04-28 03:10:03.906138+00:00, run_end_date=2024-04-28 03:10:05.733406+00:00, run_duration=1.827268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:00.999045+00:00, queued_by_job_id=1, pid=7913 2024-04-28T03:10:08.065460602Z [2024-04-28T03:10:08.064+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:10:08.065508931Z 2024-04-28T03:10:08.065517553Z [2024-04-28T03:10:08.065+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:10:08.066280919Z [2024-04-28T03:10:08.065+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:10:08.066323900Z 2024-04-28T03:10:08.069717570Z [2024-04-28T03:10:08.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:10:08.069763220Z [2024-04-28T03:10:08.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:10:08.136869533Z [2024-04-28T03:10:08.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:08.136935536Z [2024-04-28T03:10:08.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:08.144096949Z [2024-04-28T03:10:08.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 191af46b-8fb6-44d6-a074-72728fa2aafa 2024-04-28T03:10:08.144385032Z [2024-04-28T03:10:08.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:05:00+00:00, map_index=-1, run_start_date=2024-04-28 03:10:07.410360+00:00, run_end_date=2024-04-28 03:10:07.810445+00:00, run_duration=0.400085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:05.491751+00:00, queued_by_job_id=1, pid=7947 2024-04-28T03:10:10.663943084Z [2024-04-28T03:10:10.663+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:10:10.663994631Z 2024-04-28T03:10:10.664279822Z [2024-04-28T03:10:10.663+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:10:10.667803961Z [2024-04-28T03:10:10.665+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:10:10.667843202Z 2024-04-28T03:10:10.672944371Z [2024-04-28T03:10:10.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:10:10.673535558Z [2024-04-28T03:10:10.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:10:10.744801421Z [2024-04-28T03:10:10.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status queued for try_number 1 2024-04-28T03:10:10.744846905Z [2024-04-28T03:10:10.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:10.750904095Z [2024-04-28T03:10:10.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0b76e0f-066e-4c58-ad52-e41aad92932c 2024-04-28T03:10:10.751118188Z [2024-04-28T03:10:10.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:05:00+00:00, map_index=0, run_start_date=2024-04-28 03:10:09.744053+00:00, run_end_date=2024-04-28 03:10:10.129528+00:00, run_duration=0.385475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:08.066789+00:00, queued_by_job_id=1, pid=7959 2024-04-28T03:10:13.467157101Z [2024-04-28T03:10:13.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:10:13.467495252Z [2024-04-28T03:10:13.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:05:00+00:00, run_id=scheduled__2024-04-28T03:05:00+00:00, run_start_date=2024-04-28 03:10:00.908634+00:00, run_end_date=2024-04-28 03:10:13.466905+00:00, run_duration=12.558271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:05:00+00:00, data_interval_end=2024-04-28 03:10:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:10:13.473834793Z [2024-04-28T03:10:13.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:10:00+00:00, run_after=2024-04-28T03:15:00+00:00 2024-04-28T03:10:13.513014272Z [2024-04-28T03:10:13.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:05:00+00:00 exited with status success for try_number 1 2024-04-28T03:10:13.519397370Z [2024-04-28T03:10:13.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:05:00+00:00, map_index=-1, run_start_date=2024-04-28 03:10:12.242210+00:00, run_end_date=2024-04-28 03:10:12.636476+00:00, run_duration=0.394266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:10:10.668706+00:00, queued_by_job_id=1, pid=7971 2024-04-28T03:11:00.216841959Z [2024-04-28T03:11:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:11:00.233809511Z [2024-04-28T03:11:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:11:00+00:00, run_after=2024-04-28T03:12:00+00:00 2024-04-28T03:11:00.298289047Z [2024-04-28T03:11:00.297+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:11:00.298314028Z 2024-04-28T03:11:00.298317454Z 2024-04-28T03:11:00.298320751Z [2024-04-28T03:11:00.297+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:11:00.298323801Z [2024-04-28T03:11:00.297+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:11:00.299440077Z [2024-04-28T03:11:00.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:11:00.299454514Z 2024-04-28T03:11:00.299463217Z 2024-04-28T03:11:00.302965937Z [2024-04-28T03:11:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:11:00.303112048Z [2024-04-28T03:11:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:11:00.303354029Z [2024-04-28T03:11:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:11:00.303480987Z [2024-04-28T03:11:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:11:00.554740752Z [2024-04-28T03:11:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:11:00.554987347Z [2024-04-28T03:11:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:11:00.561450432Z [2024-04-28T03:11:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92214301-2b1a-4d34-8bd9-fbbe7e56d80f 2024-04-28T03:11:00.561564575Z [2024-04-28T03:11:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9d59d4a-8448-4549-b2cd-2c69dc070dbb 2024-04-28T03:11:04.054421264Z [2024-04-28T03:11:04.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:11:04.055208339Z [2024-04-28T03:11:04.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:10:00+00:00, run_id=scheduled__2024-04-28T03:10:00+00:00, run_start_date=2024-04-28 03:11:00.248940+00:00, run_end_date=2024-04-28 03:11:04.054220+00:00, run_duration=3.80528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:10:00+00:00, data_interval_end=2024-04-28 03:11:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:11:04.075537650Z [2024-04-28T03:11:04.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:11:00+00:00, run_after=2024-04-28T03:12:00+00:00 2024-04-28T03:11:04.086415464Z [2024-04-28T03:11:04.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:11:04.086925276Z [2024-04-28T03:11:04.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:10:00+00:00, run_id=scheduled__2024-04-28T03:10:00+00:00, run_start_date=2024-04-28 03:11:00.247217+00:00, run_end_date=2024-04-28 03:11:04.086556+00:00, run_duration=3.839339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:10:00+00:00, data_interval_end=2024-04-28 03:11:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:11:04.098903498Z [2024-04-28T03:11:04.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:11:00+00:00, run_after=2024-04-28T03:12:00+00:00 2024-04-28T03:11:04.129304062Z [2024-04-28T03:11:04.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:11:04.129547569Z [2024-04-28T03:11:04.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:11:04.138439231Z [2024-04-28T03:11:04.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=-1, run_start_date=2024-04-28 03:11:02.021775+00:00, run_end_date=2024-04-28 03:11:03.702480+00:00, run_duration=1.680705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:11:00.299095+00:00, queued_by_job_id=1, pid=8004 2024-04-28T03:11:04.138789408Z [2024-04-28T03:11:04.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=-1, run_start_date=2024-04-28 03:11:02.068454+00:00, run_end_date=2024-04-28 03:11:03.401747+00:00, run_duration=1.333293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:11:00.299095+00:00, queued_by_job_id=1, pid=8005 2024-04-28T03:11:16.780793188Z [2024-04-28T03:11:16.780+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:12:00.080096702Z [2024-04-28T03:12:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:12:00+00:00, run_after=2024-04-28T03:13:00+00:00 2024-04-28T03:12:00.097514935Z [2024-04-28T03:12:00.096+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:12:00.116594241Z [2024-04-28T03:12:00.116+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:12:00.217552675Z [2024-04-28T03:12:00.217+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:12:00.217586199Z 2024-04-28T03:12:00.217595164Z 2024-04-28T03:12:00.217601048Z 2024-04-28T03:12:00.217677369Z [2024-04-28T03:12:00.217+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:12:00.217698273Z [2024-04-28T03:12:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:12:00.217719350Z [2024-04-28T03:12:00.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:12:00.218457724Z [2024-04-28T03:12:00.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:12:00.218471742Z 2024-04-28T03:12:00.218477885Z 2024-04-28T03:12:00.218484225Z 2024-04-28T03:12:00.222684790Z [2024-04-28T03:12:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:12:00.222806063Z [2024-04-28T03:12:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:12:00.222923776Z [2024-04-28T03:12:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:12:00.222999862Z [2024-04-28T03:12:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:12:00.223187353Z [2024-04-28T03:12:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:12:00.223296113Z [2024-04-28T03:12:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:12:00.493558735Z [2024-04-28T03:12:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:12:00.494486712Z [2024-04-28T03:12:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:11:00+00:00 exited with status queued for try_number 1 2024-04-28T03:12:00.494951984Z [2024-04-28T03:12:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:11:00+00:00 exited with status queued for try_number 1 2024-04-28T03:12:00.522513936Z [2024-04-28T03:12:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa7caf1b-550d-42be-9233-3723b55e3c2e 2024-04-28T03:12:00.529021698Z [2024-04-28T03:12:00.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bbfc988-04d4-433a-b52f-daaf18a25642 2024-04-28T03:12:00.530046021Z [2024-04-28T03:12:00.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64e95b2e-88d2-47fd-900a-620858a2b444 2024-04-28T03:12:01.691053138Z [2024-04-28T03:12:01.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:12:01.691445720Z [2024-04-28T03:12:01.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:10:00+00:00, run_id=scheduled__2024-04-28T03:10:00+00:00, run_start_date=2024-04-28 03:12:00.132554+00:00, run_end_date=2024-04-28 03:12:01.690924+00:00, run_duration=1.55837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:10:00+00:00, data_interval_end=2024-04-28 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:12:01.700314475Z [2024-04-28T03:12:01.699+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:12:00+00:00, run_after=2024-04-28T03:14:00+00:00 2024-04-28T03:12:01.778750659Z [2024-04-28T03:12:01.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:12:01.787738553Z [2024-04-28T03:12:01.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=-1, run_start_date=2024-04-28 03:12:01.068358+00:00, run_end_date=2024-04-28 03:12:01.460085+00:00, run_duration=0.391727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:12:00.218949+00:00, queued_by_job_id=1, pid=8030 2024-04-28T03:12:04.594621615Z [2024-04-28T03:12:04.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:12:04.595047388Z [2024-04-28T03:12:04.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:11:00+00:00, run_id=scheduled__2024-04-28T03:11:00+00:00, run_start_date=2024-04-28 03:12:00.136372+00:00, run_end_date=2024-04-28 03:12:04.594713+00:00, run_duration=4.458341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:11:00+00:00, data_interval_end=2024-04-28 03:12:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:12:04.604420016Z [2024-04-28T03:12:04.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:12:00+00:00, run_after=2024-04-28T03:13:00+00:00 2024-04-28T03:12:04.611688786Z [2024-04-28T03:12:04.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:12:04.612325523Z [2024-04-28T03:12:04.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:11:00+00:00, run_id=scheduled__2024-04-28T03:11:00+00:00, run_start_date=2024-04-28 03:12:00.134570+00:00, run_end_date=2024-04-28 03:12:04.612018+00:00, run_duration=4.477448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:11:00+00:00, data_interval_end=2024-04-28 03:12:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:12:04.621946143Z [2024-04-28T03:12:04.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:12:00+00:00, run_after=2024-04-28T03:13:00+00:00 2024-04-28T03:12:04.662748981Z [2024-04-28T03:12:04.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:11:00+00:00 exited with status success for try_number 1 2024-04-28T03:12:04.663140672Z [2024-04-28T03:12:04.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:11:00+00:00 exited with status success for try_number 1 2024-04-28T03:12:04.672000507Z [2024-04-28T03:12:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:11:00+00:00, map_index=-1, run_start_date=2024-04-28 03:12:02.143119+00:00, run_end_date=2024-04-28 03:12:03.870744+00:00, run_duration=1.727625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:12:00.218949+00:00, queued_by_job_id=1, pid=8070 2024-04-28T03:12:04.672502393Z [2024-04-28T03:12:04.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:11:00+00:00, map_index=-1, run_start_date=2024-04-28 03:12:02.220672+00:00, run_end_date=2024-04-28 03:12:03.625195+00:00, run_duration=1.404523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:12:00.218949+00:00, queued_by_job_id=1, pid=8071 2024-04-28T03:13:00.782475138Z [2024-04-28T03:13:00.781+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:13:00.800342233Z [2024-04-28T03:13:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:13:00+00:00, run_after=2024-04-28T03:14:00+00:00 2024-04-28T03:13:00.889722220Z [2024-04-28T03:13:00.889+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:13:00.889762285Z 2024-04-28T03:13:00.889771853Z 2024-04-28T03:13:00.890255060Z [2024-04-28T03:13:00.889+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:13:00.890736259Z [2024-04-28T03:13:00.890+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:13:00.892287574Z [2024-04-28T03:13:00.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:13:00.892298853Z 2024-04-28T03:13:00.892302506Z 2024-04-28T03:13:00.896505162Z [2024-04-28T03:13:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:13:00.896730471Z [2024-04-28T03:13:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:13:00.897005789Z [2024-04-28T03:13:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:13:00.897159811Z [2024-04-28T03:13:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:13:01.064971596Z [2024-04-28T03:13:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:12:00+00:00 exited with status queued for try_number 1 2024-04-28T03:13:01.065283707Z [2024-04-28T03:13:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:12:00+00:00 exited with status queued for try_number 1 2024-04-28T03:13:01.073098505Z [2024-04-28T03:13:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f65fd80-e0b2-4854-9466-c12a7a9af406 2024-04-28T03:13:01.073406050Z [2024-04-28T03:13:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f7c0cfa-f5fe-4321-985d-e168a7e01744 2024-04-28T03:13:05.128926802Z [2024-04-28T03:13:05.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:13:05.129172719Z [2024-04-28T03:13:05.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:12:00+00:00, run_id=scheduled__2024-04-28T03:12:00+00:00, run_start_date=2024-04-28 03:13:00.810612+00:00, run_end_date=2024-04-28 03:13:05.128840+00:00, run_duration=4.318228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:12:00+00:00, data_interval_end=2024-04-28 03:13:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:13:05.144771605Z [2024-04-28T03:13:05.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:13:00+00:00, run_after=2024-04-28T03:14:00+00:00 2024-04-28T03:13:05.159666510Z [2024-04-28T03:13:05.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:13:05.160064093Z [2024-04-28T03:13:05.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:12:00+00:00, run_id=scheduled__2024-04-28T03:12:00+00:00, run_start_date=2024-04-28 03:13:00.812098+00:00, run_end_date=2024-04-28 03:13:05.159642+00:00, run_duration=4.347544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:12:00+00:00, data_interval_end=2024-04-28 03:13:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:13:05.174127392Z [2024-04-28T03:13:05.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:13:00+00:00, run_after=2024-04-28T03:14:00+00:00 2024-04-28T03:13:05.217877983Z [2024-04-28T03:13:05.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:12:00+00:00 exited with status success for try_number 1 2024-04-28T03:13:05.218041413Z [2024-04-28T03:13:05.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:12:00+00:00 exited with status success for try_number 1 2024-04-28T03:13:05.240081897Z [2024-04-28T03:13:05.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:12:00+00:00, map_index=-1, run_start_date=2024-04-28 03:13:02.716935+00:00, run_end_date=2024-04-28 03:13:04.344958+00:00, run_duration=1.628023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:13:00.893258+00:00, queued_by_job_id=1, pid=8125 2024-04-28T03:13:05.240170806Z [2024-04-28T03:13:05.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:12:00+00:00, map_index=-1, run_start_date=2024-04-28 03:13:02.822797+00:00, run_end_date=2024-04-28 03:13:04.945016+00:00, run_duration=2.122219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:13:00.893258+00:00, queued_by_job_id=1, pid=8126 2024-04-28T03:14:01.057581018Z [2024-04-28T03:14:01.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:14:00+00:00, run_after=2024-04-28T03:15:00+00:00 2024-04-28T03:14:01.068981068Z [2024-04-28T03:14:01.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:14:01.078033360Z [2024-04-28T03:14:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:14:01.148217030Z [2024-04-28T03:14:01.147+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:14:01.148258995Z 2024-04-28T03:14:01.148267486Z 2024-04-28T03:14:01.148270839Z 2024-04-28T03:14:01.148574796Z [2024-04-28T03:14:01.148+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:14:01.148936730Z [2024-04-28T03:14:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:14:01.149196057Z [2024-04-28T03:14:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:14:01.149829926Z [2024-04-28T03:14:01.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:14:01.149841805Z 2024-04-28T03:14:01.149845398Z 2024-04-28T03:14:01.149863896Z 2024-04-28T03:14:01.156371096Z [2024-04-28T03:14:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:14:01.156805158Z [2024-04-28T03:14:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:14:01.157529800Z [2024-04-28T03:14:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:14:01.157832749Z [2024-04-28T03:14:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:14:01.158421000Z [2024-04-28T03:14:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:14:01.158714913Z [2024-04-28T03:14:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:14:01.419881200Z [2024-04-28T03:14:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:12:00+00:00 exited with status queued for try_number 1 2024-04-28T03:14:01.420221040Z [2024-04-28T03:14:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:13:00+00:00 exited with status queued for try_number 1 2024-04-28T03:14:01.420424948Z [2024-04-28T03:14:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:13:00+00:00 exited with status queued for try_number 1 2024-04-28T03:14:01.428028074Z [2024-04-28T03:14:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7691d0c2-a4da-499a-8126-e9b59c1441bd 2024-04-28T03:14:01.428273879Z [2024-04-28T03:14:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45f4931b-3539-4fd3-b3bb-7e3b834d375c 2024-04-28T03:14:01.428550710Z [2024-04-28T03:14:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68aea0d7-872a-4b2c-9a5e-58beaebb91f2 2024-04-28T03:14:02.467477797Z [2024-04-28T03:14:02.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:14:02.467956647Z [2024-04-28T03:14:02.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:12:00+00:00, run_id=scheduled__2024-04-28T03:12:00+00:00, run_start_date=2024-04-28 03:14:01.090838+00:00, run_end_date=2024-04-28 03:14:02.467383+00:00, run_duration=1.376545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:12:00+00:00, data_interval_end=2024-04-28 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:14:02.475951520Z [2024-04-28T03:14:02.475+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:14:00+00:00, run_after=2024-04-28T03:16:00+00:00 2024-04-28T03:14:03.387281205Z [2024-04-28T03:14:03.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:12:00+00:00 exited with status success for try_number 1 2024-04-28T03:14:03.394960488Z [2024-04-28T03:14:03.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:12:00+00:00, map_index=-1, run_start_date=2024-04-28 03:14:01.983352+00:00, run_end_date=2024-04-28 03:14:02.400762+00:00, run_duration=0.41741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:14:01.150731+00:00, queued_by_job_id=1, pid=8161 2024-04-28T03:14:05.554746679Z [2024-04-28T03:14:05.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:14:05.555292610Z [2024-04-28T03:14:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:13:00+00:00, run_id=scheduled__2024-04-28T03:13:00+00:00, run_start_date=2024-04-28 03:14:01.092018+00:00, run_end_date=2024-04-28 03:14:05.554686+00:00, run_duration=4.462668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:13:00+00:00, data_interval_end=2024-04-28 03:14:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:14:05.564847363Z [2024-04-28T03:14:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:14:00+00:00, run_after=2024-04-28T03:15:00+00:00 2024-04-28T03:14:05.571798425Z [2024-04-28T03:14:05.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:14:05.572171922Z [2024-04-28T03:14:05.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:13:00+00:00, run_id=scheduled__2024-04-28T03:13:00+00:00, run_start_date=2024-04-28 03:14:01.093027+00:00, run_end_date=2024-04-28 03:14:05.571716+00:00, run_duration=4.478689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:13:00+00:00, data_interval_end=2024-04-28 03:14:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:14:05.582574347Z [2024-04-28T03:14:05.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:14:00+00:00, run_after=2024-04-28T03:15:00+00:00 2024-04-28T03:14:05.642490428Z [2024-04-28T03:14:05.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:13:00+00:00 exited with status success for try_number 1 2024-04-28T03:14:05.642524496Z [2024-04-28T03:14:05.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:13:00+00:00 exited with status success for try_number 1 2024-04-28T03:14:05.654734922Z [2024-04-28T03:14:05.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:13:00+00:00, map_index=-1, run_start_date=2024-04-28 03:14:03.268760+00:00, run_end_date=2024-04-28 03:14:04.829437+00:00, run_duration=1.560677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:14:01.150731+00:00, queued_by_job_id=1, pid=8191 2024-04-28T03:14:05.654765787Z [2024-04-28T03:14:05.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:13:00+00:00, map_index=-1, run_start_date=2024-04-28 03:14:03.336541+00:00, run_end_date=2024-04-28 03:14:05.199694+00:00, run_duration=1.863153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:14:01.150731+00:00, queued_by_job_id=1, pid=8192 2024-04-28T03:15:00.286439770Z [2024-04-28T03:15:00.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:15:00+00:00, run_after=2024-04-28T03:20:00+00:00 2024-04-28T03:15:00.306362565Z [2024-04-28T03:15:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:15:00+00:00, run_after=2024-04-28T03:16:00+00:00 2024-04-28T03:15:00.313517090Z [2024-04-28T03:15:00.313+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:15:00.374638987Z [2024-04-28T03:15:00.374+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:15:00.374694694Z 2024-04-28T03:15:00.374701648Z 2024-04-28T03:15:00.374705047Z 2024-04-28T03:15:00.374708325Z [2024-04-28T03:15:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:15:00.374723160Z [2024-04-28T03:15:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:15:00.374726429Z [2024-04-28T03:15:00.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:15:00.375096113Z [2024-04-28T03:15:00.374+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:15:00.375125725Z 2024-04-28T03:15:00.375135601Z 2024-04-28T03:15:00.375143375Z 2024-04-28T03:15:00.378010699Z [2024-04-28T03:15:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:15:00.378218595Z [2024-04-28T03:15:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:15:00.378519982Z [2024-04-28T03:15:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:15:00.378675558Z [2024-04-28T03:15:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:15:00.378871140Z [2024-04-28T03:15:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:15:00.378942413Z [2024-04-28T03:15:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:15:00.638641441Z [2024-04-28T03:15:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:15:00.638826760Z [2024-04-28T03:15:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:14:00+00:00 exited with status queued for try_number 1 2024-04-28T03:15:00.639008604Z [2024-04-28T03:15:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:14:00+00:00 exited with status queued for try_number 1 2024-04-28T03:15:00.649014584Z [2024-04-28T03:15:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33074624-cbbf-45ec-9a1c-8b398899bf74 2024-04-28T03:15:00.649566755Z [2024-04-28T03:15:00.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d73e609-02b9-42f0-9778-bb6dd63b4e05 2024-04-28T03:15:00.649752809Z [2024-04-28T03:15:00.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f024ea-0a58-48f9-a9e6-9ee6f322be28 2024-04-28T03:15:04.934552891Z [2024-04-28T03:15:04.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:15:04.934599777Z [2024-04-28T03:15:04.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:14:00+00:00, run_id=scheduled__2024-04-28T03:14:00+00:00, run_start_date=2024-04-28 03:15:00.324393+00:00, run_end_date=2024-04-28 03:15:04.931812+00:00, run_duration=4.607419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:14:00+00:00, data_interval_end=2024-04-28 03:15:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:15:04.950424620Z [2024-04-28T03:15:04.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:15:00+00:00, run_after=2024-04-28T03:16:00+00:00 2024-04-28T03:15:05.054176768Z [2024-04-28T03:15:05.053+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:15:05.054233465Z 2024-04-28T03:15:05.054310722Z [2024-04-28T03:15:05.054+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:15:05.055756970Z [2024-04-28T03:15:05.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:15:05.055772105Z 2024-04-28T03:15:05.058908667Z [2024-04-28T03:15:05.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:15:05.058998126Z [2024-04-28T03:15:05.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:15:05.137119192Z [2024-04-28T03:15:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:15:05.137206240Z [2024-04-28T03:15:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:15:05.137330182Z [2024-04-28T03:15:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:14:00+00:00 exited with status success for try_number 1 2024-04-28T03:15:05.149589265Z [2024-04-28T03:15:05.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=-1, run_start_date=2024-04-28 03:15:03.267552+00:00, run_end_date=2024-04-28 03:15:03.757084+00:00, run_duration=0.489532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:15:00.375623+00:00, queued_by_job_id=1, pid=8259 2024-04-28T03:15:05.149687519Z [2024-04-28T03:15:05.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a22485c-65a2-4ace-882e-da060884a676 2024-04-28T03:15:05.149955344Z [2024-04-28T03:15:05.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:14:00+00:00, map_index=-1, run_start_date=2024-04-28 03:15:03.127149+00:00, run_end_date=2024-04-28 03:15:04.454281+00:00, run_duration=1.327132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:15:00.375623+00:00, queued_by_job_id=1, pid=8258 2024-04-28T03:15:05.215994152Z [2024-04-28T03:15:05.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:15:05.216161759Z [2024-04-28T03:15:05.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:14:00+00:00, run_id=scheduled__2024-04-28T03:14:00+00:00, run_start_date=2024-04-28 03:15:00.325515+00:00, run_end_date=2024-04-28 03:15:05.215881+00:00, run_duration=4.890366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:14:00+00:00, data_interval_end=2024-04-28 03:15:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:15:05.234935020Z [2024-04-28T03:15:05.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:15:00+00:00, run_after=2024-04-28T03:16:00+00:00 2024-04-28T03:15:05.322895690Z [2024-04-28T03:15:05.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:14:00+00:00 exited with status success for try_number 1 2024-04-28T03:15:05.331253978Z [2024-04-28T03:15:05.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:14:00+00:00, map_index=-1, run_start_date=2024-04-28 03:15:03.084279+00:00, run_end_date=2024-04-28 03:15:04.977556+00:00, run_duration=1.893277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:15:00.375623+00:00, queued_by_job_id=1, pid=8257 2024-04-28T03:15:08.580876191Z [2024-04-28T03:15:08.580+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:15:08.580924790Z 2024-04-28T03:15:08.581074072Z [2024-04-28T03:15:08.580+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:15:08.582015688Z [2024-04-28T03:15:08.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:15:08.582041476Z 2024-04-28T03:15:08.584703269Z [2024-04-28T03:15:08.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:15:08.585045791Z [2024-04-28T03:15:08.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:15:08.635918505Z [2024-04-28T03:15:08.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:15:08.635946891Z [2024-04-28T03:15:08.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:15:08.641682159Z [2024-04-28T03:15:08.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to d17a53c0-d4e2-4d86-bd42-096832b32fe4 2024-04-28T03:15:08.641903993Z [2024-04-28T03:15:08.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=-1, run_start_date=2024-04-28 03:15:06.977089+00:00, run_end_date=2024-04-28 03:15:07.398426+00:00, run_duration=0.421337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:15:05.056309+00:00, queued_by_job_id=1, pid=8301 2024-04-28T03:15:11.999840619Z [2024-04-28T03:15:11.999+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:15:11.999884937Z 2024-04-28T03:15:11.999895818Z [2024-04-28T03:15:11.999+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:15:12.000448364Z [2024-04-28T03:15:12.000+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:15:12.000465353Z 2024-04-28T03:15:12.004596215Z [2024-04-28T03:15:12.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:15:12.006655788Z [2024-04-28T03:15:12.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:15:12.075784459Z [2024-04-28T03:15:12.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status queued for try_number 1 2024-04-28T03:15:12.075897638Z [2024-04-28T03:15:12.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:15:12.083562701Z [2024-04-28T03:15:12.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12838fbe-d1f3-42ca-9706-49c9bd6f7610 2024-04-28T03:15:12.084573018Z [2024-04-28T03:15:12.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=0, run_start_date=2024-04-28 03:15:10.243604+00:00, run_end_date=2024-04-28 03:15:11.533953+00:00, run_duration=1.290349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:15:08.582524+00:00, queued_by_job_id=1, pid=8313 2024-04-28T03:15:14.919113472Z [2024-04-28T03:15:14.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:15:14.919354865Z [2024-04-28T03:15:14.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:10:00+00:00, run_id=scheduled__2024-04-28T03:10:00+00:00, run_start_date=2024-04-28 03:15:00.323111+00:00, run_end_date=2024-04-28 03:15:14.919020+00:00, run_duration=14.595909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:10:00+00:00, data_interval_end=2024-04-28 03:15:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:15:14.926497927Z [2024-04-28T03:15:14.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:15:00+00:00, run_after=2024-04-28T03:20:00+00:00 2024-04-28T03:15:14.974207844Z [2024-04-28T03:15:14.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:10:00+00:00 exited with status success for try_number 1 2024-04-28T03:15:14.983486408Z [2024-04-28T03:15:14.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:10:00+00:00, map_index=-1, run_start_date=2024-04-28 03:15:13.645748+00:00, run_end_date=2024-04-28 03:15:13.967792+00:00, run_duration=0.322044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:15:12.000703+00:00, queued_by_job_id=1, pid=8334 2024-04-28T03:16:00.691000552Z [2024-04-28T03:16:00.690+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:16:00.717368483Z [2024-04-28T03:16:00.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:16:00+00:00, run_after=2024-04-28T03:17:00+00:00 2024-04-28T03:16:00.726493345Z [2024-04-28T03:16:00.726+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:16:00.809488296Z [2024-04-28T03:16:00.809+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:16:00.809518380Z 2024-04-28T03:16:00.809524857Z 2024-04-28T03:16:00.809529733Z 2024-04-28T03:16:00.809755810Z [2024-04-28T03:16:00.809+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:16:00.810028067Z [2024-04-28T03:16:00.809+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:16:00.810587275Z [2024-04-28T03:16:00.810+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:16:00.812242282Z [2024-04-28T03:16:00.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:16:00.812255540Z 2024-04-28T03:16:00.812261064Z 2024-04-28T03:16:00.812265822Z 2024-04-28T03:16:00.816442614Z [2024-04-28T03:16:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:16:00.816710260Z [2024-04-28T03:16:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:16:00.817145236Z [2024-04-28T03:16:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:16:00.817391305Z [2024-04-28T03:16:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:16:00.817730897Z [2024-04-28T03:16:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:16:00.817901283Z [2024-04-28T03:16:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:16:01.050479346Z [2024-04-28T03:16:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:14:00+00:00 exited with status queued for try_number 1 2024-04-28T03:16:01.050866495Z [2024-04-28T03:16:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status queued for try_number 1 2024-04-28T03:16:01.051218710Z [2024-04-28T03:16:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status queued for try_number 1 2024-04-28T03:16:01.063740008Z [2024-04-28T03:16:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71a8c9eb-98d3-49e9-b9cd-18016bf5fe79 2024-04-28T03:16:01.064000113Z [2024-04-28T03:16:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40991acc-3697-4abf-8f00-11a7f195b98d 2024-04-28T03:16:01.064308104Z [2024-04-28T03:16:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a877a7d-33f5-40c5-b81d-af1ba24bdceb 2024-04-28T03:16:02.263405715Z [2024-04-28T03:16:02.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:16:02.264286319Z [2024-04-28T03:16:02.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:14:00+00:00, run_id=scheduled__2024-04-28T03:14:00+00:00, run_start_date=2024-04-28 03:16:00.738799+00:00, run_end_date=2024-04-28 03:16:02.263733+00:00, run_duration=1.524934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:14:00+00:00, data_interval_end=2024-04-28 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:16:02.278873714Z [2024-04-28T03:16:02.278+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:16:00+00:00, run_after=2024-04-28T03:18:00+00:00 2024-04-28T03:16:02.389394432Z [2024-04-28T03:16:02.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:14:00+00:00 exited with status success for try_number 1 2024-04-28T03:16:02.396748030Z [2024-04-28T03:16:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:14:00+00:00, map_index=-1, run_start_date=2024-04-28 03:16:01.513290+00:00, run_end_date=2024-04-28 03:16:01.887809+00:00, run_duration=0.374519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:16:00.813280+00:00, queued_by_job_id=1, pid=8338 2024-04-28T03:16:04.395303545Z [2024-04-28T03:16:04.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:16:04.395946372Z [2024-04-28T03:16:04.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:15:00+00:00, run_id=scheduled__2024-04-28T03:15:00+00:00, run_start_date=2024-04-28 03:16:00.740075+00:00, run_end_date=2024-04-28 03:16:04.395397+00:00, run_duration=3.655322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:15:00+00:00, data_interval_end=2024-04-28 03:16:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:16:04.408581599Z [2024-04-28T03:16:04.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:16:00+00:00, run_after=2024-04-28T03:17:00+00:00 2024-04-28T03:16:04.752080882Z [2024-04-28T03:16:04.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status success for try_number 1 2024-04-28T03:16:04.761621486Z [2024-04-28T03:16:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:15:00+00:00, map_index=-1, run_start_date=2024-04-28 03:16:02.615192+00:00, run_end_date=2024-04-28 03:16:04.303806+00:00, run_duration=1.688614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:16:00.813280+00:00, queued_by_job_id=1, pid=8378 2024-04-28T03:16:05.828513429Z [2024-04-28T03:16:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:16:05.828911038Z [2024-04-28T03:16:05.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:15:00+00:00, run_id=scheduled__2024-04-28T03:15:00+00:00, run_start_date=2024-04-28 03:16:00.742108+00:00, run_end_date=2024-04-28 03:16:05.828407+00:00, run_duration=5.086299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:15:00+00:00, data_interval_end=2024-04-28 03:16:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:16:05.839701469Z [2024-04-28T03:16:05.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:16:00+00:00, run_after=2024-04-28T03:17:00+00:00 2024-04-28T03:16:05.869068141Z [2024-04-28T03:16:05.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status success for try_number 1 2024-04-28T03:16:05.874392773Z [2024-04-28T03:16:05.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:15:00+00:00, map_index=-1, run_start_date=2024-04-28 03:16:02.701681+00:00, run_end_date=2024-04-28 03:16:04.619139+00:00, run_duration=1.917458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:16:00.813280+00:00, queued_by_job_id=1, pid=8379 2024-04-28T03:16:16.860442216Z [2024-04-28T03:16:16.859+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:17:00.515976162Z [2024-04-28T03:17:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:17:00+00:00, run_after=2024-04-28T03:18:00+00:00 2024-04-28T03:17:00.521982916Z [2024-04-28T03:17:00.521+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:17:00.596292932Z [2024-04-28T03:17:00.595+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:17:00.596321004Z 2024-04-28T03:17:00.596325922Z 2024-04-28T03:17:00.596486860Z [2024-04-28T03:17:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:17:00.596718824Z [2024-04-28T03:17:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:17:00.597536024Z [2024-04-28T03:17:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:17:00.597553846Z 2024-04-28T03:17:00.597557460Z 2024-04-28T03:17:00.602694463Z [2024-04-28T03:17:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:17:00.602790979Z [2024-04-28T03:17:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:17:00.603204291Z [2024-04-28T03:17:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:17:00.603392824Z [2024-04-28T03:17:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:17:00.768968527Z [2024-04-28T03:17:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:16:00+00:00 exited with status queued for try_number 1 2024-04-28T03:17:00.769362390Z [2024-04-28T03:17:00.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:16:00+00:00 exited with status queued for try_number 1 2024-04-28T03:17:00.780726118Z [2024-04-28T03:17:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to b97233e4-e9ee-45c3-ab81-75a117cc6a9a 2024-04-28T03:17:00.781034217Z [2024-04-28T03:17:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 941f21f4-ff16-4c9d-99e8-ff33365515e2 2024-04-28T03:17:04.642717967Z [2024-04-28T03:17:04.642+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:17:04.643232541Z [2024-04-28T03:17:04.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:16:00+00:00, run_id=scheduled__2024-04-28T03:16:00+00:00, run_start_date=2024-04-28 03:17:00.536589+00:00, run_end_date=2024-04-28 03:17:04.642842+00:00, run_duration=4.106253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:16:00+00:00, data_interval_end=2024-04-28 03:17:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:17:04.651435777Z [2024-04-28T03:17:04.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:17:00+00:00, run_after=2024-04-28T03:18:00+00:00 2024-04-28T03:17:04.657423001Z [2024-04-28T03:17:04.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:17:04.657815089Z [2024-04-28T03:17:04.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:16:00+00:00, run_id=scheduled__2024-04-28T03:16:00+00:00, run_start_date=2024-04-28 03:17:00.539263+00:00, run_end_date=2024-04-28 03:17:04.657520+00:00, run_duration=4.118257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:16:00+00:00, data_interval_end=2024-04-28 03:17:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:17:04.666047441Z [2024-04-28T03:17:04.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:17:00+00:00, run_after=2024-04-28T03:18:00+00:00 2024-04-28T03:17:04.695964914Z [2024-04-28T03:17:04.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:16:00+00:00 exited with status success for try_number 1 2024-04-28T03:17:04.696387543Z [2024-04-28T03:17:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:16:00+00:00 exited with status success for try_number 1 2024-04-28T03:17:04.702039234Z [2024-04-28T03:17:04.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:16:00+00:00, map_index=-1, run_start_date=2024-04-28 03:17:02.271561+00:00, run_end_date=2024-04-28 03:17:03.601168+00:00, run_duration=1.329607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:17:00.598684+00:00, queued_by_job_id=1, pid=8435 2024-04-28T03:17:04.702551599Z [2024-04-28T03:17:04.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:16:00+00:00, map_index=-1, run_start_date=2024-04-28 03:17:02.257792+00:00, run_end_date=2024-04-28 03:17:03.902830+00:00, run_duration=1.645038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:17:00.598684+00:00, queued_by_job_id=1, pid=8434 2024-04-28T03:18:00.859558863Z [2024-04-28T03:18:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:18:00.866950142Z [2024-04-28T03:18:00.866+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:18:00.880397944Z [2024-04-28T03:18:00.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:18:00+00:00, run_after=2024-04-28T03:19:00+00:00 2024-04-28T03:18:00.972436395Z [2024-04-28T03:18:00.971+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:18:00.972491474Z 2024-04-28T03:18:00.972502162Z 2024-04-28T03:18:00.972505419Z 2024-04-28T03:18:00.972759681Z [2024-04-28T03:18:00.972+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:18:00.973154401Z [2024-04-28T03:18:00.972+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:18:00.973539359Z [2024-04-28T03:18:00.973+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:18:00.974777320Z [2024-04-28T03:18:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:18:00.974809315Z 2024-04-28T03:18:00.974815461Z 2024-04-28T03:18:00.974820253Z 2024-04-28T03:18:00.982045816Z [2024-04-28T03:18:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:18:00.982453059Z [2024-04-28T03:18:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:18:00.982892345Z [2024-04-28T03:18:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:18:00.983110208Z [2024-04-28T03:18:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:18:00.983473191Z [2024-04-28T03:18:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:18:00.983719596Z [2024-04-28T03:18:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:18:01.233802182Z [2024-04-28T03:18:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:16:00+00:00 exited with status queued for try_number 1 2024-04-28T03:18:01.233834434Z [2024-04-28T03:18:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:17:00+00:00 exited with status queued for try_number 1 2024-04-28T03:18:01.233922568Z [2024-04-28T03:18:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:17:00+00:00 exited with status queued for try_number 1 2024-04-28T03:18:01.243068190Z [2024-04-28T03:18:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7b12b73-657f-42fe-a051-127969ad43cb 2024-04-28T03:18:01.243117101Z [2024-04-28T03:18:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 730f0129-a969-4623-a44a-1a5b5065ba6d 2024-04-28T03:18:01.243222681Z [2024-04-28T03:18:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 222108b5-a43e-4b62-b451-71668c2ed449 2024-04-28T03:18:02.758987246Z [2024-04-28T03:18:02.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:18:02.759212613Z [2024-04-28T03:18:02.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:16:00+00:00, run_id=scheduled__2024-04-28T03:16:00+00:00, run_start_date=2024-04-28 03:18:00.899740+00:00, run_end_date=2024-04-28 03:18:02.758887+00:00, run_duration=1.859147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:16:00+00:00, data_interval_end=2024-04-28 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:18:02.793269593Z [2024-04-28T03:18:02.779+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:18:00+00:00, run_after=2024-04-28T03:20:00+00:00 2024-04-28T03:18:02.907822569Z [2024-04-28T03:18:02.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:16:00+00:00 exited with status success for try_number 1 2024-04-28T03:18:02.918084215Z [2024-04-28T03:18:02.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:16:00+00:00, map_index=-1, run_start_date=2024-04-28 03:18:01.707957+00:00, run_end_date=2024-04-28 03:18:02.058469+00:00, run_duration=0.350512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:18:00.976417+00:00, queued_by_job_id=1, pid=8460 2024-04-28T03:18:05.049583576Z [2024-04-28T03:18:05.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:18:05.049817759Z [2024-04-28T03:18:05.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:17:00+00:00, run_id=scheduled__2024-04-28T03:17:00+00:00, run_start_date=2024-04-28 03:18:00.904471+00:00, run_end_date=2024-04-28 03:18:05.049533+00:00, run_duration=4.145062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:17:00+00:00, data_interval_end=2024-04-28 03:18:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:18:05.059579815Z [2024-04-28T03:18:05.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:18:00+00:00, run_after=2024-04-28T03:19:00+00:00 2024-04-28T03:18:05.067238015Z [2024-04-28T03:18:05.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:18:05.067877824Z [2024-04-28T03:18:05.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:17:00+00:00, run_id=scheduled__2024-04-28T03:17:00+00:00, run_start_date=2024-04-28 03:18:00.902204+00:00, run_end_date=2024-04-28 03:18:05.067152+00:00, run_duration=4.164948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:17:00+00:00, data_interval_end=2024-04-28 03:18:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:18:05.079559444Z [2024-04-28T03:18:05.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:18:00+00:00, run_after=2024-04-28T03:19:00+00:00 2024-04-28T03:18:05.145363569Z [2024-04-28T03:18:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:17:00+00:00 exited with status success for try_number 1 2024-04-28T03:18:05.145519778Z [2024-04-28T03:18:05.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:17:00+00:00 exited with status success for try_number 1 2024-04-28T03:18:05.155949707Z [2024-04-28T03:18:05.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:17:00+00:00, map_index=-1, run_start_date=2024-04-28 03:18:02.941509+00:00, run_end_date=2024-04-28 03:18:04.554581+00:00, run_duration=1.613072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:18:00.976417+00:00, queued_by_job_id=1, pid=8501 2024-04-28T03:18:05.156233539Z [2024-04-28T03:18:05.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:17:00+00:00, map_index=-1, run_start_date=2024-04-28 03:18:02.857186+00:00, run_end_date=2024-04-28 03:18:04.273650+00:00, run_duration=1.416464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:18:00.976417+00:00, queued_by_job_id=1, pid=8500 2024-04-28T03:19:00.849281069Z [2024-04-28T03:19:00.848+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:19:00.861218044Z [2024-04-28T03:19:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:19:00+00:00, run_after=2024-04-28T03:20:00+00:00 2024-04-28T03:19:00.937406011Z [2024-04-28T03:19:00.937+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:19:00.937434367Z 2024-04-28T03:19:00.937438671Z 2024-04-28T03:19:00.937649712Z [2024-04-28T03:19:00.937+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:19:00.937851829Z [2024-04-28T03:19:00.937+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:19:00.938561943Z [2024-04-28T03:19:00.938+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:19:00.938575365Z 2024-04-28T03:19:00.938579319Z 2024-04-28T03:19:00.941445903Z [2024-04-28T03:19:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:19:00.941460746Z [2024-04-28T03:19:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:19:00.941895569Z [2024-04-28T03:19:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:19:00.942103517Z [2024-04-28T03:19:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:19:01.107899758Z [2024-04-28T03:19:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:18:00+00:00 exited with status queued for try_number 1 2024-04-28T03:19:01.108188126Z [2024-04-28T03:19:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:18:00+00:00 exited with status queued for try_number 1 2024-04-28T03:19:01.115584464Z [2024-04-28T03:19:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b81b328-70f1-4d43-b48d-a2f4b61f35bc 2024-04-28T03:19:01.115764739Z [2024-04-28T03:19:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca9c026d-7ce2-407e-a7c2-809a02b7c43d 2024-04-28T03:19:04.910119280Z [2024-04-28T03:19:04.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:19:04.910513136Z [2024-04-28T03:19:04.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:18:00+00:00, run_id=scheduled__2024-04-28T03:18:00+00:00, run_start_date=2024-04-28 03:19:00.873561+00:00, run_end_date=2024-04-28 03:19:04.910113+00:00, run_duration=4.036552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:18:00+00:00, data_interval_end=2024-04-28 03:19:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:19:04.921141242Z [2024-04-28T03:19:04.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:19:00+00:00, run_after=2024-04-28T03:20:00+00:00 2024-04-28T03:19:04.936823294Z [2024-04-28T03:19:04.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:19:04.936841294Z [2024-04-28T03:19:04.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:18:00+00:00, run_id=scheduled__2024-04-28T03:18:00+00:00, run_start_date=2024-04-28 03:19:00.875538+00:00, run_end_date=2024-04-28 03:19:04.936031+00:00, run_duration=4.060493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:18:00+00:00, data_interval_end=2024-04-28 03:19:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:19:04.966454305Z [2024-04-28T03:19:04.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:19:00+00:00, run_after=2024-04-28T03:20:00+00:00 2024-04-28T03:19:05.011323933Z [2024-04-28T03:19:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:18:00+00:00 exited with status success for try_number 1 2024-04-28T03:19:05.011396403Z [2024-04-28T03:19:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:18:00+00:00 exited with status success for try_number 1 2024-04-28T03:19:05.025717031Z [2024-04-28T03:19:05.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:18:00+00:00, map_index=-1, run_start_date=2024-04-28 03:19:02.890666+00:00, run_end_date=2024-04-28 03:19:04.205369+00:00, run_duration=1.314703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:19:00.939176+00:00, queued_by_job_id=1, pid=8556 2024-04-28T03:19:05.025818852Z [2024-04-28T03:19:05.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:18:00+00:00, map_index=-1, run_start_date=2024-04-28 03:19:02.658123+00:00, run_end_date=2024-04-28 03:19:04.586898+00:00, run_duration=1.928775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:19:00.939176+00:00, queued_by_job_id=1, pid=8555 2024-04-28T03:20:00.599697424Z [2024-04-28T03:20:00.599+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:20:00.614903716Z [2024-04-28T03:20:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:20:00+00:00, run_after=2024-04-28T03:21:00+00:00 2024-04-28T03:20:00.624157259Z [2024-04-28T03:20:00.623+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:20:00.636941432Z [2024-04-28T03:20:00.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:20:00+00:00, run_after=2024-04-28T03:25:00+00:00 2024-04-28T03:20:00.714852838Z [2024-04-28T03:20:00.714+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T03:20:00.714879476Z 2024-04-28T03:20:00.714882820Z 2024-04-28T03:20:00.714886670Z 2024-04-28T03:20:00.714889906Z 2024-04-28T03:20:00.715137027Z [2024-04-28T03:20:00.714+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:20:00.715472516Z [2024-04-28T03:20:00.715+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:20:00.717506931Z [2024-04-28T03:20:00.715+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:20:00.717520328Z [2024-04-28T03:20:00.715+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:20:00.717524493Z [2024-04-28T03:20:00.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:20:00.717528344Z 2024-04-28T03:20:00.717532326Z 2024-04-28T03:20:00.717535576Z 2024-04-28T03:20:00.717538826Z 2024-04-28T03:20:00.720254132Z [2024-04-28T03:20:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:20:00.720550242Z [2024-04-28T03:20:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:20:00.720845239Z [2024-04-28T03:20:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:20:00.721030330Z [2024-04-28T03:20:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:20:00.721340940Z [2024-04-28T03:20:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:20:00.721542309Z [2024-04-28T03:20:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:20:00.721781772Z [2024-04-28T03:20:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:20:00.721947211Z [2024-04-28T03:20:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:20:01.223879381Z [2024-04-28T03:20:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:01.223962761Z [2024-04-28T03:20:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:18:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:01.224005832Z [2024-04-28T03:20:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:19:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:01.224023964Z [2024-04-28T03:20:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:19:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:01.237637171Z [2024-04-28T03:20:01.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43679b87-3ac1-48af-97f6-0f3b923c3625 2024-04-28T03:20:01.237735165Z [2024-04-28T03:20:01.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc68c197-9974-49f6-94ef-0d2825106c68 2024-04-28T03:20:01.237793685Z [2024-04-28T03:20:01.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to f528252d-6e48-4aee-9f35-376cec54f4c4 2024-04-28T03:20:01.237896850Z [2024-04-28T03:20:01.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dc88e5b-aed3-4481-b2d6-c777db147a79 2024-04-28T03:20:03.474397330Z [2024-04-28T03:20:03.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:20:03.478954169Z [2024-04-28T03:20:03.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:18:00+00:00, run_id=scheduled__2024-04-28T03:18:00+00:00, run_start_date=2024-04-28 03:20:00.650956+00:00, run_end_date=2024-04-28 03:20:03.478437+00:00, run_duration=2.827481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:18:00+00:00, data_interval_end=2024-04-28 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:20:03.491027659Z [2024-04-28T03:20:03.490+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:20:00+00:00, run_after=2024-04-28T03:22:00+00:00 2024-04-28T03:20:03.557437593Z [2024-04-28T03:20:03.557+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:20:03.557452149Z 2024-04-28T03:20:03.557696924Z [2024-04-28T03:20:03.557+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:20:03.558634218Z [2024-04-28T03:20:03.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:20:03.558641356Z 2024-04-28T03:20:03.562251500Z [2024-04-28T03:20:03.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:20:03.562486289Z [2024-04-28T03:20:03.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:20:03.648677002Z [2024-04-28T03:20:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:03.649883832Z [2024-04-28T03:20:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:18:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:03.657194311Z [2024-04-28T03:20:03.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 159e109c-219d-4253-ab31-4221e9f71c1e 2024-04-28T03:20:03.659755783Z [2024-04-28T03:20:03.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:18:00+00:00, map_index=-1, run_start_date=2024-04-28 03:20:02.040356+00:00, run_end_date=2024-04-28 03:20:02.522075+00:00, run_duration=0.481719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:00.717765+00:00, queued_by_job_id=1, pid=8594 2024-04-28T03:20:03.790691641Z [2024-04-28T03:20:03.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:03.796280617Z [2024-04-28T03:20:03.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:15:00+00:00, map_index=-1, run_start_date=2024-04-28 03:20:02.973628+00:00, run_end_date=2024-04-28 03:20:03.374707+00:00, run_duration=0.401079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:00.717765+00:00, queued_by_job_id=1, pid=8619 2024-04-28T03:20:04.869074629Z [2024-04-28T03:20:04.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:20:04.869614269Z [2024-04-28T03:20:04.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:19:00+00:00, run_id=scheduled__2024-04-28T03:19:00+00:00, run_start_date=2024-04-28 03:20:00.652095+00:00, run_end_date=2024-04-28 03:20:04.868983+00:00, run_duration=4.216888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:19:00+00:00, data_interval_end=2024-04-28 03:20:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:20:04.896677302Z [2024-04-28T03:20:04.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:20:00+00:00, run_after=2024-04-28T03:21:00+00:00 2024-04-28T03:20:05.003648740Z [2024-04-28T03:20:04.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:19:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:05.008319953Z [2024-04-28T03:20:05.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:19:00+00:00, map_index=-1, run_start_date=2024-04-28 03:20:03.265939+00:00, run_end_date=2024-04-28 03:20:04.701091+00:00, run_duration=1.435152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:00.717765+00:00, queued_by_job_id=1, pid=8638 2024-04-28T03:20:06.096116728Z [2024-04-28T03:20:06.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:20:06.096319769Z [2024-04-28T03:20:06.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:19:00+00:00, run_id=scheduled__2024-04-28T03:19:00+00:00, run_start_date=2024-04-28 03:20:00.653306+00:00, run_end_date=2024-04-28 03:20:06.096039+00:00, run_duration=5.442733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:19:00+00:00, data_interval_end=2024-04-28 03:20:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:20:06.119695136Z [2024-04-28T03:20:06.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:20:00+00:00, run_after=2024-04-28T03:21:00+00:00 2024-04-28T03:20:06.229334451Z [2024-04-28T03:20:06.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:19:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:06.235495213Z [2024-04-28T03:20:06.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:19:00+00:00, map_index=-1, run_start_date=2024-04-28 03:20:03.304134+00:00, run_end_date=2024-04-28 03:20:05.195913+00:00, run_duration=1.891779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:00.717765+00:00, queued_by_job_id=1, pid=8644 2024-04-28T03:20:07.314751292Z [2024-04-28T03:20:07.314+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:20:07.314806196Z 2024-04-28T03:20:07.314976151Z [2024-04-28T03:20:07.314+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:20:07.315734180Z [2024-04-28T03:20:07.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:20:07.315749675Z 2024-04-28T03:20:07.318273009Z [2024-04-28T03:20:07.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:20:07.318539600Z [2024-04-28T03:20:07.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:20:07.361396767Z [2024-04-28T03:20:07.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:07.361470325Z [2024-04-28T03:20:07.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:07.373973536Z [2024-04-28T03:20:07.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ac02f91-88e5-40d2-9293-3970247e663e 2024-04-28T03:20:07.374258686Z [2024-04-28T03:20:07.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:15:00+00:00, map_index=-1, run_start_date=2024-04-28 03:20:05.799249+00:00, run_end_date=2024-04-28 03:20:06.214744+00:00, run_duration=0.415495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:03.559397+00:00, queued_by_job_id=1, pid=8677 2024-04-28T03:20:11.035580807Z [2024-04-28T03:20:11.034+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:20:11.035642112Z 2024-04-28T03:20:11.036300669Z [2024-04-28T03:20:11.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:20:11.037619910Z [2024-04-28T03:20:11.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:20:11.037632991Z 2024-04-28T03:20:11.042850796Z [2024-04-28T03:20:11.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:20:11.043251701Z [2024-04-28T03:20:11.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:20:11.113042240Z [2024-04-28T03:20:11.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status queued for try_number 1 2024-04-28T03:20:11.113478218Z [2024-04-28T03:20:11.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:11.119574376Z [2024-04-28T03:20:11.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0f0712c-38e5-460e-8da2-365125eb590c 2024-04-28T03:20:11.120438054Z [2024-04-28T03:20:11.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:15:00+00:00, map_index=0, run_start_date=2024-04-28 03:20:08.933363+00:00, run_end_date=2024-04-28 03:20:10.291700+00:00, run_duration=1.358337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:07.316282+00:00, queued_by_job_id=1, pid=8689 2024-04-28T03:20:13.344072858Z [2024-04-28T03:20:13.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:20:13.346311176Z [2024-04-28T03:20:13.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:15:00+00:00, run_id=scheduled__2024-04-28T03:15:00+00:00, run_start_date=2024-04-28 03:20:00.649551+00:00, run_end_date=2024-04-28 03:20:13.343976+00:00, run_duration=12.694425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:15:00+00:00, data_interval_end=2024-04-28 03:20:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:20:13.351307966Z [2024-04-28T03:20:13.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:20:00+00:00, run_after=2024-04-28T03:25:00+00:00 2024-04-28T03:20:13.382107232Z [2024-04-28T03:20:13.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:15:00+00:00 exited with status success for try_number 1 2024-04-28T03:20:13.387374847Z [2024-04-28T03:20:13.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:15:00+00:00, map_index=-1, run_start_date=2024-04-28 03:20:12.901332+00:00, run_end_date=2024-04-28 03:20:13.229832+00:00, run_duration=0.3285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:20:11.038260+00:00, queued_by_job_id=1, pid=8710 2024-04-28T03:21:00.671119380Z [2024-04-28T03:21:00.670+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:21:00.698409377Z [2024-04-28T03:21:00.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:21:00+00:00, run_after=2024-04-28T03:22:00+00:00 2024-04-28T03:21:00.810292665Z [2024-04-28T03:21:00.809+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:21:00.810348796Z 2024-04-28T03:21:00.810357924Z 2024-04-28T03:21:00.810754392Z [2024-04-28T03:21:00.810+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:21:00.811114822Z [2024-04-28T03:21:00.810+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:21:00.812085244Z [2024-04-28T03:21:00.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:21:00.812127289Z 2024-04-28T03:21:00.812132577Z 2024-04-28T03:21:00.816628812Z [2024-04-28T03:21:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:21:00.816775305Z [2024-04-28T03:21:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:21:00.817249169Z [2024-04-28T03:21:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:21:00.817554732Z [2024-04-28T03:21:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:21:01.031915293Z [2024-04-28T03:21:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:21:01.032279267Z [2024-04-28T03:21:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:21:01.042907103Z [2024-04-28T03:21:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 617d5b0f-7dc8-48af-8612-720e996616e6 2024-04-28T03:21:01.043318415Z [2024-04-28T03:21:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9cb2980-6c51-47de-8f9b-df28ea90a6d9 2024-04-28T03:21:05.771484020Z [2024-04-28T03:21:05.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:21:05.772274308Z [2024-04-28T03:21:05.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:20:00+00:00, run_id=scheduled__2024-04-28T03:20:00+00:00, run_start_date=2024-04-28 03:21:00.724419+00:00, run_end_date=2024-04-28 03:21:05.771398+00:00, run_duration=5.046979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:20:00+00:00, data_interval_end=2024-04-28 03:21:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:21:05.789066297Z [2024-04-28T03:21:05.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:21:00+00:00, run_after=2024-04-28T03:22:00+00:00 2024-04-28T03:21:05.800509227Z [2024-04-28T03:21:05.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:21:05.801214036Z [2024-04-28T03:21:05.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:20:00+00:00, run_id=scheduled__2024-04-28T03:20:00+00:00, run_start_date=2024-04-28 03:21:00.721535+00:00, run_end_date=2024-04-28 03:21:05.800425+00:00, run_duration=5.07889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:20:00+00:00, data_interval_end=2024-04-28 03:21:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:21:05.815918925Z [2024-04-28T03:21:05.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:21:00+00:00, run_after=2024-04-28T03:22:00+00:00 2024-04-28T03:21:05.847550123Z [2024-04-28T03:21:05.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:21:05.847824637Z [2024-04-28T03:21:05.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:21:05.860145923Z [2024-04-28T03:21:05.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=-1, run_start_date=2024-04-28 03:21:02.781162+00:00, run_end_date=2024-04-28 03:21:05.267545+00:00, run_duration=2.486383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:21:00.812951+00:00, queued_by_job_id=1, pid=8743 2024-04-28T03:21:05.860825155Z [2024-04-28T03:21:05.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=-1, run_start_date=2024-04-28 03:21:03.065802+00:00, run_end_date=2024-04-28 03:21:04.735993+00:00, run_duration=1.670191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:21:00.812951+00:00, queued_by_job_id=1, pid=8744 2024-04-28T03:21:16.932222198Z [2024-04-28T03:21:16.931+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:22:00.126166503Z [2024-04-28T03:22:00.125+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:22:00.140300991Z [2024-04-28T03:22:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:22:00+00:00, run_after=2024-04-28T03:23:00+00:00 2024-04-28T03:22:00.163520685Z [2024-04-28T03:22:00.163+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:22:00.233786549Z [2024-04-28T03:22:00.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:22:00.233818338Z 2024-04-28T03:22:00.233829375Z 2024-04-28T03:22:00.233836065Z 2024-04-28T03:22:00.233843756Z [2024-04-28T03:22:00.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:22:00.234022365Z [2024-04-28T03:22:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:22:00.234104529Z [2024-04-28T03:22:00.233+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:22:00.234749943Z [2024-04-28T03:22:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:22:00.234769063Z 2024-04-28T03:22:00.234776950Z 2024-04-28T03:22:00.234784133Z 2024-04-28T03:22:00.237983989Z [2024-04-28T03:22:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:22:00.238129572Z [2024-04-28T03:22:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:22:00.238228526Z [2024-04-28T03:22:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:22:00.239888364Z [2024-04-28T03:22:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:22:00.239917631Z [2024-04-28T03:22:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:22:00.239927463Z [2024-04-28T03:22:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:22:00.528851754Z [2024-04-28T03:22:00.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:22:00.528879082Z [2024-04-28T03:22:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:21:00+00:00 exited with status queued for try_number 1 2024-04-28T03:22:00.528882955Z [2024-04-28T03:22:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:21:00+00:00 exited with status queued for try_number 1 2024-04-28T03:22:00.573543389Z [2024-04-28T03:22:00.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4f7107f-078a-4f92-ac0e-b7a4768a4be8 2024-04-28T03:22:00.573577367Z [2024-04-28T03:22:00.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48f84731-6f74-43ca-a344-54736fbb5362 2024-04-28T03:22:00.573604408Z [2024-04-28T03:22:00.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 348d5ea2-7d09-4f45-8581-31bd0d326308 2024-04-28T03:22:01.728692541Z [2024-04-28T03:22:01.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:22:01.729237987Z [2024-04-28T03:22:01.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:20:00+00:00, run_id=scheduled__2024-04-28T03:20:00+00:00, run_start_date=2024-04-28 03:22:00.180581+00:00, run_end_date=2024-04-28 03:22:01.728669+00:00, run_duration=1.548088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:20:00+00:00, data_interval_end=2024-04-28 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:22:01.738445877Z [2024-04-28T03:22:01.738+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:22:00+00:00, run_after=2024-04-28T03:24:00+00:00 2024-04-28T03:22:01.840753135Z [2024-04-28T03:22:01.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:22:01.843129846Z [2024-04-28T03:22:01.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=-1, run_start_date=2024-04-28 03:22:01.079515+00:00, run_end_date=2024-04-28 03:22:01.434698+00:00, run_duration=0.355183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:22:00.235428+00:00, queued_by_job_id=1, pid=8769 2024-04-28T03:22:03.973619405Z [2024-04-28T03:22:03.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:22:03.973902968Z [2024-04-28T03:22:03.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:21:00+00:00, run_id=scheduled__2024-04-28T03:21:00+00:00, run_start_date=2024-04-28 03:22:00.183680+00:00, run_end_date=2024-04-28 03:22:03.973602+00:00, run_duration=3.789922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:21:00+00:00, data_interval_end=2024-04-28 03:22:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:22:03.982816901Z [2024-04-28T03:22:03.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:22:00+00:00, run_after=2024-04-28T03:23:00+00:00 2024-04-28T03:22:03.991104019Z [2024-04-28T03:22:03.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:22:03.991406821Z [2024-04-28T03:22:03.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:21:00+00:00, run_id=scheduled__2024-04-28T03:21:00+00:00, run_start_date=2024-04-28 03:22:00.182194+00:00, run_end_date=2024-04-28 03:22:03.991085+00:00, run_duration=3.808891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:21:00+00:00, data_interval_end=2024-04-28 03:22:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:22:04.026070901Z [2024-04-28T03:22:04.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:22:00+00:00, run_after=2024-04-28T03:23:00+00:00 2024-04-28T03:22:04.060662299Z [2024-04-28T03:22:04.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:21:00+00:00 exited with status success for try_number 1 2024-04-28T03:22:04.060779780Z [2024-04-28T03:22:04.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:21:00+00:00 exited with status success for try_number 1 2024-04-28T03:22:04.066796153Z [2024-04-28T03:22:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:21:00+00:00, map_index=-1, run_start_date=2024-04-28 03:22:02.316424+00:00, run_end_date=2024-04-28 03:22:03.759519+00:00, run_duration=1.443095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:22:00.235428+00:00, queued_by_job_id=1, pid=8809 2024-04-28T03:22:04.066988294Z [2024-04-28T03:22:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:21:00+00:00, map_index=-1, run_start_date=2024-04-28 03:22:02.351357+00:00, run_end_date=2024-04-28 03:22:03.653996+00:00, run_duration=1.302639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:22:00.235428+00:00, queued_by_job_id=1, pid=8810 2024-04-28T03:23:00.558283181Z [2024-04-28T03:23:00.557+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:23:00.583032915Z [2024-04-28T03:23:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:23:00+00:00, run_after=2024-04-28T03:24:00+00:00 2024-04-28T03:23:00.646955297Z [2024-04-28T03:23:00.646+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:23:00.646994431Z 2024-04-28T03:23:00.647001372Z 2024-04-28T03:23:00.647007761Z [2024-04-28T03:23:00.646+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:23:00.647168960Z [2024-04-28T03:23:00.646+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:23:00.647829110Z [2024-04-28T03:23:00.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:23:00.647840730Z 2024-04-28T03:23:00.647846745Z 2024-04-28T03:23:00.651124819Z [2024-04-28T03:23:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:23:00.651302366Z [2024-04-28T03:23:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:23:00.651599982Z [2024-04-28T03:23:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:23:00.651725883Z [2024-04-28T03:23:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:23:00.801852571Z [2024-04-28T03:23:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:22:00+00:00 exited with status queued for try_number 1 2024-04-28T03:23:00.801889773Z [2024-04-28T03:23:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:22:00+00:00 exited with status queued for try_number 1 2024-04-28T03:23:00.809913906Z [2024-04-28T03:23:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45ccd940-6779-44c4-a952-e3dfc08c980b 2024-04-28T03:23:00.809940027Z [2024-04-28T03:23:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a6a3d88-d381-448a-b71e-152f90b6934a 2024-04-28T03:23:04.303945001Z [2024-04-28T03:23:04.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:23:04.304820519Z [2024-04-28T03:23:04.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:22:00+00:00, run_id=scheduled__2024-04-28T03:22:00+00:00, run_start_date=2024-04-28 03:23:00.600752+00:00, run_end_date=2024-04-28 03:23:04.304419+00:00, run_duration=3.703667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:22:00+00:00, data_interval_end=2024-04-28 03:23:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:23:04.317715821Z [2024-04-28T03:23:04.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:23:00+00:00, run_after=2024-04-28T03:24:00+00:00 2024-04-28T03:23:04.334996990Z [2024-04-28T03:23:04.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:23:04.335396527Z [2024-04-28T03:23:04.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:22:00+00:00, run_id=scheduled__2024-04-28T03:22:00+00:00, run_start_date=2024-04-28 03:23:00.599126+00:00, run_end_date=2024-04-28 03:23:04.335047+00:00, run_duration=3.735921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:22:00+00:00, data_interval_end=2024-04-28 03:23:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:23:04.360583927Z [2024-04-28T03:23:04.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:23:00+00:00, run_after=2024-04-28T03:24:00+00:00 2024-04-28T03:23:04.441851617Z [2024-04-28T03:23:04.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:22:00+00:00 exited with status success for try_number 1 2024-04-28T03:23:04.450003816Z [2024-04-28T03:23:04.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:22:00+00:00, map_index=-1, run_start_date=2024-04-28 03:23:02.564682+00:00, run_end_date=2024-04-28 03:23:03.858946+00:00, run_duration=1.294264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:23:00.648329+00:00, queued_by_job_id=1, pid=8863 2024-04-28T03:23:05.545405732Z [2024-04-28T03:23:05.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:22:00+00:00 exited with status success for try_number 1 2024-04-28T03:23:05.553709606Z [2024-04-28T03:23:05.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:22:00+00:00, map_index=-1, run_start_date=2024-04-28 03:23:02.607014+00:00, run_end_date=2024-04-28 03:23:04.228753+00:00, run_duration=1.621739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:23:00.648329+00:00, queued_by_job_id=1, pid=8864 2024-04-28T03:24:00.919761969Z [2024-04-28T03:24:00.919+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:24:00.929106274Z [2024-04-28T03:24:00.928+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:24:00.944069046Z [2024-04-28T03:24:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:24:00+00:00, run_after=2024-04-28T03:25:00+00:00 2024-04-28T03:24:01.039447462Z [2024-04-28T03:24:01.038+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:24:01.039491281Z 2024-04-28T03:24:01.039502770Z 2024-04-28T03:24:01.039508063Z 2024-04-28T03:24:01.039805437Z [2024-04-28T03:24:01.039+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:24:01.040171377Z [2024-04-28T03:24:01.039+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:24:01.040508235Z [2024-04-28T03:24:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:24:01.042031120Z [2024-04-28T03:24:01.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:24:01.042070419Z 2024-04-28T03:24:01.042081951Z 2024-04-28T03:24:01.042091594Z 2024-04-28T03:24:01.048951451Z [2024-04-28T03:24:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:24:01.049229374Z [2024-04-28T03:24:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:24:01.049694857Z [2024-04-28T03:24:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:24:01.049927068Z [2024-04-28T03:24:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:24:01.050457016Z [2024-04-28T03:24:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:24:01.050804085Z [2024-04-28T03:24:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:24:01.259174811Z [2024-04-28T03:24:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:22:00+00:00 exited with status queued for try_number 1 2024-04-28T03:24:01.259298504Z [2024-04-28T03:24:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:23:00+00:00 exited with status queued for try_number 1 2024-04-28T03:24:01.259496716Z [2024-04-28T03:24:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:23:00+00:00 exited with status queued for try_number 1 2024-04-28T03:24:01.273333242Z [2024-04-28T03:24:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5450495-b9f8-4b78-8101-9aa36dabc225 2024-04-28T03:24:01.273450950Z [2024-04-28T03:24:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5c3b045-b86f-4ced-9aea-7e4d48acca11 2024-04-28T03:24:01.273620575Z [2024-04-28T03:24:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0cf9340-d713-4e1a-aceb-0e4ec04f839d 2024-04-28T03:24:02.428604427Z [2024-04-28T03:24:02.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:24:02.428656077Z [2024-04-28T03:24:02.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:22:00+00:00, run_id=scheduled__2024-04-28T03:22:00+00:00, run_start_date=2024-04-28 03:24:00.958034+00:00, run_end_date=2024-04-28 03:24:02.426628+00:00, run_duration=1.468594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:22:00+00:00, data_interval_end=2024-04-28 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:24:02.443352605Z [2024-04-28T03:24:02.443+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:24:00+00:00, run_after=2024-04-28T03:26:00+00:00 2024-04-28T03:24:02.531287004Z [2024-04-28T03:24:02.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:22:00+00:00 exited with status success for try_number 1 2024-04-28T03:24:02.550019063Z [2024-04-28T03:24:02.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:22:00+00:00, map_index=-1, run_start_date=2024-04-28 03:24:01.782164+00:00, run_end_date=2024-04-28 03:24:02.229515+00:00, run_duration=0.447351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:24:01.043750+00:00, queued_by_job_id=1, pid=8891 2024-04-28T03:24:05.633078703Z [2024-04-28T03:24:05.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:24:05.633109658Z [2024-04-28T03:24:05.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:23:00+00:00, run_id=scheduled__2024-04-28T03:23:00+00:00, run_start_date=2024-04-28 03:24:00.960989+00:00, run_end_date=2024-04-28 03:24:05.632198+00:00, run_duration=4.671209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:23:00+00:00, data_interval_end=2024-04-28 03:24:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:24:05.646886824Z [2024-04-28T03:24:05.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:24:00+00:00, run_after=2024-04-28T03:25:00+00:00 2024-04-28T03:24:05.676005147Z [2024-04-28T03:24:05.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:24:05.676033679Z [2024-04-28T03:24:05.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:23:00+00:00, run_id=scheduled__2024-04-28T03:23:00+00:00, run_start_date=2024-04-28 03:24:00.959653+00:00, run_end_date=2024-04-28 03:24:05.654555+00:00, run_duration=4.694902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:23:00+00:00, data_interval_end=2024-04-28 03:24:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:24:05.676052262Z [2024-04-28T03:24:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:24:00+00:00, run_after=2024-04-28T03:25:00+00:00 2024-04-28T03:24:05.729964332Z [2024-04-28T03:24:05.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:23:00+00:00 exited with status success for try_number 1 2024-04-28T03:24:05.730311119Z [2024-04-28T03:24:05.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:23:00+00:00 exited with status success for try_number 1 2024-04-28T03:24:05.746284301Z [2024-04-28T03:24:05.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:23:00+00:00, map_index=-1, run_start_date=2024-04-28 03:24:03.239744+00:00, run_end_date=2024-04-28 03:24:04.588482+00:00, run_duration=1.348738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:24:01.043750+00:00, queued_by_job_id=1, pid=8928 2024-04-28T03:24:05.746974689Z [2024-04-28T03:24:05.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:23:00+00:00, map_index=-1, run_start_date=2024-04-28 03:24:03.240254+00:00, run_end_date=2024-04-28 03:24:05.017145+00:00, run_duration=1.776891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:24:01.043750+00:00, queued_by_job_id=1, pid=8929 2024-04-28T03:25:00.427091006Z [2024-04-28T03:25:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:25:00+00:00, run_after=2024-04-28T03:30:00+00:00 2024-04-28T03:25:00.442895579Z [2024-04-28T03:25:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:25:00+00:00, run_after=2024-04-28T03:26:00+00:00 2024-04-28T03:25:00.453548370Z [2024-04-28T03:25:00.453+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:25:00.523642598Z [2024-04-28T03:25:00.523+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:25:00.523692936Z 2024-04-28T03:25:00.523705212Z 2024-04-28T03:25:00.523714296Z 2024-04-28T03:25:00.523749592Z [2024-04-28T03:25:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:25:00.524088252Z [2024-04-28T03:25:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:25:00.524275257Z [2024-04-28T03:25:00.524+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:25:00.524989339Z [2024-04-28T03:25:00.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:25:00.525001967Z 2024-04-28T03:25:00.525010589Z 2024-04-28T03:25:00.525019342Z 2024-04-28T03:25:00.529391267Z [2024-04-28T03:25:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:25:00.529478889Z [2024-04-28T03:25:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:25:00.529862497Z [2024-04-28T03:25:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:25:00.530029491Z [2024-04-28T03:25:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:25:00.530336523Z [2024-04-28T03:25:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:25:00.530544922Z [2024-04-28T03:25:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:25:00.717145674Z [2024-04-28T03:25:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:25:00.717230859Z [2024-04-28T03:25:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:24:00+00:00 exited with status queued for try_number 1 2024-04-28T03:25:00.717375415Z [2024-04-28T03:25:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:24:00+00:00 exited with status queued for try_number 1 2024-04-28T03:25:00.724527911Z [2024-04-28T03:25:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67f5c177-a97f-4f98-b7af-ced377099a03 2024-04-28T03:25:00.724676964Z [2024-04-28T03:25:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 309f3b83-678c-4b99-adc6-fa5333a918bc 2024-04-28T03:25:00.724810040Z [2024-04-28T03:25:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa79cf99-e2fd-476b-bb3a-12b8a98cb3ef 2024-04-28T03:25:03.074301702Z [2024-04-28T03:25:03.073+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:25:03.074335538Z 2024-04-28T03:25:03.074518488Z [2024-04-28T03:25:03.074+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:25:03.075130887Z [2024-04-28T03:25:03.074+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:25:03.075142032Z 2024-04-28T03:25:03.078607053Z [2024-04-28T03:25:03.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:25:03.078959147Z [2024-04-28T03:25:03.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:25:03.140647933Z [2024-04-28T03:25:03.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:25:03.140989337Z [2024-04-28T03:25:03.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:25:03.152838494Z [2024-04-28T03:25:03.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93bcf930-017d-41c8-9c89-e60df34b6f26 2024-04-28T03:25:03.154430735Z [2024-04-28T03:25:03.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=-1, run_start_date=2024-04-28 03:25:02.464025+00:00, run_end_date=2024-04-28 03:25:02.912096+00:00, run_duration=0.448071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:25:00.526069+00:00, queued_by_job_id=1, pid=8995 2024-04-28T03:25:03.758621826Z [2024-04-28T03:25:03.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:25:03.759079454Z [2024-04-28T03:25:03.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:24:00+00:00, run_id=scheduled__2024-04-28T03:24:00+00:00, run_start_date=2024-04-28 03:25:00.465240+00:00, run_end_date=2024-04-28 03:25:03.758700+00:00, run_duration=3.29346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:24:00+00:00, data_interval_end=2024-04-28 03:25:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:25:03.769647642Z [2024-04-28T03:25:03.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:25:00+00:00, run_after=2024-04-28T03:26:00+00:00 2024-04-28T03:25:03.836184548Z [2024-04-28T03:25:03.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:24:00+00:00 exited with status success for try_number 1 2024-04-28T03:25:03.842576138Z [2024-04-28T03:25:03.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:24:00+00:00, map_index=-1, run_start_date=2024-04-28 03:25:02.400407+00:00, run_end_date=2024-04-28 03:25:03.608558+00:00, run_duration=1.208151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:25:00.526069+00:00, queued_by_job_id=1, pid=8994 2024-04-28T03:25:04.918871440Z [2024-04-28T03:25:04.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:25:04.920520996Z [2024-04-28T03:25:04.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:24:00+00:00, run_id=scheduled__2024-04-28T03:24:00+00:00, run_start_date=2024-04-28 03:25:00.466274+00:00, run_end_date=2024-04-28 03:25:04.918818+00:00, run_duration=4.452544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:24:00+00:00, data_interval_end=2024-04-28 03:25:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:25:04.942581187Z [2024-04-28T03:25:04.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:25:00+00:00, run_after=2024-04-28T03:26:00+00:00 2024-04-28T03:25:06.082927913Z [2024-04-28T03:25:06.082+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:25:06.082958497Z 2024-04-28T03:25:06.082989273Z [2024-04-28T03:25:06.082+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:25:06.083642742Z [2024-04-28T03:25:06.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:25:06.083655857Z 2024-04-28T03:25:06.086548214Z [2024-04-28T03:25:06.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:25:06.086636954Z [2024-04-28T03:25:06.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:25:06.156352658Z [2024-04-28T03:25:06.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:25:06.156708334Z [2024-04-28T03:25:06.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:24:00+00:00 exited with status success for try_number 1 2024-04-28T03:25:06.156937473Z [2024-04-28T03:25:06.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:25:06.173405172Z [2024-04-28T03:25:06.173+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cfbe498-3078-482c-a64b-e95255655a2a 2024-04-28T03:25:06.173676423Z [2024-04-28T03:25:06.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:24:00+00:00, map_index=-1, run_start_date=2024-04-28 03:25:02.283703+00:00, run_end_date=2024-04-28 03:25:04.772659+00:00, run_duration=2.488956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:25:00.526069+00:00, queued_by_job_id=1, pid=8993 2024-04-28T03:25:06.173922053Z [2024-04-28T03:25:06.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=-1, run_start_date=2024-04-28 03:25:05.159575+00:00, run_end_date=2024-04-28 03:25:05.568381+00:00, run_duration=0.408806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:25:03.075500+00:00, queued_by_job_id=1, pid=9037 2024-04-28T03:25:09.627523245Z [2024-04-28T03:25:09.627+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:25:09.627549270Z 2024-04-28T03:25:09.627896808Z [2024-04-28T03:25:09.627+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:25:09.628534127Z [2024-04-28T03:25:09.628+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:25:09.628547780Z 2024-04-28T03:25:09.631587052Z [2024-04-28T03:25:09.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:25:09.631804612Z [2024-04-28T03:25:09.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:25:09.677361451Z [2024-04-28T03:25:09.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status queued for try_number 1 2024-04-28T03:25:09.677633645Z [2024-04-28T03:25:09.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:25:09.686209424Z [2024-04-28T03:25:09.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3abf168d-77ef-49c3-9417-7d806541d36e 2024-04-28T03:25:09.686247731Z [2024-04-28T03:25:09.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=0, run_start_date=2024-04-28 03:25:07.777657+00:00, run_end_date=2024-04-28 03:25:09.072862+00:00, run_duration=1.295205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:25:06.083998+00:00, queued_by_job_id=1, pid=9049 2024-04-28T03:25:11.908294164Z [2024-04-28T03:25:11.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:25:11.908906372Z [2024-04-28T03:25:11.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:20:00+00:00, run_id=scheduled__2024-04-28T03:20:00+00:00, run_start_date=2024-04-28 03:25:00.464082+00:00, run_end_date=2024-04-28 03:25:11.908181+00:00, run_duration=11.444099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:20:00+00:00, data_interval_end=2024-04-28 03:25:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:25:11.919593198Z [2024-04-28T03:25:11.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:25:00+00:00, run_after=2024-04-28T03:30:00+00:00 2024-04-28T03:25:11.964875510Z [2024-04-28T03:25:11.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:20:00+00:00 exited with status success for try_number 1 2024-04-28T03:25:11.973162811Z [2024-04-28T03:25:11.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:20:00+00:00, map_index=-1, run_start_date=2024-04-28 03:25:11.213158+00:00, run_end_date=2024-04-28 03:25:11.573926+00:00, run_duration=0.360768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:25:09.629161+00:00, queued_by_job_id=1, pid=9070 2024-04-28T03:26:00.243807637Z [2024-04-28T03:26:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:26:00+00:00, run_after=2024-04-28T03:27:00+00:00 2024-04-28T03:26:00.253596179Z [2024-04-28T03:26:00.253+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:26:00.263626903Z [2024-04-28T03:26:00.263+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:26:00.353269514Z [2024-04-28T03:26:00.352+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:26:00.353311067Z 2024-04-28T03:26:00.353327594Z 2024-04-28T03:26:00.353337699Z 2024-04-28T03:26:00.353598402Z [2024-04-28T03:26:00.353+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:26:00.353870269Z [2024-04-28T03:26:00.353+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:26:00.354117203Z [2024-04-28T03:26:00.353+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:26:00.355377706Z [2024-04-28T03:26:00.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:26:00.355390704Z 2024-04-28T03:26:00.355411736Z 2024-04-28T03:26:00.355415112Z 2024-04-28T03:26:00.360753210Z [2024-04-28T03:26:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:26:00.360955313Z [2024-04-28T03:26:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:26:00.361234989Z [2024-04-28T03:26:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:26:00.361384989Z [2024-04-28T03:26:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:26:00.361798560Z [2024-04-28T03:26:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:26:00.362047180Z [2024-04-28T03:26:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:26:00.646143199Z [2024-04-28T03:26:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:24:00+00:00 exited with status queued for try_number 1 2024-04-28T03:26:00.650772229Z [2024-04-28T03:26:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status queued for try_number 1 2024-04-28T03:26:00.651068817Z [2024-04-28T03:26:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status queued for try_number 1 2024-04-28T03:26:00.662991564Z [2024-04-28T03:26:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8426a2fe-e99b-4a88-9ac6-343b2545d8e7 2024-04-28T03:26:00.663364029Z [2024-04-28T03:26:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17460a35-73b8-49f1-b630-36eb55135bac 2024-04-28T03:26:00.663626967Z [2024-04-28T03:26:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa9806ff-33f9-4cdc-be43-f21a00f36592 2024-04-28T03:26:01.801936262Z [2024-04-28T03:26:01.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:26:01.802078498Z [2024-04-28T03:26:01.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:24:00+00:00, run_id=scheduled__2024-04-28T03:24:00+00:00, run_start_date=2024-04-28 03:26:00.276443+00:00, run_end_date=2024-04-28 03:26:01.801727+00:00, run_duration=1.525284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:24:00+00:00, data_interval_end=2024-04-28 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:26:01.811463565Z [2024-04-28T03:26:01.811+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:26:00+00:00, run_after=2024-04-28T03:28:00+00:00 2024-04-28T03:26:01.863832334Z [2024-04-28T03:26:01.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:24:00+00:00 exited with status success for try_number 1 2024-04-28T03:26:01.870178277Z [2024-04-28T03:26:01.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:24:00+00:00, map_index=-1, run_start_date=2024-04-28 03:26:01.192577+00:00, run_end_date=2024-04-28 03:26:01.507878+00:00, run_duration=0.315301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:26:00.356911+00:00, queued_by_job_id=1, pid=9074 2024-04-28T03:26:04.004082901Z [2024-04-28T03:26:04.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:26:04.004365252Z [2024-04-28T03:26:04.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:25:00+00:00, run_id=scheduled__2024-04-28T03:25:00+00:00, run_start_date=2024-04-28 03:26:00.278246+00:00, run_end_date=2024-04-28 03:26:04.003992+00:00, run_duration=3.725746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:25:00+00:00, data_interval_end=2024-04-28 03:26:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:26:04.013520702Z [2024-04-28T03:26:04.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:26:00+00:00, run_after=2024-04-28T03:27:00+00:00 2024-04-28T03:26:04.050235942Z [2024-04-28T03:26:04.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status success for try_number 1 2024-04-28T03:26:04.055355396Z [2024-04-28T03:26:04.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:25:00+00:00, map_index=-1, run_start_date=2024-04-28 03:26:02.372026+00:00, run_end_date=2024-04-28 03:26:03.757957+00:00, run_duration=1.385931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:26:00.356911+00:00, queued_by_job_id=1, pid=9116 2024-04-28T03:26:04.116164957Z [2024-04-28T03:26:04.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:26:04.118635668Z [2024-04-28T03:26:04.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:25:00+00:00, run_id=scheduled__2024-04-28T03:25:00+00:00, run_start_date=2024-04-28 03:26:00.279496+00:00, run_end_date=2024-04-28 03:26:04.115500+00:00, run_duration=3.836004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:25:00+00:00, data_interval_end=2024-04-28 03:26:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:26:04.136963336Z [2024-04-28T03:26:04.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:26:00+00:00, run_after=2024-04-28T03:27:00+00:00 2024-04-28T03:26:05.314525786Z [2024-04-28T03:26:05.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status success for try_number 1 2024-04-28T03:26:05.321829891Z [2024-04-28T03:26:05.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:25:00+00:00, map_index=-1, run_start_date=2024-04-28 03:26:02.329791+00:00, run_end_date=2024-04-28 03:26:04.070831+00:00, run_duration=1.74104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:26:00.356911+00:00, queued_by_job_id=1, pid=9115 2024-04-28T03:26:16.998453887Z [2024-04-28T03:26:16.998+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:26:40.764184219Z [2024-04-28T03:26:40.763+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:26:40.764252437Z 2024-04-28T03:26:40.764268440Z [2024-04-28T03:26:40.764+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-28T03:26:40.764630897Z [2024-04-28T03:26:40.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:26:40.764640742Z 2024-04-28T03:26:40.766633689Z [2024-04-28T03:26:40.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240428032640_318576', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:26:40.766686314Z [2024-04-28T03:26:40.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240428032640_318576', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-28T03:26:40.850005321Z [2024-04-28T03:26:40.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240428032640_318576 exited with status queued for try_number 1 2024-04-28T03:26:40.859257448Z [2024-04-28T03:26:40.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to caf5ce24-c76d-4805-b8da-6618b856fd09 2024-04-28T03:26:43.073319296Z [2024-04-28T03:26:43.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:26:43.074152894Z [2024-04-28T03:26:43.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-28 03:26:40.482646+00:00, run_id=scaleout_vdu_20240428032640_318576, run_start_date=2024-04-28 03:26:40.739159+00:00, run_end_date=2024-04-28 03:26:43.073118+00:00, run_duration=2.333959, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 03:26:40.482646+00:00, data_interval_end=2024-04-28 03:26:40.482646+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-28T03:26:43.079556654Z [2024-04-28T03:26:43.079+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-28T03:26:43.111425556Z [2024-04-28T03:26:43.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240428032640_318576 exited with status success for try_number 1 2024-04-28T03:26:43.116597880Z [2024-04-28T03:26:43.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240428032640_318576, map_index=-1, run_start_date=2024-04-28 03:26:41.534009+00:00, run_end_date=2024-04-28 03:26:41.992379+00:00, run_duration=0.45837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:26:40.764917+00:00, queued_by_job_id=1, pid=9139 2024-04-28T03:27:01.037026840Z [2024-04-28T03:27:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:27:00+00:00, run_after=2024-04-28T03:28:00+00:00 2024-04-28T03:27:01.045492202Z [2024-04-28T03:27:01.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:27:01.112951649Z [2024-04-28T03:27:01.112+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:27:01.113014616Z 2024-04-28T03:27:01.113020710Z 2024-04-28T03:27:01.113025466Z [2024-04-28T03:27:01.112+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:27:01.113030137Z [2024-04-28T03:27:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:27:01.113456116Z [2024-04-28T03:27:01.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:27:01.113469969Z 2024-04-28T03:27:01.113475373Z 2024-04-28T03:27:01.116350190Z [2024-04-28T03:27:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:27:01.116396754Z [2024-04-28T03:27:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:27:01.116640341Z [2024-04-28T03:27:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:27:01.116712720Z [2024-04-28T03:27:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:27:01.258668981Z [2024-04-28T03:27:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:26:00+00:00 exited with status queued for try_number 1 2024-04-28T03:27:01.258711764Z [2024-04-28T03:27:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:26:00+00:00 exited with status queued for try_number 1 2024-04-28T03:27:01.270658950Z [2024-04-28T03:27:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 503ab107-24f5-4b1c-957e-bdc3ad5ede06 2024-04-28T03:27:01.270742097Z [2024-04-28T03:27:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8dc94c0-8e78-4f5f-b032-a92f55d21518 2024-04-28T03:27:04.460477136Z [2024-04-28T03:27:04.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:27:04.464092096Z [2024-04-28T03:27:04.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:26:00+00:00, run_id=scheduled__2024-04-28T03:26:00+00:00, run_start_date=2024-04-28 03:27:01.059525+00:00, run_end_date=2024-04-28 03:27:04.463647+00:00, run_duration=3.404122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:26:00+00:00, data_interval_end=2024-04-28 03:27:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:27:04.478925461Z [2024-04-28T03:27:04.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:27:00+00:00, run_after=2024-04-28T03:28:00+00:00 2024-04-28T03:27:04.493375577Z [2024-04-28T03:27:04.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:27:04.493908189Z [2024-04-28T03:27:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:26:00+00:00, run_id=scheduled__2024-04-28T03:26:00+00:00, run_start_date=2024-04-28 03:27:01.058191+00:00, run_end_date=2024-04-28 03:27:04.493557+00:00, run_duration=3.435366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:26:00+00:00, data_interval_end=2024-04-28 03:27:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:27:04.512436115Z [2024-04-28T03:27:04.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:27:00+00:00, run_after=2024-04-28T03:28:00+00:00 2024-04-28T03:27:04.573177203Z [2024-04-28T03:27:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:26:00+00:00 exited with status success for try_number 1 2024-04-28T03:27:04.582501008Z [2024-04-28T03:27:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:26:00+00:00, map_index=-1, run_start_date=2024-04-28 03:27:02.894648+00:00, run_end_date=2024-04-28 03:27:04.028444+00:00, run_duration=1.133796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:27:01.113878+00:00, queued_by_job_id=1, pid=9183 2024-04-28T03:27:05.118294607Z [2024-04-28T03:27:05.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:26:00+00:00 exited with status success for try_number 1 2024-04-28T03:27:05.128336576Z [2024-04-28T03:27:05.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:26:00+00:00, map_index=-1, run_start_date=2024-04-28 03:27:02.882165+00:00, run_end_date=2024-04-28 03:27:04.417716+00:00, run_duration=1.535551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:27:01.113878+00:00, queued_by_job_id=1, pid=9182 2024-04-28T03:28:00.334543317Z [2024-04-28T03:28:00.334+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:28:00.351824774Z [2024-04-28T03:28:00.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:28:00+00:00, run_after=2024-04-28T03:29:00+00:00 2024-04-28T03:28:00.371543203Z [2024-04-28T03:28:00.366+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:28:00.436151117Z [2024-04-28T03:28:00.435+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:28:00.436202159Z 2024-04-28T03:28:00.436217337Z 2024-04-28T03:28:00.436229909Z 2024-04-28T03:28:00.436848290Z [2024-04-28T03:28:00.435+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:28:00.437361819Z [2024-04-28T03:28:00.437+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:28:00.438087484Z [2024-04-28T03:28:00.437+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:28:00.440466567Z [2024-04-28T03:28:00.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:28:00.440484338Z 2024-04-28T03:28:00.440490960Z 2024-04-28T03:28:00.440494630Z 2024-04-28T03:28:00.450146498Z [2024-04-28T03:28:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:28:00.450877118Z [2024-04-28T03:28:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:28:00.452902656Z [2024-04-28T03:28:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:28:00.453537857Z [2024-04-28T03:28:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:28:00.454507871Z [2024-04-28T03:28:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:28:00.454899294Z [2024-04-28T03:28:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:28:00.663176840Z [2024-04-28T03:28:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:26:00+00:00 exited with status queued for try_number 1 2024-04-28T03:28:00.663308670Z [2024-04-28T03:28:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:27:00+00:00 exited with status queued for try_number 1 2024-04-28T03:28:00.663447771Z [2024-04-28T03:28:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:27:00+00:00 exited with status queued for try_number 1 2024-04-28T03:28:00.673217695Z [2024-04-28T03:28:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89798b80-05df-43e7-ab74-8358effdac6b 2024-04-28T03:28:00.673400097Z [2024-04-28T03:28:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 739ecbe0-f99a-4e92-b718-45108dfe96ba 2024-04-28T03:28:00.673567130Z [2024-04-28T03:28:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ef3d2ac-5fac-46a7-ab8d-0ed9aaafb958 2024-04-28T03:28:02.093141430Z [2024-04-28T03:28:02.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:28:02.093335802Z [2024-04-28T03:28:02.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:26:00+00:00, run_id=scheduled__2024-04-28T03:26:00+00:00, run_start_date=2024-04-28 03:28:00.383976+00:00, run_end_date=2024-04-28 03:28:02.093060+00:00, run_duration=1.709084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:26:00+00:00, data_interval_end=2024-04-28 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:28:02.101489248Z [2024-04-28T03:28:02.101+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:28:00+00:00, run_after=2024-04-28T03:30:00+00:00 2024-04-28T03:28:02.162561569Z [2024-04-28T03:28:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:26:00+00:00 exited with status success for try_number 1 2024-04-28T03:28:02.186241737Z [2024-04-28T03:28:02.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:26:00+00:00, map_index=-1, run_start_date=2024-04-28 03:28:01.183441+00:00, run_end_date=2024-04-28 03:28:01.534931+00:00, run_duration=0.35149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:28:00.444144+00:00, queued_by_job_id=1, pid=9208 2024-04-28T03:28:04.303805502Z [2024-04-28T03:28:04.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:28:04.303975047Z [2024-04-28T03:28:04.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:27:00+00:00, run_id=scheduled__2024-04-28T03:27:00+00:00, run_start_date=2024-04-28 03:28:00.386616+00:00, run_end_date=2024-04-28 03:28:04.303714+00:00, run_duration=3.917098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:27:00+00:00, data_interval_end=2024-04-28 03:28:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:28:04.313813441Z [2024-04-28T03:28:04.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:28:00+00:00, run_after=2024-04-28T03:29:00+00:00 2024-04-28T03:28:04.320321938Z [2024-04-28T03:28:04.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:28:04.320458721Z [2024-04-28T03:28:04.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:27:00+00:00, run_id=scheduled__2024-04-28T03:27:00+00:00, run_start_date=2024-04-28 03:28:00.385222+00:00, run_end_date=2024-04-28 03:28:04.320223+00:00, run_duration=3.935001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:27:00+00:00, data_interval_end=2024-04-28 03:28:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:28:04.329785965Z [2024-04-28T03:28:04.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:28:00+00:00, run_after=2024-04-28T03:29:00+00:00 2024-04-28T03:28:04.371522461Z [2024-04-28T03:28:04.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:27:00+00:00 exited with status success for try_number 1 2024-04-28T03:28:04.371592552Z [2024-04-28T03:28:04.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:27:00+00:00 exited with status success for try_number 1 2024-04-28T03:28:04.385038261Z [2024-04-28T03:28:04.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:27:00+00:00, map_index=-1, run_start_date=2024-04-28 03:28:02.279079+00:00, run_end_date=2024-04-28 03:28:03.894922+00:00, run_duration=1.615843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:28:00.444144+00:00, queued_by_job_id=1, pid=9248 2024-04-28T03:28:04.385496441Z [2024-04-28T03:28:04.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:27:00+00:00, map_index=-1, run_start_date=2024-04-28 03:28:02.409508+00:00, run_end_date=2024-04-28 03:28:03.818035+00:00, run_duration=1.408527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:28:00.444144+00:00, queued_by_job_id=1, pid=9249 2024-04-28T03:29:00.655683371Z [2024-04-28T03:29:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:29:00.672498177Z [2024-04-28T03:29:00.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:29:00+00:00, run_after=2024-04-28T03:30:00+00:00 2024-04-28T03:29:00.757987810Z [2024-04-28T03:29:00.757+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:29:00.758071045Z 2024-04-28T03:29:00.758077992Z 2024-04-28T03:29:00.758091451Z [2024-04-28T03:29:00.757+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:29:00.758346624Z [2024-04-28T03:29:00.758+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:29:00.759709104Z [2024-04-28T03:29:00.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:29:00.759752392Z 2024-04-28T03:29:00.759757485Z 2024-04-28T03:29:00.765273420Z [2024-04-28T03:29:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:29:00.765854628Z [2024-04-28T03:29:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:29:00.766429477Z [2024-04-28T03:29:00.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:29:00.766725001Z [2024-04-28T03:29:00.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:29:00.951179878Z [2024-04-28T03:29:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:28:00+00:00 exited with status queued for try_number 1 2024-04-28T03:29:00.951220956Z [2024-04-28T03:29:00.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:28:00+00:00 exited with status queued for try_number 1 2024-04-28T03:29:00.958879087Z [2024-04-28T03:29:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to de372873-0cd4-45af-87bd-3def934740d5 2024-04-28T03:29:00.958975282Z [2024-04-28T03:29:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 796e31e9-5510-4b4e-9803-1a8da474fe22 2024-04-28T03:29:04.119056825Z [2024-04-28T03:29:04.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:29:04.119083078Z [2024-04-28T03:29:04.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:28:00+00:00, run_id=scheduled__2024-04-28T03:28:00+00:00, run_start_date=2024-04-28 03:29:00.688605+00:00, run_end_date=2024-04-28 03:29:04.118100+00:00, run_duration=3.429495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:28:00+00:00, data_interval_end=2024-04-28 03:29:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:29:04.128878635Z [2024-04-28T03:29:04.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:29:00+00:00, run_after=2024-04-28T03:30:00+00:00 2024-04-28T03:29:04.183993208Z [2024-04-28T03:29:04.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:28:00+00:00 exited with status success for try_number 1 2024-04-28T03:29:04.193113373Z [2024-04-28T03:29:04.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:28:00+00:00, map_index=-1, run_start_date=2024-04-28 03:29:02.440346+00:00, run_end_date=2024-04-28 03:29:04.021412+00:00, run_duration=1.581066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:29:00.760967+00:00, queued_by_job_id=1, pid=9303 2024-04-28T03:29:05.026825438Z [2024-04-28T03:29:05.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:29:05.027265908Z [2024-04-28T03:29:05.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:28:00+00:00, run_id=scheduled__2024-04-28T03:28:00+00:00, run_start_date=2024-04-28 03:29:00.690033+00:00, run_end_date=2024-04-28 03:29:05.026853+00:00, run_duration=4.33682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:28:00+00:00, data_interval_end=2024-04-28 03:29:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:29:05.046130196Z [2024-04-28T03:29:05.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:29:00+00:00, run_after=2024-04-28T03:30:00+00:00 2024-04-28T03:29:05.072375398Z [2024-04-28T03:29:05.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:28:00+00:00 exited with status success for try_number 1 2024-04-28T03:29:05.077201984Z [2024-04-28T03:29:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:28:00+00:00, map_index=-1, run_start_date=2024-04-28 03:29:02.590551+00:00, run_end_date=2024-04-28 03:29:04.795581+00:00, run_duration=2.20503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:29:00.760967+00:00, queued_by_job_id=1, pid=9304 2024-04-28T03:30:00.959815085Z [2024-04-28T03:30:00.959+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:30:00.973614676Z [2024-04-28T03:30:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:30:00+00:00, run_after=2024-04-28T03:35:00+00:00 2024-04-28T03:30:00.989295886Z [2024-04-28T03:30:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:30:00+00:00, run_after=2024-04-28T03:31:00+00:00 2024-04-28T03:30:00.999591686Z [2024-04-28T03:30:00.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:30:01.093055976Z [2024-04-28T03:30:01.092+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T03:30:01.093090949Z 2024-04-28T03:30:01.093094360Z 2024-04-28T03:30:01.093098299Z 2024-04-28T03:30:01.093102554Z 2024-04-28T03:30:01.093273796Z [2024-04-28T03:30:01.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:30:01.093384796Z [2024-04-28T03:30:01.093+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:30:01.093489506Z [2024-04-28T03:30:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:30:01.093539294Z [2024-04-28T03:30:01.093+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:30:01.094115825Z [2024-04-28T03:30:01.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:30:01.094124462Z 2024-04-28T03:30:01.094128449Z 2024-04-28T03:30:01.094132333Z 2024-04-28T03:30:01.094136179Z 2024-04-28T03:30:01.098148023Z [2024-04-28T03:30:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:30:01.098274331Z [2024-04-28T03:30:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:30:01.098701073Z [2024-04-28T03:30:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:30:01.098763102Z [2024-04-28T03:30:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:30:01.098954707Z [2024-04-28T03:30:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:30:01.099040683Z [2024-04-28T03:30:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:30:01.099197744Z [2024-04-28T03:30:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:30:01.099275093Z [2024-04-28T03:30:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:30:01.507095525Z [2024-04-28T03:30:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:01.507651547Z [2024-04-28T03:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:28:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:01.508003513Z [2024-04-28T03:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:29:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:01.508256894Z [2024-04-28T03:30:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:29:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:01.528197368Z [2024-04-28T03:30:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34236ef0-5fea-48c8-9e90-f5ad66c1e4d3 2024-04-28T03:30:01.528332511Z [2024-04-28T03:30:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 598fdf79-3f39-4284-9f1a-3fd11bd17ce7 2024-04-28T03:30:01.529454848Z [2024-04-28T03:30:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84105faa-7a8f-4cc5-b249-efe2affba63d 2024-04-28T03:30:01.529558395Z [2024-04-28T03:30:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11c67cdd-f614-49e4-bad4-c812d87dcef7 2024-04-28T03:30:02.822471040Z [2024-04-28T03:30:02.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:30:02.822506428Z [2024-04-28T03:30:02.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:28:00+00:00, run_id=scheduled__2024-04-28T03:28:00+00:00, run_start_date=2024-04-28 03:30:01.016511+00:00, run_end_date=2024-04-28 03:30:02.817956+00:00, run_duration=1.801445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:28:00+00:00, data_interval_end=2024-04-28 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:30:02.844393852Z [2024-04-28T03:30:02.839+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:30:00+00:00, run_after=2024-04-28T03:32:00+00:00 2024-04-28T03:30:04.201133256Z [2024-04-28T03:30:04.200+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:30:04.201154512Z 2024-04-28T03:30:04.201218437Z [2024-04-28T03:30:04.201+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:30:04.204939793Z [2024-04-28T03:30:04.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:30:04.204960196Z 2024-04-28T03:30:04.210800252Z [2024-04-28T03:30:04.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:30:04.210820448Z [2024-04-28T03:30:04.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:30:04.320603438Z [2024-04-28T03:30:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:04.320797517Z [2024-04-28T03:30:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:04.320924336Z [2024-04-28T03:30:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:28:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:04.336023957Z [2024-04-28T03:30:04.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:25:00+00:00, map_index=-1, run_start_date=2024-04-28 03:30:03.416939+00:00, run_end_date=2024-04-28 03:30:03.921340+00:00, run_duration=0.504401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:01.094932+00:00, queued_by_job_id=1, pid=9363 2024-04-28T03:30:04.336373539Z [2024-04-28T03:30:04.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f84092f-c2ea-4ab6-8074-df0f81f885ba 2024-04-28T03:30:04.336681755Z [2024-04-28T03:30:04.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:28:00+00:00, map_index=-1, run_start_date=2024-04-28 03:30:02.170916+00:00, run_end_date=2024-04-28 03:30:02.701645+00:00, run_duration=0.530729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:01.094932+00:00, queued_by_job_id=1, pid=9341 2024-04-28T03:30:06.486017161Z [2024-04-28T03:30:06.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:30:06.486464226Z [2024-04-28T03:30:06.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:29:00+00:00, run_id=scheduled__2024-04-28T03:29:00+00:00, run_start_date=2024-04-28 03:30:01.017722+00:00, run_end_date=2024-04-28 03:30:06.485875+00:00, run_duration=5.468153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:29:00+00:00, data_interval_end=2024-04-28 03:30:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:30:06.513697643Z [2024-04-28T03:30:06.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:30:00+00:00, run_after=2024-04-28T03:31:00+00:00 2024-04-28T03:30:06.521951320Z [2024-04-28T03:30:06.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:30:06.522318850Z [2024-04-28T03:30:06.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:29:00+00:00, run_id=scheduled__2024-04-28T03:29:00+00:00, run_start_date=2024-04-28 03:30:01.018941+00:00, run_end_date=2024-04-28 03:30:06.521857+00:00, run_duration=5.502916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:29:00+00:00, data_interval_end=2024-04-28 03:30:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:30:06.531981758Z [2024-04-28T03:30:06.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:30:00+00:00, run_after=2024-04-28T03:31:00+00:00 2024-04-28T03:30:06.605636975Z [2024-04-28T03:30:06.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:29:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:06.605867337Z [2024-04-28T03:30:06.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:29:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:06.620370798Z [2024-04-28T03:30:06.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:29:00+00:00, map_index=-1, run_start_date=2024-04-28 03:30:04.007954+00:00, run_end_date=2024-04-28 03:30:05.469868+00:00, run_duration=1.461914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:01.094932+00:00, queued_by_job_id=1, pid=9391 2024-04-28T03:30:06.620819070Z [2024-04-28T03:30:06.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:29:00+00:00, map_index=-1, run_start_date=2024-04-28 03:30:03.814345+00:00, run_end_date=2024-04-28 03:30:05.857648+00:00, run_duration=2.043303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:01.094932+00:00, queued_by_job_id=1, pid=9389 2024-04-28T03:30:07.736646082Z [2024-04-28T03:30:07.736+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:30:07.736702899Z 2024-04-28T03:30:07.736709199Z [2024-04-28T03:30:07.736+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:30:07.737280357Z [2024-04-28T03:30:07.736+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:30:07.737298092Z 2024-04-28T03:30:07.739984908Z [2024-04-28T03:30:07.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:30:07.740058934Z [2024-04-28T03:30:07.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:30:07.792137367Z [2024-04-28T03:30:07.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:07.792372315Z [2024-04-28T03:30:07.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:07.802139471Z [2024-04-28T03:30:07.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4624fed6-0a0a-42ee-b274-af3a8583a840 2024-04-28T03:30:07.802252913Z [2024-04-28T03:30:07.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:25:00+00:00, map_index=-1, run_start_date=2024-04-28 03:30:07.077372+00:00, run_end_date=2024-04-28 03:30:07.416771+00:00, run_duration=0.339399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:04.205253+00:00, queued_by_job_id=1, pid=9424 2024-04-28T03:30:12.201293157Z [2024-04-28T03:30:12.200+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:30:12.201323788Z 2024-04-28T03:30:12.201600313Z [2024-04-28T03:30:12.201+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:30:12.202672230Z [2024-04-28T03:30:12.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:30:12.202681944Z 2024-04-28T03:30:12.206523524Z [2024-04-28T03:30:12.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:30:12.206779608Z [2024-04-28T03:30:12.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:30:12.275950220Z [2024-04-28T03:30:12.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status queued for try_number 1 2024-04-28T03:30:12.276116864Z [2024-04-28T03:30:12.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:12.281140150Z [2024-04-28T03:30:12.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53d5c8ee-7912-4b8f-bef7-00fcd8b3137a 2024-04-28T03:30:12.281334969Z [2024-04-28T03:30:12.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:25:00+00:00, map_index=0, run_start_date=2024-04-28 03:30:09.620821+00:00, run_end_date=2024-04-28 03:30:11.274007+00:00, run_duration=1.653186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:07.737541+00:00, queued_by_job_id=1, pid=9436 2024-04-28T03:30:14.296594385Z [2024-04-28T03:30:14.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:30:14.296775932Z [2024-04-28T03:30:14.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:25:00+00:00, run_id=scheduled__2024-04-28T03:25:00+00:00, run_start_date=2024-04-28 03:30:01.014450+00:00, run_end_date=2024-04-28 03:30:14.296386+00:00, run_duration=13.281936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:25:00+00:00, data_interval_end=2024-04-28 03:30:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:30:14.302481602Z [2024-04-28T03:30:14.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:30:00+00:00, run_after=2024-04-28T03:35:00+00:00 2024-04-28T03:30:15.400785584Z [2024-04-28T03:30:15.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:25:00+00:00 exited with status success for try_number 1 2024-04-28T03:30:15.406435232Z [2024-04-28T03:30:15.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:25:00+00:00, map_index=-1, run_start_date=2024-04-28 03:30:13.847186+00:00, run_end_date=2024-04-28 03:30:14.236371+00:00, run_duration=0.389185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:30:12.203318+00:00, queued_by_job_id=1, pid=9457 2024-04-28T03:31:00.421550239Z [2024-04-28T03:31:00.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:31:00+00:00, run_after=2024-04-28T03:32:00+00:00 2024-04-28T03:31:00.431608803Z [2024-04-28T03:31:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:31:00.489666644Z [2024-04-28T03:31:00.489+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:31:00.489698317Z 2024-04-28T03:31:00.489704630Z 2024-04-28T03:31:00.489718567Z [2024-04-28T03:31:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:31:00.489887630Z [2024-04-28T03:31:00.489+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:31:00.490442045Z [2024-04-28T03:31:00.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:31:00.490453230Z 2024-04-28T03:31:00.490458492Z 2024-04-28T03:31:00.493099581Z [2024-04-28T03:31:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:31:00.493116473Z [2024-04-28T03:31:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:31:00.493342197Z [2024-04-28T03:31:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:31:00.493452555Z [2024-04-28T03:31:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:31:00.663354360Z [2024-04-28T03:31:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:31:00.663602175Z [2024-04-28T03:31:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:31:00.670959213Z [2024-04-28T03:31:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78bca57d-228a-4c1b-a02a-bee7fd0f4e9c 2024-04-28T03:31:00.671024373Z [2024-04-28T03:31:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3533d602-7294-4559-b1df-deee883632bd 2024-04-28T03:31:03.886631547Z [2024-04-28T03:31:03.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:31:03.887035677Z [2024-04-28T03:31:03.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:30:00+00:00, run_id=scheduled__2024-04-28T03:30:00+00:00, run_start_date=2024-04-28 03:31:00.449554+00:00, run_end_date=2024-04-28 03:31:03.886601+00:00, run_duration=3.437047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:30:00+00:00, data_interval_end=2024-04-28 03:31:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:31:03.897689511Z [2024-04-28T03:31:03.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:31:00+00:00, run_after=2024-04-28T03:32:00+00:00 2024-04-28T03:31:03.941573705Z [2024-04-28T03:31:03.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:31:03.946895854Z [2024-04-28T03:31:03.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=-1, run_start_date=2024-04-28 03:31:02.271316+00:00, run_end_date=2024-04-28 03:31:03.526357+00:00, run_duration=1.255041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:31:00.490934+00:00, queued_by_job_id=1, pid=9490 2024-04-28T03:31:05.009054806Z [2024-04-28T03:31:05.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:31:05.009323050Z [2024-04-28T03:31:05.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:30:00+00:00, run_id=scheduled__2024-04-28T03:30:00+00:00, run_start_date=2024-04-28 03:31:00.450874+00:00, run_end_date=2024-04-28 03:31:05.009001+00:00, run_duration=4.558127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:30:00+00:00, data_interval_end=2024-04-28 03:31:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:31:05.024388475Z [2024-04-28T03:31:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:31:00+00:00, run_after=2024-04-28T03:32:00+00:00 2024-04-28T03:31:05.064196738Z [2024-04-28T03:31:05.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:31:05.069812248Z [2024-04-28T03:31:05.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=-1, run_start_date=2024-04-28 03:31:02.321237+00:00, run_end_date=2024-04-28 03:31:03.866377+00:00, run_duration=1.54514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:31:00.490934+00:00, queued_by_job_id=1, pid=9491 2024-04-28T03:31:17.062801766Z [2024-04-28T03:31:17.062+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:32:00.745640544Z [2024-04-28T03:32:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:32:00+00:00, run_after=2024-04-28T03:33:00+00:00 2024-04-28T03:32:00.753875603Z [2024-04-28T03:32:00.753+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:32:00.762751825Z [2024-04-28T03:32:00.762+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:32:00.839670116Z [2024-04-28T03:32:00.839+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:32:00.839770084Z 2024-04-28T03:32:00.839786979Z 2024-04-28T03:32:00.839796370Z 2024-04-28T03:32:00.839884817Z [2024-04-28T03:32:00.839+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:32:00.839949234Z [2024-04-28T03:32:00.839+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:32:00.839996576Z [2024-04-28T03:32:00.839+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:32:00.840774289Z [2024-04-28T03:32:00.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:32:00.840822035Z 2024-04-28T03:32:00.840831581Z 2024-04-28T03:32:00.840838662Z 2024-04-28T03:32:00.845419789Z [2024-04-28T03:32:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:32:00.845641924Z [2024-04-28T03:32:00.845+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:32:00.846020012Z [2024-04-28T03:32:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:32:00.846264703Z [2024-04-28T03:32:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:32:00.846634615Z [2024-04-28T03:32:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:32:00.846832511Z [2024-04-28T03:32:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:32:01.124615680Z [2024-04-28T03:32:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:32:01.124755764Z [2024-04-28T03:32:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:31:00+00:00 exited with status queued for try_number 1 2024-04-28T03:32:01.124904270Z [2024-04-28T03:32:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:31:00+00:00 exited with status queued for try_number 1 2024-04-28T03:32:01.136261474Z [2024-04-28T03:32:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 319d4314-12e2-44d7-8688-e0894397fed5 2024-04-28T03:32:01.136406110Z [2024-04-28T03:32:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbd35901-a9ff-4103-af68-80eb79463fd4 2024-04-28T03:32:01.136616074Z [2024-04-28T03:32:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9290ebe2-b04d-4620-9350-7eedf4047aa9 2024-04-28T03:32:02.284265176Z [2024-04-28T03:32:02.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:32:02.284771710Z [2024-04-28T03:32:02.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:30:00+00:00, run_id=scheduled__2024-04-28T03:30:00+00:00, run_start_date=2024-04-28 03:32:00.776732+00:00, run_end_date=2024-04-28 03:32:02.284197+00:00, run_duration=1.507465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:30:00+00:00, data_interval_end=2024-04-28 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:32:02.294760548Z [2024-04-28T03:32:02.294+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:32:00+00:00, run_after=2024-04-28T03:34:00+00:00 2024-04-28T03:32:02.340440429Z [2024-04-28T03:32:02.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:32:02.347685991Z [2024-04-28T03:32:02.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=-1, run_start_date=2024-04-28 03:32:01.534319+00:00, run_end_date=2024-04-28 03:32:01.934191+00:00, run_duration=0.399872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:32:00.841636+00:00, queued_by_job_id=1, pid=9516 2024-04-28T03:32:04.480596236Z [2024-04-28T03:32:04.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:32:04.481014730Z [2024-04-28T03:32:04.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:31:00+00:00, run_id=scheduled__2024-04-28T03:31:00+00:00, run_start_date=2024-04-28 03:32:00.778061+00:00, run_end_date=2024-04-28 03:32:04.480501+00:00, run_duration=3.70244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:31:00+00:00, data_interval_end=2024-04-28 03:32:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:32:04.489640820Z [2024-04-28T03:32:04.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:32:00+00:00, run_after=2024-04-28T03:33:00+00:00 2024-04-28T03:32:04.500777051Z [2024-04-28T03:32:04.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:32:04.501217401Z [2024-04-28T03:32:04.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:31:00+00:00, run_id=scheduled__2024-04-28T03:31:00+00:00, run_start_date=2024-04-28 03:32:00.779230+00:00, run_end_date=2024-04-28 03:32:04.500701+00:00, run_duration=3.721471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:31:00+00:00, data_interval_end=2024-04-28 03:32:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:32:04.514802049Z [2024-04-28T03:32:04.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:32:00+00:00, run_after=2024-04-28T03:33:00+00:00 2024-04-28T03:32:04.554448622Z [2024-04-28T03:32:04.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:31:00+00:00 exited with status success for try_number 1 2024-04-28T03:32:04.554852778Z [2024-04-28T03:32:04.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:31:00+00:00 exited with status success for try_number 1 2024-04-28T03:32:04.561661218Z [2024-04-28T03:32:04.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:31:00+00:00, map_index=-1, run_start_date=2024-04-28 03:32:02.727976+00:00, run_end_date=2024-04-28 03:32:04.113448+00:00, run_duration=1.385472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:32:00.841636+00:00, queued_by_job_id=1, pid=9557 2024-04-28T03:32:04.562032720Z [2024-04-28T03:32:04.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:31:00+00:00, map_index=-1, run_start_date=2024-04-28 03:32:02.654032+00:00, run_end_date=2024-04-28 03:32:04.353078+00:00, run_duration=1.699046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:32:00.841636+00:00, queued_by_job_id=1, pid=9556 2024-04-28T03:32:41.388447911Z [2024-04-28T03:32:41.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:32:41.388477131Z 2024-04-28T03:32:41.388823895Z [2024-04-28T03:32:41.388+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-28T03:32:41.389843472Z [2024-04-28T03:32:41.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:32:41.389855742Z 2024-04-28T03:32:41.392248407Z [2024-04-28T03:32:41.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240428033240_189117', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:32:41.392501936Z [2024-04-28T03:32:41.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240428033240_189117', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-28T03:32:41.485716141Z [2024-04-28T03:32:41.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240428033240_189117 exited with status queued for try_number 1 2024-04-28T03:32:41.513880042Z [2024-04-28T03:32:41.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 765177b0-6ab7-483e-a08e-ff460c68e3be 2024-04-28T03:32:43.725412554Z [2024-04-28T03:32:43.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:32:43.726328503Z [2024-04-28T03:32:43.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-28 03:32:40.547478+00:00, run_id=scaleout_vdu_20240428033240_189117, run_start_date=2024-04-28 03:32:41.360876+00:00, run_end_date=2024-04-28 03:32:43.725946+00:00, run_duration=2.36507, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 03:32:40.547478+00:00, data_interval_end=2024-04-28 03:32:40.547478+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-28T03:32:43.735869735Z [2024-04-28T03:32:43.735+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-28T03:32:43.778733377Z [2024-04-28T03:32:43.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240428033240_189117 exited with status success for try_number 1 2024-04-28T03:32:43.800545063Z [2024-04-28T03:32:43.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240428033240_189117, map_index=-1, run_start_date=2024-04-28 03:32:42.179362+00:00, run_end_date=2024-04-28 03:32:42.549936+00:00, run_duration=0.370574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:32:41.390135+00:00, queued_by_job_id=1, pid=9580 2024-04-28T03:33:00.642204821Z [2024-04-28T03:33:00.641+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:33:00.656076429Z [2024-04-28T03:33:00.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:33:00+00:00, run_after=2024-04-28T03:34:00+00:00 2024-04-28T03:33:00.714237424Z [2024-04-28T03:33:00.713+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:33:00.714272254Z 2024-04-28T03:33:00.714277927Z 2024-04-28T03:33:00.714472904Z [2024-04-28T03:33:00.714+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:33:00.714759920Z [2024-04-28T03:33:00.714+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:33:00.715640122Z [2024-04-28T03:33:00.715+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:33:00.715654093Z 2024-04-28T03:33:00.715659290Z 2024-04-28T03:33:00.719220553Z [2024-04-28T03:33:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:33:00.719416392Z [2024-04-28T03:33:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:33:00.719738574Z [2024-04-28T03:33:00.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:33:00.719950575Z [2024-04-28T03:33:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:33:00.883254795Z [2024-04-28T03:33:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:32:00+00:00 exited with status queued for try_number 1 2024-04-28T03:33:00.883502030Z [2024-04-28T03:33:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:32:00+00:00 exited with status queued for try_number 1 2024-04-28T03:33:00.891019437Z [2024-04-28T03:33:00.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33e37446-f988-45ac-b705-418edd887993 2024-04-28T03:33:00.891310769Z [2024-04-28T03:33:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5e05a18-ad91-4c17-aefb-fd4a86322ad8 2024-04-28T03:33:03.866123946Z [2024-04-28T03:33:03.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:33:03.866835107Z [2024-04-28T03:33:03.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:32:00+00:00, run_id=scheduled__2024-04-28T03:32:00+00:00, run_start_date=2024-04-28 03:33:00.665834+00:00, run_end_date=2024-04-28 03:33:03.866475+00:00, run_duration=3.200641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:32:00+00:00, data_interval_end=2024-04-28 03:33:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:33:03.875856349Z [2024-04-28T03:33:03.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:33:00+00:00, run_after=2024-04-28T03:34:00+00:00 2024-04-28T03:33:04.986563310Z [2024-04-28T03:33:04.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:33:04.986661223Z [2024-04-28T03:33:04.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:32:00+00:00, run_id=scheduled__2024-04-28T03:32:00+00:00, run_start_date=2024-04-28 03:33:00.667109+00:00, run_end_date=2024-04-28 03:33:04.986284+00:00, run_duration=4.319175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:32:00+00:00, data_interval_end=2024-04-28 03:33:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:33:04.996840192Z [2024-04-28T03:33:04.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:33:00+00:00, run_after=2024-04-28T03:34:00+00:00 2024-04-28T03:33:05.038603564Z [2024-04-28T03:33:05.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:32:00+00:00 exited with status success for try_number 1 2024-04-28T03:33:05.038640867Z [2024-04-28T03:33:05.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:32:00+00:00 exited with status success for try_number 1 2024-04-28T03:33:05.059972270Z [2024-04-28T03:33:05.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:32:00+00:00, map_index=-1, run_start_date=2024-04-28 03:33:02.420133+00:00, run_end_date=2024-04-28 03:33:03.818792+00:00, run_duration=1.398659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:33:00.716535+00:00, queued_by_job_id=1, pid=9622 2024-04-28T03:33:05.060864008Z [2024-04-28T03:33:05.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:32:00+00:00, map_index=-1, run_start_date=2024-04-28 03:33:02.401253+00:00, run_end_date=2024-04-28 03:33:04.354800+00:00, run_duration=1.953547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:33:00.716535+00:00, queued_by_job_id=1, pid=9621 2024-04-28T03:34:00.870788591Z [2024-04-28T03:34:00.870+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:34:00.884793086Z [2024-04-28T03:34:00.884+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:34:00.913653054Z [2024-04-28T03:34:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:34:00+00:00, run_after=2024-04-28T03:35:00+00:00 2024-04-28T03:34:01.012564444Z [2024-04-28T03:34:01.012+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:34:01.012633073Z 2024-04-28T03:34:01.012645305Z 2024-04-28T03:34:01.012673439Z 2024-04-28T03:34:01.012680450Z [2024-04-28T03:34:01.012+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:34:01.012759404Z [2024-04-28T03:34:01.012+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:34:01.012795816Z [2024-04-28T03:34:01.012+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:34:01.013374635Z [2024-04-28T03:34:01.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:34:01.013390517Z 2024-04-28T03:34:01.013396304Z 2024-04-28T03:34:01.013401235Z 2024-04-28T03:34:01.017779152Z [2024-04-28T03:34:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:34:01.018052200Z [2024-04-28T03:34:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:34:01.018471054Z [2024-04-28T03:34:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:34:01.018695453Z [2024-04-28T03:34:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:34:01.019028525Z [2024-04-28T03:34:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:34:01.019237757Z [2024-04-28T03:34:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:34:01.336854292Z [2024-04-28T03:34:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:32:00+00:00 exited with status queued for try_number 1 2024-04-28T03:34:01.336901790Z [2024-04-28T03:34:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:33:00+00:00 exited with status queued for try_number 1 2024-04-28T03:34:01.336984156Z [2024-04-28T03:34:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:33:00+00:00 exited with status queued for try_number 1 2024-04-28T03:34:01.350970834Z [2024-04-28T03:34:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c03338a-1c3a-4d21-b89a-ee73493c8b84 2024-04-28T03:34:01.351039771Z [2024-04-28T03:34:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b8066a4-1025-4f29-9e2f-22171da08399 2024-04-28T03:34:01.351149440Z [2024-04-28T03:34:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82e43cb4-5122-43d3-94a4-2c28862733c7 2024-04-28T03:34:03.212127052Z [2024-04-28T03:34:03.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:34:03.212725644Z [2024-04-28T03:34:03.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:32:00+00:00, run_id=scheduled__2024-04-28T03:32:00+00:00, run_start_date=2024-04-28 03:34:00.932974+00:00, run_end_date=2024-04-28 03:34:03.212320+00:00, run_duration=2.279346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:32:00+00:00, data_interval_end=2024-04-28 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:34:03.220786470Z [2024-04-28T03:34:03.220+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:34:00+00:00, run_after=2024-04-28T03:36:00+00:00 2024-04-28T03:34:03.264632383Z [2024-04-28T03:34:03.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:32:00+00:00 exited with status success for try_number 1 2024-04-28T03:34:03.270481684Z [2024-04-28T03:34:03.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:32:00+00:00, map_index=-1, run_start_date=2024-04-28 03:34:01.883763+00:00, run_end_date=2024-04-28 03:34:02.279752+00:00, run_duration=0.395989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:34:01.014027+00:00, queued_by_job_id=1, pid=9657 2024-04-28T03:34:05.398248930Z [2024-04-28T03:34:05.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:34:05.398732582Z [2024-04-28T03:34:05.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:33:00+00:00, run_id=scheduled__2024-04-28T03:33:00+00:00, run_start_date=2024-04-28 03:34:00.937008+00:00, run_end_date=2024-04-28 03:34:05.398358+00:00, run_duration=4.46135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:33:00+00:00, data_interval_end=2024-04-28 03:34:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:34:05.407553592Z [2024-04-28T03:34:05.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:34:00+00:00, run_after=2024-04-28T03:35:00+00:00 2024-04-28T03:34:05.413858699Z [2024-04-28T03:34:05.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:34:05.414355199Z [2024-04-28T03:34:05.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:33:00+00:00, run_id=scheduled__2024-04-28T03:33:00+00:00, run_start_date=2024-04-28 03:34:00.935174+00:00, run_end_date=2024-04-28 03:34:05.414002+00:00, run_duration=4.478828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:33:00+00:00, data_interval_end=2024-04-28 03:34:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:34:05.424265647Z [2024-04-28T03:34:05.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:34:00+00:00, run_after=2024-04-28T03:35:00+00:00 2024-04-28T03:34:05.453650725Z [2024-04-28T03:34:05.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:33:00+00:00 exited with status success for try_number 1 2024-04-28T03:34:05.457692853Z [2024-04-28T03:34:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:33:00+00:00 exited with status success for try_number 1 2024-04-28T03:34:05.463512471Z [2024-04-28T03:34:05.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:33:00+00:00, map_index=-1, run_start_date=2024-04-28 03:34:03.370991+00:00, run_end_date=2024-04-28 03:34:04.766376+00:00, run_duration=1.395385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:34:01.014027+00:00, queued_by_job_id=1, pid=9688 2024-04-28T03:34:05.463959130Z [2024-04-28T03:34:05.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:33:00+00:00, map_index=-1, run_start_date=2024-04-28 03:34:03.255417+00:00, run_end_date=2024-04-28 03:34:05.135992+00:00, run_duration=1.880575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:34:01.014027+00:00, queued_by_job_id=1, pid=9687 2024-04-28T03:34:40.610598938Z [2024-04-28T03:34:40.610+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:34:40.610633109Z 2024-04-28T03:34:40.610700875Z [2024-04-28T03:34:40.610+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-28T03:34:40.611231629Z [2024-04-28T03:34:40.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:34:40.611240889Z 2024-04-28T03:34:40.613145382Z [2024-04-28T03:34:40.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240428033440_778209', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:34:40.613253786Z [2024-04-28T03:34:40.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240428033440_778209', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-28T03:34:40.664155944Z [2024-04-28T03:34:40.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240428033440_778209 exited with status queued for try_number 1 2024-04-28T03:34:40.671402343Z [2024-04-28T03:34:40.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88ecbd94-9366-4879-a406-ce18a9260756 2024-04-28T03:34:41.822632499Z [2024-04-28T03:34:41.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:34:41.823184023Z [2024-04-28T03:34:41.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-28 03:34:40.480245+00:00, run_id=scaleout_vdu_20240428033440_778209, run_start_date=2024-04-28 03:34:40.585744+00:00, run_end_date=2024-04-28 03:34:41.822621+00:00, run_duration=1.236877, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 03:34:40.480245+00:00, data_interval_end=2024-04-28 03:34:40.480245+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-28T03:34:41.848162776Z [2024-04-28T03:34:41.841+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-28T03:34:41.886920353Z [2024-04-28T03:34:41.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240428033440_778209 exited with status success for try_number 1 2024-04-28T03:34:41.896599610Z [2024-04-28T03:34:41.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240428033440_778209, map_index=-1, run_start_date=2024-04-28 03:34:41.294240+00:00, run_end_date=2024-04-28 03:34:41.652414+00:00, run_duration=0.358174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:34:40.611551+00:00, queued_by_job_id=1, pid=9711 2024-04-28T03:35:00.910548901Z [2024-04-28T03:35:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:35:00+00:00, run_after=2024-04-28T03:40:00+00:00 2024-04-28T03:35:00.923625908Z [2024-04-28T03:35:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:35:00+00:00, run_after=2024-04-28T03:36:00+00:00 2024-04-28T03:35:00.929952568Z [2024-04-28T03:35:00.929+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:35:01.035311790Z [2024-04-28T03:35:01.034+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:35:01.035343262Z 2024-04-28T03:35:01.035352143Z 2024-04-28T03:35:01.035356772Z 2024-04-28T03:35:01.035368714Z [2024-04-28T03:35:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:35:01.035600815Z [2024-04-28T03:35:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:35:01.035812048Z [2024-04-28T03:35:01.035+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:35:01.036598250Z [2024-04-28T03:35:01.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:35:01.036607647Z 2024-04-28T03:35:01.036612199Z 2024-04-28T03:35:01.036616394Z 2024-04-28T03:35:01.041556651Z [2024-04-28T03:35:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:35:01.041659849Z [2024-04-28T03:35:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:35:01.042130681Z [2024-04-28T03:35:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:35:01.042361945Z [2024-04-28T03:35:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:35:01.042691445Z [2024-04-28T03:35:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:35:01.042822573Z [2024-04-28T03:35:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:35:01.312867749Z [2024-04-28T03:35:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:35:01.313031596Z [2024-04-28T03:35:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:34:00+00:00 exited with status queued for try_number 1 2024-04-28T03:35:01.313148522Z [2024-04-28T03:35:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:34:00+00:00 exited with status queued for try_number 1 2024-04-28T03:35:01.321729074Z [2024-04-28T03:35:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dc6d085-d72c-4043-b49c-10b173bebe9c 2024-04-28T03:35:01.321951916Z [2024-04-28T03:35:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 995e0376-252f-4f4b-8f17-274f267a7b1d 2024-04-28T03:35:01.322181554Z [2024-04-28T03:35:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad7d1844-65e9-4a78-acc6-b752b3445ed4 2024-04-28T03:35:04.014745442Z [2024-04-28T03:35:04.014+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:35:04.014785970Z 2024-04-28T03:35:04.014969353Z [2024-04-28T03:35:04.014+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:35:04.015560662Z [2024-04-28T03:35:04.015+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:35:04.015613677Z 2024-04-28T03:35:04.018313795Z [2024-04-28T03:35:04.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:35:04.018564348Z [2024-04-28T03:35:04.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:35:04.076818954Z [2024-04-28T03:35:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:35:04.077881445Z [2024-04-28T03:35:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:35:04.084785859Z [2024-04-28T03:35:04.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0df783eb-c269-47d4-a827-2b1234dbc524 2024-04-28T03:35:04.085236508Z [2024-04-28T03:35:04.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=-1, run_start_date=2024-04-28 03:35:03.222660+00:00, run_end_date=2024-04-28 03:35:03.670898+00:00, run_duration=0.448238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:35:01.037704+00:00, queued_by_job_id=1, pid=9754 2024-04-28T03:35:05.309240021Z [2024-04-28T03:35:05.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:35:05.309425200Z [2024-04-28T03:35:05.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:34:00+00:00, run_id=scheduled__2024-04-28T03:34:00+00:00, run_start_date=2024-04-28 03:35:00.945885+00:00, run_end_date=2024-04-28 03:35:05.309159+00:00, run_duration=4.363274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:34:00+00:00, data_interval_end=2024-04-28 03:35:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:35:05.321883594Z [2024-04-28T03:35:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:35:00+00:00, run_after=2024-04-28T03:36:00+00:00 2024-04-28T03:35:05.428848664Z [2024-04-28T03:35:05.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:34:00+00:00 exited with status success for try_number 1 2024-04-28T03:35:05.444858342Z [2024-04-28T03:35:05.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:34:00+00:00, map_index=-1, run_start_date=2024-04-28 03:35:03.333886+00:00, run_end_date=2024-04-28 03:35:04.660930+00:00, run_duration=1.327044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:35:01.037704+00:00, queued_by_job_id=1, pid=9755 2024-04-28T03:35:06.523766324Z [2024-04-28T03:35:06.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:35:06.523910352Z [2024-04-28T03:35:06.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:34:00+00:00, run_id=scheduled__2024-04-28T03:34:00+00:00, run_start_date=2024-04-28 03:35:00.947901+00:00, run_end_date=2024-04-28 03:35:06.523661+00:00, run_duration=5.57576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:34:00+00:00, data_interval_end=2024-04-28 03:35:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:35:06.534639800Z [2024-04-28T03:35:06.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:35:00+00:00, run_after=2024-04-28T03:36:00+00:00 2024-04-28T03:35:06.613279180Z [2024-04-28T03:35:06.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:34:00+00:00 exited with status success for try_number 1 2024-04-28T03:35:06.621476690Z [2024-04-28T03:35:06.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:34:00+00:00, map_index=-1, run_start_date=2024-04-28 03:35:03.671600+00:00, run_end_date=2024-04-28 03:35:06.264988+00:00, run_duration=2.593388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:35:01.037704+00:00, queued_by_job_id=1, pid=9783 2024-04-28T03:35:07.695936013Z [2024-04-28T03:35:07.695+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:35:07.695966462Z 2024-04-28T03:35:07.696180253Z [2024-04-28T03:35:07.695+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:35:07.696802153Z [2024-04-28T03:35:07.696+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:35:07.696823382Z 2024-04-28T03:35:07.698796082Z [2024-04-28T03:35:07.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:35:07.698994304Z [2024-04-28T03:35:07.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:35:07.766219304Z [2024-04-28T03:35:07.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:35:07.766574338Z [2024-04-28T03:35:07.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:35:07.775313783Z [2024-04-28T03:35:07.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbf8e2ed-4fd6-4c3e-a99e-d0bab534ed03 2024-04-28T03:35:07.775826292Z [2024-04-28T03:35:07.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=-1, run_start_date=2024-04-28 03:35:06.348926+00:00, run_end_date=2024-04-28 03:35:06.725643+00:00, run_duration=0.376717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:35:04.016073+00:00, queued_by_job_id=1, pid=9807 2024-04-28T03:35:11.342106039Z [2024-04-28T03:35:11.341+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:35:11.342130889Z 2024-04-28T03:35:11.342281155Z [2024-04-28T03:35:11.341+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:35:11.343542308Z [2024-04-28T03:35:11.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:35:11.343551101Z 2024-04-28T03:35:11.347703903Z [2024-04-28T03:35:11.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:35:11.347926393Z [2024-04-28T03:35:11.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:35:11.426997368Z [2024-04-28T03:35:11.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status queued for try_number 1 2024-04-28T03:35:11.427068255Z [2024-04-28T03:35:11.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:35:11.435061130Z [2024-04-28T03:35:11.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5a55d4e-228a-4809-92e6-1daee0e558cd 2024-04-28T03:35:11.435197713Z [2024-04-28T03:35:11.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=0, run_start_date=2024-04-28 03:35:09.408356+00:00, run_end_date=2024-04-28 03:35:10.644623+00:00, run_duration=1.236267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:35:07.697010+00:00, queued_by_job_id=1, pid=9819 2024-04-28T03:35:14.229447704Z [2024-04-28T03:35:14.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:35:14.230635113Z [2024-04-28T03:35:14.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:30:00+00:00, run_id=scheduled__2024-04-28T03:30:00+00:00, run_start_date=2024-04-28 03:35:00.943395+00:00, run_end_date=2024-04-28 03:35:14.229167+00:00, run_duration=13.285772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:30:00+00:00, data_interval_end=2024-04-28 03:35:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:35:14.249828242Z [2024-04-28T03:35:14.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:35:00+00:00, run_after=2024-04-28T03:40:00+00:00 2024-04-28T03:35:14.270512336Z [2024-04-28T03:35:14.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:30:00+00:00 exited with status success for try_number 1 2024-04-28T03:35:14.274478020Z [2024-04-28T03:35:14.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:30:00+00:00, map_index=-1, run_start_date=2024-04-28 03:35:13.087697+00:00, run_end_date=2024-04-28 03:35:13.476103+00:00, run_duration=0.388406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:35:11.344204+00:00, queued_by_job_id=1, pid=9840 2024-04-28T03:36:01.007888386Z [2024-04-28T03:36:01.003+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:36:01.037442674Z [2024-04-28T03:36:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:36:00+00:00, run_after=2024-04-28T03:37:00+00:00 2024-04-28T03:36:01.047115842Z [2024-04-28T03:36:01.046+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:36:01.121246226Z [2024-04-28T03:36:01.120+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:36:01.121289003Z 2024-04-28T03:36:01.121300638Z 2024-04-28T03:36:01.121309460Z 2024-04-28T03:36:01.121318872Z [2024-04-28T03:36:01.120+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:36:01.121327315Z [2024-04-28T03:36:01.121+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:36:01.121350039Z [2024-04-28T03:36:01.121+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:36:01.122058108Z [2024-04-28T03:36:01.121+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:36:01.122095727Z 2024-04-28T03:36:01.122128008Z 2024-04-28T03:36:01.122138067Z 2024-04-28T03:36:01.127224843Z [2024-04-28T03:36:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:36:01.127272541Z [2024-04-28T03:36:01.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:36:01.127609523Z [2024-04-28T03:36:01.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:36:01.127716480Z [2024-04-28T03:36:01.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:36:01.128116518Z [2024-04-28T03:36:01.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:36:01.128198600Z [2024-04-28T03:36:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:36:01.360595960Z [2024-04-28T03:36:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:34:00+00:00 exited with status queued for try_number 1 2024-04-28T03:36:01.360625227Z [2024-04-28T03:36:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status queued for try_number 1 2024-04-28T03:36:01.360687604Z [2024-04-28T03:36:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status queued for try_number 1 2024-04-28T03:36:01.368949618Z [2024-04-28T03:36:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to febe1ae3-bdfa-4126-9fb4-4f66014c48e1 2024-04-28T03:36:01.369105724Z [2024-04-28T03:36:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fc4d01d-9e65-4e4c-8296-28c38f29813f 2024-04-28T03:36:01.370839762Z [2024-04-28T03:36:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca2927c-de0f-4c30-850d-59854c820546 2024-04-28T03:36:02.526725233Z [2024-04-28T03:36:02.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:36:02.527252062Z [2024-04-28T03:36:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:34:00+00:00, run_id=scheduled__2024-04-28T03:34:00+00:00, run_start_date=2024-04-28 03:36:01.058218+00:00, run_end_date=2024-04-28 03:36:02.526797+00:00, run_duration=1.468579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:34:00+00:00, data_interval_end=2024-04-28 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:36:02.536326242Z [2024-04-28T03:36:02.536+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:36:00+00:00, run_after=2024-04-28T03:38:00+00:00 2024-04-28T03:36:02.591326969Z [2024-04-28T03:36:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:34:00+00:00 exited with status success for try_number 1 2024-04-28T03:36:02.599510586Z [2024-04-28T03:36:02.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:34:00+00:00, map_index=-1, run_start_date=2024-04-28 03:36:01.855618+00:00, run_end_date=2024-04-28 03:36:02.256265+00:00, run_duration=0.400647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:36:01.123051+00:00, queued_by_job_id=1, pid=9853 2024-04-28T03:36:06.178709460Z [2024-04-28T03:36:06.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:36:06.179100083Z [2024-04-28T03:36:06.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:35:00+00:00, run_id=scheduled__2024-04-28T03:35:00+00:00, run_start_date=2024-04-28 03:36:01.060916+00:00, run_end_date=2024-04-28 03:36:06.178638+00:00, run_duration=5.117722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:35:00+00:00, data_interval_end=2024-04-28 03:36:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:36:06.189589998Z [2024-04-28T03:36:06.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:36:00+00:00, run_after=2024-04-28T03:37:00+00:00 2024-04-28T03:36:06.196474220Z [2024-04-28T03:36:06.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:36:06.196897894Z [2024-04-28T03:36:06.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:35:00+00:00, run_id=scheduled__2024-04-28T03:35:00+00:00, run_start_date=2024-04-28 03:36:01.059741+00:00, run_end_date=2024-04-28 03:36:06.196390+00:00, run_duration=5.136649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:35:00+00:00, data_interval_end=2024-04-28 03:36:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:36:06.206129939Z [2024-04-28T03:36:06.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:36:00+00:00, run_after=2024-04-28T03:37:00+00:00 2024-04-28T03:36:06.239148239Z [2024-04-28T03:36:06.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status success for try_number 1 2024-04-28T03:36:06.255461364Z [2024-04-28T03:36:06.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:35:00+00:00, map_index=-1, run_start_date=2024-04-28 03:36:03.047870+00:00, run_end_date=2024-04-28 03:36:05.165470+00:00, run_duration=2.1176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:36:01.123051+00:00, queued_by_job_id=1, pid=9883 2024-04-28T03:36:06.851374520Z [2024-04-28T03:36:06.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status success for try_number 1 2024-04-28T03:36:06.856424754Z [2024-04-28T03:36:06.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:35:00+00:00, map_index=-1, run_start_date=2024-04-28 03:36:03.247311+00:00, run_end_date=2024-04-28 03:36:06.095081+00:00, run_duration=2.84777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:36:01.123051+00:00, queued_by_job_id=1, pid=9884 2024-04-28T03:36:17.142280734Z [2024-04-28T03:36:17.141+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:36:39.128762684Z [2024-04-28T03:36:39.128+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:36:39.128791990Z 2024-04-28T03:36:39.129176938Z [2024-04-28T03:36:39.128+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-28T03:36:39.129888552Z [2024-04-28T03:36:39.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:36:39.129899965Z 2024-04-28T03:36:39.133481568Z [2024-04-28T03:36:39.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240428033637_155746', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:36:39.133755513Z [2024-04-28T03:36:39.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240428033637_155746', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-28T03:36:39.191823824Z [2024-04-28T03:36:39.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240428033637_155746 exited with status queued for try_number 1 2024-04-28T03:36:39.199133935Z [2024-04-28T03:36:39.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to 972a4a19-f595-40f7-8623-cdf20cfe9046 2024-04-28T03:36:40.565549067Z [2024-04-28T03:36:40.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:36:40.565808785Z [2024-04-28T03:36:40.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-28 03:36:38.155933+00:00, run_id=vdu_alarm_20240428033637_155746, run_start_date=2024-04-28 03:36:39.077413+00:00, run_end_date=2024-04-28 03:36:40.565553+00:00, run_duration=1.48814, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 03:36:38.155933+00:00, data_interval_end=2024-04-28 03:36:38.155933+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-28T03:36:40.568780906Z [2024-04-28T03:36:40.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-28T03:36:40.619361296Z [2024-04-28T03:36:40.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240428033637_155746 exited with status success for try_number 1 2024-04-28T03:36:40.628631052Z [2024-04-28T03:36:40.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240428033637_155746, map_index=-1, run_start_date=2024-04-28 03:36:39.812652+00:00, run_end_date=2024-04-28 03:36:40.261397+00:00, run_duration=0.448745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:36:39.130600+00:00, queued_by_job_id=1, pid=9907 2024-04-28T03:37:00.925092106Z [2024-04-28T03:37:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:37:00+00:00, run_after=2024-04-28T03:38:00+00:00 2024-04-28T03:37:00.936508076Z [2024-04-28T03:37:00.936+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:37:00.998577988Z [2024-04-28T03:37:00.997+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:37:00.998630792Z 2024-04-28T03:37:00.998641367Z 2024-04-28T03:37:00.999219297Z [2024-04-28T03:37:00.998+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:37:00.999768239Z [2024-04-28T03:37:00.999+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:37:01.003345620Z [2024-04-28T03:37:01.002+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:37:01.003380441Z 2024-04-28T03:37:01.003390064Z 2024-04-28T03:37:01.011397862Z [2024-04-28T03:37:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:37:01.012205208Z [2024-04-28T03:37:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:37:01.014741098Z [2024-04-28T03:37:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:37:01.015033968Z [2024-04-28T03:37:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:37:01.179102683Z [2024-04-28T03:37:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:36:00+00:00 exited with status queued for try_number 1 2024-04-28T03:37:01.179229320Z [2024-04-28T03:37:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:36:00+00:00 exited with status queued for try_number 1 2024-04-28T03:37:01.186841153Z [2024-04-28T03:37:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9d228e2-3022-49b0-9f47-586388347cf8 2024-04-28T03:37:01.187055386Z [2024-04-28T03:37:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24ce5f36-e7e8-4af1-8e4a-e9b64a043be1 2024-04-28T03:37:04.926016504Z [2024-04-28T03:37:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:37:04.928165640Z [2024-04-28T03:37:04.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:36:00+00:00, run_id=scheduled__2024-04-28T03:36:00+00:00, run_start_date=2024-04-28 03:37:00.951120+00:00, run_end_date=2024-04-28 03:37:04.925936+00:00, run_duration=3.974816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:36:00+00:00, data_interval_end=2024-04-28 03:37:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:37:04.943537556Z [2024-04-28T03:37:04.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:37:00+00:00, run_after=2024-04-28T03:38:00+00:00 2024-04-28T03:37:05.018446178Z [2024-04-28T03:37:05.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:36:00+00:00 exited with status success for try_number 1 2024-04-28T03:37:05.029109373Z [2024-04-28T03:37:05.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:36:00+00:00, map_index=-1, run_start_date=2024-04-28 03:37:02.940036+00:00, run_end_date=2024-04-28 03:37:04.430246+00:00, run_duration=1.49021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:37:01.005010+00:00, queued_by_job_id=1, pid=9950 2024-04-28T03:37:06.097300870Z [2024-04-28T03:37:06.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:37:06.097831629Z [2024-04-28T03:37:06.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:36:00+00:00, run_id=scheduled__2024-04-28T03:36:00+00:00, run_start_date=2024-04-28 03:37:00.952860+00:00, run_end_date=2024-04-28 03:37:06.097190+00:00, run_duration=5.14433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:36:00+00:00, data_interval_end=2024-04-28 03:37:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:37:06.107263480Z [2024-04-28T03:37:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:37:00+00:00, run_after=2024-04-28T03:38:00+00:00 2024-04-28T03:37:06.150900642Z [2024-04-28T03:37:06.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:36:00+00:00 exited with status success for try_number 1 2024-04-28T03:37:06.159521355Z [2024-04-28T03:37:06.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:36:00+00:00, map_index=-1, run_start_date=2024-04-28 03:37:02.796197+00:00, run_end_date=2024-04-28 03:37:05.858288+00:00, run_duration=3.062091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:37:01.005010+00:00, queued_by_job_id=1, pid=9949 2024-04-28T03:38:00.098879382Z [2024-04-28T03:38:00.094+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:38:00.118826458Z [2024-04-28T03:38:00.118+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:38:00.135123190Z [2024-04-28T03:38:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:38:00+00:00, run_after=2024-04-28T03:39:00+00:00 2024-04-28T03:38:00.210242566Z [2024-04-28T03:38:00.209+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:38:00.210266380Z 2024-04-28T03:38:00.210270474Z 2024-04-28T03:38:00.210273845Z 2024-04-28T03:38:00.210496439Z [2024-04-28T03:38:00.210+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:38:00.210904807Z [2024-04-28T03:38:00.210+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:38:00.211058248Z [2024-04-28T03:38:00.210+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:38:00.211911097Z [2024-04-28T03:38:00.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:38:00.211945552Z 2024-04-28T03:38:00.211958658Z 2024-04-28T03:38:00.211965258Z 2024-04-28T03:38:00.222605565Z [2024-04-28T03:38:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:38:00.222627640Z [2024-04-28T03:38:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:38:00.222634545Z [2024-04-28T03:38:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:38:00.222639699Z [2024-04-28T03:38:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:38:00.222644319Z [2024-04-28T03:38:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:38:00.222649133Z [2024-04-28T03:38:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:38:00.557439658Z [2024-04-28T03:38:00.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:36:00+00:00 exited with status queued for try_number 1 2024-04-28T03:38:00.557491863Z [2024-04-28T03:38:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:37:00+00:00 exited with status queued for try_number 1 2024-04-28T03:38:00.557662875Z [2024-04-28T03:38:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:37:00+00:00 exited with status queued for try_number 1 2024-04-28T03:38:00.568149449Z [2024-04-28T03:38:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9440a398-ad92-4a19-929a-0a881e15b361 2024-04-28T03:38:00.568763060Z [2024-04-28T03:38:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91867780-16d2-441f-8cc2-d48cdf431d25 2024-04-28T03:38:00.570078070Z [2024-04-28T03:38:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to f54e6a50-8b56-433c-b4a2-0929266d9e20 2024-04-28T03:38:02.063981678Z [2024-04-28T03:38:02.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:38:02.064264154Z [2024-04-28T03:38:02.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:36:00+00:00, run_id=scheduled__2024-04-28T03:36:00+00:00, run_start_date=2024-04-28 03:38:00.144962+00:00, run_end_date=2024-04-28 03:38:02.063910+00:00, run_duration=1.918948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:36:00+00:00, data_interval_end=2024-04-28 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:38:02.096177870Z [2024-04-28T03:38:02.095+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:38:00+00:00, run_after=2024-04-28T03:40:00+00:00 2024-04-28T03:38:02.176765285Z [2024-04-28T03:38:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:36:00+00:00 exited with status success for try_number 1 2024-04-28T03:38:02.191482916Z [2024-04-28T03:38:02.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:36:00+00:00, map_index=-1, run_start_date=2024-04-28 03:38:01.049818+00:00, run_end_date=2024-04-28 03:38:01.368308+00:00, run_duration=0.31849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:38:00.213437+00:00, queued_by_job_id=1, pid=9975 2024-04-28T03:38:03.860742697Z [2024-04-28T03:38:03.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:38:03.861803067Z [2024-04-28T03:38:03.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:37:00+00:00, run_id=scheduled__2024-04-28T03:37:00+00:00, run_start_date=2024-04-28 03:38:00.146098+00:00, run_end_date=2024-04-28 03:38:03.860906+00:00, run_duration=3.714808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:37:00+00:00, data_interval_end=2024-04-28 03:38:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:38:03.876624811Z [2024-04-28T03:38:03.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:38:00+00:00, run_after=2024-04-28T03:39:00+00:00 2024-04-28T03:38:03.922424720Z [2024-04-28T03:38:03.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:37:00+00:00 exited with status success for try_number 1 2024-04-28T03:38:03.929880601Z [2024-04-28T03:38:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:37:00+00:00, map_index=-1, run_start_date=2024-04-28 03:38:02.116606+00:00, run_end_date=2024-04-28 03:38:03.554316+00:00, run_duration=1.43771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:38:00.213437+00:00, queued_by_job_id=1, pid=10015 2024-04-28T03:38:04.985218397Z [2024-04-28T03:38:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:38:04.985244544Z [2024-04-28T03:38:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:37:00+00:00, run_id=scheduled__2024-04-28T03:37:00+00:00, run_start_date=2024-04-28 03:38:00.147110+00:00, run_end_date=2024-04-28 03:38:04.983342+00:00, run_duration=4.836232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:37:00+00:00, data_interval_end=2024-04-28 03:38:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:38:04.996520804Z [2024-04-28T03:38:04.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:38:00+00:00, run_after=2024-04-28T03:39:00+00:00 2024-04-28T03:38:05.023848864Z [2024-04-28T03:38:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:37:00+00:00 exited with status success for try_number 1 2024-04-28T03:38:05.028458569Z [2024-04-28T03:38:05.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:37:00+00:00, map_index=-1, run_start_date=2024-04-28 03:38:02.238256+00:00, run_end_date=2024-04-28 03:38:03.910222+00:00, run_duration=1.671966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:38:00.213437+00:00, queued_by_job_id=1, pid=10016 2024-04-28T03:39:01.029480148Z [2024-04-28T03:39:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:39:00+00:00, run_after=2024-04-28T03:40:00+00:00 2024-04-28T03:39:01.039420937Z [2024-04-28T03:39:01.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:39:01.099135408Z [2024-04-28T03:39:01.098+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:39:01.099166504Z 2024-04-28T03:39:01.099171830Z 2024-04-28T03:39:01.099524645Z [2024-04-28T03:39:01.099+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:39:01.099776458Z [2024-04-28T03:39:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:39:01.100521200Z [2024-04-28T03:39:01.100+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:39:01.100555051Z 2024-04-28T03:39:01.100561426Z 2024-04-28T03:39:01.103725150Z [2024-04-28T03:39:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:39:01.103992872Z [2024-04-28T03:39:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:39:01.104303336Z [2024-04-28T03:39:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:39:01.104485390Z [2024-04-28T03:39:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:39:01.259319819Z [2024-04-28T03:39:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:38:00+00:00 exited with status queued for try_number 1 2024-04-28T03:39:01.259349389Z [2024-04-28T03:39:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:38:00+00:00 exited with status queued for try_number 1 2024-04-28T03:39:01.266150124Z [2024-04-28T03:39:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dcead5e-631b-463e-8966-d907518d872b 2024-04-28T03:39:01.266239447Z [2024-04-28T03:39:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5d30369-53bd-4d68-967f-2857bbc72928 2024-04-28T03:39:05.392347936Z [2024-04-28T03:39:05.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:39:05.394460792Z [2024-04-28T03:39:05.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:38:00+00:00, run_id=scheduled__2024-04-28T03:38:00+00:00, run_start_date=2024-04-28 03:39:01.051347+00:00, run_end_date=2024-04-28 03:39:05.392262+00:00, run_duration=4.340915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:38:00+00:00, data_interval_end=2024-04-28 03:39:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:39:05.412769634Z [2024-04-28T03:39:05.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:39:00+00:00, run_after=2024-04-28T03:40:00+00:00 2024-04-28T03:39:05.541915507Z [2024-04-28T03:39:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:38:00+00:00 exited with status success for try_number 1 2024-04-28T03:39:05.555140186Z [2024-04-28T03:39:05.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:38:00+00:00, map_index=-1, run_start_date=2024-04-28 03:39:03.175222+00:00, run_end_date=2024-04-28 03:39:04.879027+00:00, run_duration=1.703805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:39:01.101115+00:00, queued_by_job_id=1, pid=10060 2024-04-28T03:39:06.599134954Z [2024-04-28T03:39:06.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:39:06.599564540Z [2024-04-28T03:39:06.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:38:00+00:00, run_id=scheduled__2024-04-28T03:38:00+00:00, run_start_date=2024-04-28 03:39:01.052982+00:00, run_end_date=2024-04-28 03:39:06.599239+00:00, run_duration=5.546257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:38:00+00:00, data_interval_end=2024-04-28 03:39:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:39:06.609599084Z [2024-04-28T03:39:06.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:39:00+00:00, run_after=2024-04-28T03:40:00+00:00 2024-04-28T03:39:06.653843642Z [2024-04-28T03:39:06.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:38:00+00:00 exited with status success for try_number 1 2024-04-28T03:39:06.658925130Z [2024-04-28T03:39:06.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:38:00+00:00, map_index=-1, run_start_date=2024-04-28 03:39:03.468598+00:00, run_end_date=2024-04-28 03:39:05.475722+00:00, run_duration=2.007124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:39:01.101115+00:00, queued_by_job_id=1, pid=10070 2024-04-28T03:40:00.972163447Z [2024-04-28T03:40:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:40:00.979365580Z [2024-04-28T03:40:00.979+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:40:00.991629398Z [2024-04-28T03:40:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:40:00+00:00, run_after=2024-04-28T03:41:00+00:00 2024-04-28T03:40:01.016274101Z [2024-04-28T03:40:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:40:00+00:00, run_after=2024-04-28T03:45:00+00:00 2024-04-28T03:40:01.145536313Z [2024-04-28T03:40:01.145+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T03:40:01.145575030Z 2024-04-28T03:40:01.145581961Z 2024-04-28T03:40:01.145592489Z 2024-04-28T03:40:01.145620151Z 2024-04-28T03:40:01.146085058Z [2024-04-28T03:40:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:40:01.146474351Z [2024-04-28T03:40:01.146+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:40:01.146788027Z [2024-04-28T03:40:01.146+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:40:01.147127899Z [2024-04-28T03:40:01.146+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:40:01.148272046Z [2024-04-28T03:40:01.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:40:01.148290910Z 2024-04-28T03:40:01.148300932Z 2024-04-28T03:40:01.148309702Z 2024-04-28T03:40:01.148315854Z 2024-04-28T03:40:01.156399727Z [2024-04-28T03:40:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:40:01.156689869Z [2024-04-28T03:40:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:40:01.157298417Z [2024-04-28T03:40:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:40:01.157627635Z [2024-04-28T03:40:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:40:01.158070780Z [2024-04-28T03:40:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:40:01.158433443Z [2024-04-28T03:40:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:40:01.158747381Z [2024-04-28T03:40:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:40:01.158973275Z [2024-04-28T03:40:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:40:01.715600351Z [2024-04-28T03:40:01.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:01.715746079Z [2024-04-28T03:40:01.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:38:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:01.715911667Z [2024-04-28T03:40:01.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:39:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:01.716095975Z [2024-04-28T03:40:01.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:39:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:01.731205329Z [2024-04-28T03:40:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7551dcd8-0cd6-4bb0-8133-1254d861fb60 2024-04-28T03:40:01.731784100Z [2024-04-28T03:40:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b6135aa-1632-48d8-a9f1-042a853e9983 2024-04-28T03:40:01.732125442Z [2024-04-28T03:40:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to c57489f2-d412-4392-ae3b-de403c48d65d 2024-04-28T03:40:01.732464005Z [2024-04-28T03:40:01.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c4b0cfd-51d1-4e98-ab6d-81a6cbac3c49 2024-04-28T03:40:02.920042829Z [2024-04-28T03:40:02.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:40:02.920121834Z [2024-04-28T03:40:02.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:38:00+00:00, run_id=scheduled__2024-04-28T03:38:00+00:00, run_start_date=2024-04-28 03:40:01.045149+00:00, run_end_date=2024-04-28 03:40:02.918486+00:00, run_duration=1.873337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:38:00+00:00, data_interval_end=2024-04-28 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:40:02.958162947Z [2024-04-28T03:40:02.955+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:40:00+00:00, run_after=2024-04-28T03:42:00+00:00 2024-04-28T03:40:03.124443672Z [2024-04-28T03:40:03.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:38:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:03.131259311Z [2024-04-28T03:40:03.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:38:00+00:00, map_index=-1, run_start_date=2024-04-28 03:40:02.100739+00:00, run_end_date=2024-04-28 03:40:02.563346+00:00, run_duration=0.462607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:01.150041+00:00, queued_by_job_id=1, pid=10106 2024-04-28T03:40:04.297746741Z [2024-04-28T03:40:04.297+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:40:04.297774964Z 2024-04-28T03:40:04.298002709Z [2024-04-28T03:40:04.297+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:40:04.298673064Z [2024-04-28T03:40:04.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:40:04.298686936Z 2024-04-28T03:40:04.301702199Z [2024-04-28T03:40:04.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:40:04.301859945Z [2024-04-28T03:40:04.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:40:04.354354763Z [2024-04-28T03:40:04.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:04.354530465Z [2024-04-28T03:40:04.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:04.362740423Z [2024-04-28T03:40:04.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72827e2a-2dd1-418c-8142-42666daea764 2024-04-28T03:40:04.364104236Z [2024-04-28T03:40:04.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:35:00+00:00, map_index=-1, run_start_date=2024-04-28 03:40:03.673257+00:00, run_end_date=2024-04-28 03:40:04.078593+00:00, run_duration=0.405336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:01.150041+00:00, queued_by_job_id=1, pid=10147 2024-04-28T03:40:05.923907774Z [2024-04-28T03:40:05.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:40:05.924137646Z [2024-04-28T03:40:05.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:39:00+00:00, run_id=scheduled__2024-04-28T03:39:00+00:00, run_start_date=2024-04-28 03:40:01.048600+00:00, run_end_date=2024-04-28 03:40:05.923816+00:00, run_duration=4.875216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:39:00+00:00, data_interval_end=2024-04-28 03:40:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:40:05.938394251Z [2024-04-28T03:40:05.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:40:00+00:00, run_after=2024-04-28T03:41:00+00:00 2024-04-28T03:40:05.957254946Z [2024-04-28T03:40:05.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:40:05.957540719Z [2024-04-28T03:40:05.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:39:00+00:00, run_id=scheduled__2024-04-28T03:39:00+00:00, run_start_date=2024-04-28 03:40:01.046898+00:00, run_end_date=2024-04-28 03:40:05.957216+00:00, run_duration=4.910318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:39:00+00:00, data_interval_end=2024-04-28 03:40:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:40:05.976959194Z [2024-04-28T03:40:05.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:40:00+00:00, run_after=2024-04-28T03:41:00+00:00 2024-04-28T03:40:06.056133751Z [2024-04-28T03:40:06.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:39:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:06.057304997Z [2024-04-28T03:40:06.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:39:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:06.072810008Z [2024-04-28T03:40:06.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:39:00+00:00, map_index=-1, run_start_date=2024-04-28 03:40:03.598560+00:00, run_end_date=2024-04-28 03:40:05.057049+00:00, run_duration=1.458489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:01.150041+00:00, queued_by_job_id=1, pid=10146 2024-04-28T03:40:06.072830667Z [2024-04-28T03:40:06.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:39:00+00:00, map_index=-1, run_start_date=2024-04-28 03:40:03.720191+00:00, run_end_date=2024-04-28 03:40:05.553667+00:00, run_duration=1.833476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:01.150041+00:00, queued_by_job_id=1, pid=10148 2024-04-28T03:40:07.941779340Z [2024-04-28T03:40:07.940+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:40:07.941852691Z 2024-04-28T03:40:07.942459000Z [2024-04-28T03:40:07.941+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:40:07.945160020Z [2024-04-28T03:40:07.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:40:07.945237571Z 2024-04-28T03:40:07.952186411Z [2024-04-28T03:40:07.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:40:07.952579891Z [2024-04-28T03:40:07.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:40:08.026954081Z [2024-04-28T03:40:08.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:08.027282370Z [2024-04-28T03:40:08.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:08.036086946Z [2024-04-28T03:40:08.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f361404-15bb-49d1-9dc1-2e26efa0b327 2024-04-28T03:40:08.036591137Z [2024-04-28T03:40:08.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:35:00+00:00, map_index=-1, run_start_date=2024-04-28 03:40:06.484985+00:00, run_end_date=2024-04-28 03:40:06.920832+00:00, run_duration=0.435847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:04.299533+00:00, queued_by_job_id=1, pid=10190 2024-04-28T03:40:10.453492888Z [2024-04-28T03:40:10.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:40:10.453552049Z 2024-04-28T03:40:10.454012066Z [2024-04-28T03:40:10.453+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:40:10.455648363Z [2024-04-28T03:40:10.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:40:10.455667930Z 2024-04-28T03:40:10.458934216Z [2024-04-28T03:40:10.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:40:10.459174695Z [2024-04-28T03:40:10.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:40:10.521039702Z [2024-04-28T03:40:10.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status queued for try_number 1 2024-04-28T03:40:10.521139340Z [2024-04-28T03:40:10.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:10.526411152Z [2024-04-28T03:40:10.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to f64f4086-3d53-419b-af4a-158d3d1a663b 2024-04-28T03:40:10.526582463Z [2024-04-28T03:40:10.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:35:00+00:00, map_index=0, run_start_date=2024-04-28 03:40:09.774459+00:00, run_end_date=2024-04-28 03:40:10.178799+00:00, run_duration=0.40434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:07.946551+00:00, queued_by_job_id=1, pid=10202 2024-04-28T03:40:12.719562279Z [2024-04-28T03:40:12.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:40:12.719951666Z [2024-04-28T03:40:12.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:35:00+00:00, run_id=scheduled__2024-04-28T03:35:00+00:00, run_start_date=2024-04-28 03:40:01.043142+00:00, run_end_date=2024-04-28 03:40:12.719458+00:00, run_duration=11.676316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:35:00+00:00, data_interval_end=2024-04-28 03:40:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:40:12.725864052Z [2024-04-28T03:40:12.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:40:00+00:00, run_after=2024-04-28T03:45:00+00:00 2024-04-28T03:40:12.769259199Z [2024-04-28T03:40:12.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:35:00+00:00 exited with status success for try_number 1 2024-04-28T03:40:12.779603843Z [2024-04-28T03:40:12.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:35:00+00:00, map_index=-1, run_start_date=2024-04-28 03:40:12.149783+00:00, run_end_date=2024-04-28 03:40:12.577542+00:00, run_duration=0.427759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:10.456555+00:00, queued_by_job_id=1, pid=10214 2024-04-28T03:40:38.192937255Z [2024-04-28T03:40:38.192+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:40:38.193006958Z 2024-04-28T03:40:38.193179820Z [2024-04-28T03:40:38.192+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-28T03:40:38.194758626Z [2024-04-28T03:40:38.194+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:40:38.194781351Z 2024-04-28T03:40:38.198975431Z [2024-04-28T03:40:38.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240428034037_778489', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:40:38.199328854Z [2024-04-28T03:40:38.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240428034037_778489', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-28T03:40:38.258567266Z [2024-04-28T03:40:38.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240428034037_778489 exited with status queued for try_number 1 2024-04-28T03:40:38.267645237Z [2024-04-28T03:40:38.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d423a6c-7e4b-4ce5-9663-9cc9bb9d138c 2024-04-28T03:40:40.005705062Z [2024-04-28T03:40:40.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:40:40.006085060Z [2024-04-28T03:40:40.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-28 03:40:38.105472+00:00, run_id=vdu_alarm_20240428034037_778489, run_start_date=2024-04-28 03:40:38.149593+00:00, run_end_date=2024-04-28 03:40:40.005628+00:00, run_duration=1.856035, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-28 03:40:38.105472+00:00, data_interval_end=2024-04-28 03:40:38.105472+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-28T03:40:40.017113933Z [2024-04-28T03:40:40.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-28T03:40:40.093154975Z [2024-04-28T03:40:40.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240428034037_778489 exited with status success for try_number 1 2024-04-28T03:40:40.163102343Z [2024-04-28T03:40:40.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240428034037_778489, map_index=-1, run_start_date=2024-04-28 03:40:38.845945+00:00, run_end_date=2024-04-28 03:40:39.251562+00:00, run_duration=0.405617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:40:38.195508+00:00, queued_by_job_id=1, pid=10216 2024-04-28T03:41:00.138708575Z [2024-04-28T03:41:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:41:00.151097829Z [2024-04-28T03:41:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:41:00+00:00, run_after=2024-04-28T03:42:00+00:00 2024-04-28T03:41:00.196739082Z [2024-04-28T03:41:00.196+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:41:00.196773360Z 2024-04-28T03:41:00.196777262Z 2024-04-28T03:41:00.196834171Z [2024-04-28T03:41:00.196+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:41:00.196838923Z [2024-04-28T03:41:00.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:41:00.197313322Z [2024-04-28T03:41:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:41:00.197321800Z 2024-04-28T03:41:00.197324925Z 2024-04-28T03:41:00.199762625Z [2024-04-28T03:41:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:41:00.199975891Z [2024-04-28T03:41:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:41:00.200229089Z [2024-04-28T03:41:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:41:00.200356601Z [2024-04-28T03:41:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:41:00.390474537Z [2024-04-28T03:41:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:41:00.390496465Z [2024-04-28T03:41:00.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:41:00.404602936Z [2024-04-28T03:41:00.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fcc6add-ddc5-431f-b03c-3dba29c873be 2024-04-28T03:41:00.404623682Z [2024-04-28T03:41:00.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d125a88-818d-4525-b15d-b78bfd521863 2024-04-28T03:41:03.734984468Z [2024-04-28T03:41:03.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:41:03.735187073Z [2024-04-28T03:41:03.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:40:00+00:00, run_id=scheduled__2024-04-28T03:40:00+00:00, run_start_date=2024-04-28 03:41:00.162961+00:00, run_end_date=2024-04-28 03:41:03.734913+00:00, run_duration=3.571952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:40:00+00:00, data_interval_end=2024-04-28 03:41:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:41:03.744080540Z [2024-04-28T03:41:03.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:41:00+00:00, run_after=2024-04-28T03:42:00+00:00 2024-04-28T03:41:03.749985340Z [2024-04-28T03:41:03.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:41:03.750166039Z [2024-04-28T03:41:03.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:40:00+00:00, run_id=scheduled__2024-04-28T03:40:00+00:00, run_start_date=2024-04-28 03:41:00.161534+00:00, run_end_date=2024-04-28 03:41:03.749917+00:00, run_duration=3.588383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:40:00+00:00, data_interval_end=2024-04-28 03:41:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:41:03.760108039Z [2024-04-28T03:41:03.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:41:00+00:00, run_after=2024-04-28T03:42:00+00:00 2024-04-28T03:41:03.784890929Z [2024-04-28T03:41:03.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:41:03.789174875Z [2024-04-28T03:41:03.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=-1, run_start_date=2024-04-28 03:41:01.916440+00:00, run_end_date=2024-04-28 03:41:03.225137+00:00, run_duration=1.308697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:41:00.197768+00:00, queued_by_job_id=1, pid=10258 2024-04-28T03:41:04.169271304Z [2024-04-28T03:41:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:41:04.176699749Z [2024-04-28T03:41:04.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=-1, run_start_date=2024-04-28 03:41:01.929995+00:00, run_end_date=2024-04-28 03:41:03.672054+00:00, run_duration=1.742059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:41:00.197768+00:00, queued_by_job_id=1, pid=10259 2024-04-28T03:41:17.221960866Z [2024-04-28T03:41:17.221+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:42:01.021007004Z [2024-04-28T03:42:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:42:01.031384523Z [2024-04-28T03:42:01.030+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:42:01.048102555Z [2024-04-28T03:42:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:42:00+00:00, run_after=2024-04-28T03:43:00+00:00 2024-04-28T03:42:01.160003232Z [2024-04-28T03:42:01.159+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:42:01.160045351Z 2024-04-28T03:42:01.160055942Z 2024-04-28T03:42:01.160064738Z 2024-04-28T03:42:01.160092917Z [2024-04-28T03:42:01.159+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:42:01.160476542Z [2024-04-28T03:42:01.160+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:42:01.160762025Z [2024-04-28T03:42:01.160+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:42:01.161814178Z [2024-04-28T03:42:01.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:42:01.161835238Z 2024-04-28T03:42:01.161844539Z 2024-04-28T03:42:01.161853001Z 2024-04-28T03:42:01.167118957Z [2024-04-28T03:42:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:42:01.167627064Z [2024-04-28T03:42:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:42:01.168019666Z [2024-04-28T03:42:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:42:01.168342834Z [2024-04-28T03:42:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:42:01.168788031Z [2024-04-28T03:42:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:42:01.168924513Z [2024-04-28T03:42:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:42:01.459984365Z [2024-04-28T03:42:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:42:01.460110550Z [2024-04-28T03:42:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:41:00+00:00 exited with status queued for try_number 1 2024-04-28T03:42:01.460369562Z [2024-04-28T03:42:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:41:00+00:00 exited with status queued for try_number 1 2024-04-28T03:42:01.473170392Z [2024-04-28T03:42:01.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to c62c01f0-62ce-431e-ade6-28c75610c0a9 2024-04-28T03:42:01.473540560Z [2024-04-28T03:42:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6d8b8c5-3ac9-4202-b3b6-3233622c93dc 2024-04-28T03:42:01.473904968Z [2024-04-28T03:42:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 067d5fe3-59d0-45ed-b3f9-e81b37e4173f 2024-04-28T03:42:02.646102298Z [2024-04-28T03:42:02.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:42:02.646502060Z [2024-04-28T03:42:02.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:40:00+00:00, run_id=scheduled__2024-04-28T03:40:00+00:00, run_start_date=2024-04-28 03:42:01.076894+00:00, run_end_date=2024-04-28 03:42:02.646039+00:00, run_duration=1.569145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:40:00+00:00, data_interval_end=2024-04-28 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:42:02.655140413Z [2024-04-28T03:42:02.654+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:42:00+00:00, run_after=2024-04-28T03:44:00+00:00 2024-04-28T03:42:02.697013248Z [2024-04-28T03:42:02.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:42:02.708508785Z [2024-04-28T03:42:02.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=-1, run_start_date=2024-04-28 03:42:01.936038+00:00, run_end_date=2024-04-28 03:42:02.309821+00:00, run_duration=0.373783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:42:01.163039+00:00, queued_by_job_id=1, pid=10295 2024-04-28T03:42:04.911238753Z [2024-04-28T03:42:04.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:42:04.911794317Z [2024-04-28T03:42:04.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:41:00+00:00, run_id=scheduled__2024-04-28T03:41:00+00:00, run_start_date=2024-04-28 03:42:01.079287+00:00, run_end_date=2024-04-28 03:42:04.911334+00:00, run_duration=3.832047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:41:00+00:00, data_interval_end=2024-04-28 03:42:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:42:04.920893290Z [2024-04-28T03:42:04.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:42:00+00:00, run_after=2024-04-28T03:43:00+00:00 2024-04-28T03:42:05.014583348Z [2024-04-28T03:42:05.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:41:00+00:00 exited with status success for try_number 1 2024-04-28T03:42:05.032184952Z [2024-04-28T03:42:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:41:00+00:00, map_index=-1, run_start_date=2024-04-28 03:42:03.150662+00:00, run_end_date=2024-04-28 03:42:04.735570+00:00, run_duration=1.584908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:42:01.163039+00:00, queued_by_job_id=1, pid=10325 2024-04-28T03:42:05.768397017Z [2024-04-28T03:42:05.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:42:05.768550228Z [2024-04-28T03:42:05.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:41:00+00:00, run_id=scheduled__2024-04-28T03:41:00+00:00, run_start_date=2024-04-28 03:42:01.081213+00:00, run_end_date=2024-04-28 03:42:05.768308+00:00, run_duration=4.687095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:41:00+00:00, data_interval_end=2024-04-28 03:42:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:42:05.789988158Z [2024-04-28T03:42:05.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:42:00+00:00, run_after=2024-04-28T03:43:00+00:00 2024-04-28T03:42:05.853624097Z [2024-04-28T03:42:05.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:41:00+00:00 exited with status success for try_number 1 2024-04-28T03:42:05.864606034Z [2024-04-28T03:42:05.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:41:00+00:00, map_index=-1, run_start_date=2024-04-28 03:42:03.248874+00:00, run_end_date=2024-04-28 03:42:05.055012+00:00, run_duration=1.806138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:42:01.163039+00:00, queued_by_job_id=1, pid=10326 2024-04-28T03:43:00.394954473Z [2024-04-28T03:43:00.393+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:43:00.411673023Z [2024-04-28T03:43:00.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:43:00+00:00, run_after=2024-04-28T03:44:00+00:00 2024-04-28T03:43:00.489990127Z [2024-04-28T03:43:00.489+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:43:00.490013288Z 2024-04-28T03:43:00.490032205Z 2024-04-28T03:43:00.490035751Z [2024-04-28T03:43:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:43:00.491152634Z [2024-04-28T03:43:00.489+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:43:00.491168081Z [2024-04-28T03:43:00.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:43:00.491171758Z 2024-04-28T03:43:00.491175057Z 2024-04-28T03:43:00.493350918Z [2024-04-28T03:43:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:43:00.493598544Z [2024-04-28T03:43:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:43:00.493915663Z [2024-04-28T03:43:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:43:00.494084094Z [2024-04-28T03:43:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:43:00.662742717Z [2024-04-28T03:43:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:42:00+00:00 exited with status queued for try_number 1 2024-04-28T03:43:00.663006967Z [2024-04-28T03:43:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:42:00+00:00 exited with status queued for try_number 1 2024-04-28T03:43:00.672990920Z [2024-04-28T03:43:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73fbb3c7-1f30-447a-8f97-acc2054acb30 2024-04-28T03:43:00.673355550Z [2024-04-28T03:43:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54a5bf79-c93b-4ef2-883d-8fa81b3d36fd 2024-04-28T03:43:04.286787736Z [2024-04-28T03:43:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:43:04.286837448Z [2024-04-28T03:43:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:42:00+00:00, run_id=scheduled__2024-04-28T03:42:00+00:00, run_start_date=2024-04-28 03:43:00.426652+00:00, run_end_date=2024-04-28 03:43:04.285485+00:00, run_duration=3.858833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:42:00+00:00, data_interval_end=2024-04-28 03:43:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:43:04.298735945Z [2024-04-28T03:43:04.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:43:00+00:00, run_after=2024-04-28T03:44:00+00:00 2024-04-28T03:43:04.306109699Z [2024-04-28T03:43:04.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:43:04.306720732Z [2024-04-28T03:43:04.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:42:00+00:00, run_id=scheduled__2024-04-28T03:42:00+00:00, run_start_date=2024-04-28 03:43:00.428287+00:00, run_end_date=2024-04-28 03:43:04.306065+00:00, run_duration=3.877778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:42:00+00:00, data_interval_end=2024-04-28 03:43:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:43:04.314947942Z [2024-04-28T03:43:04.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:43:00+00:00, run_after=2024-04-28T03:44:00+00:00 2024-04-28T03:43:04.355388313Z [2024-04-28T03:43:04.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:42:00+00:00 exited with status success for try_number 1 2024-04-28T03:43:04.355484840Z [2024-04-28T03:43:04.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:42:00+00:00 exited with status success for try_number 1 2024-04-28T03:43:04.361919334Z [2024-04-28T03:43:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:42:00+00:00, map_index=-1, run_start_date=2024-04-28 03:43:02.287951+00:00, run_end_date=2024-04-28 03:43:03.558514+00:00, run_duration=1.270563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:43:00.491348+00:00, queued_by_job_id=1, pid=10380 2024-04-28T03:43:04.362013354Z [2024-04-28T03:43:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:42:00+00:00, map_index=-1, run_start_date=2024-04-28 03:43:02.290924+00:00, run_end_date=2024-04-28 03:43:03.967881+00:00, run_duration=1.676957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:43:00.491348+00:00, queued_by_job_id=1, pid=10381 2024-04-28T03:44:00.970872133Z [2024-04-28T03:44:00.967+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:44:00.981068624Z [2024-04-28T03:44:00.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:44:00+00:00, run_after=2024-04-28T03:45:00+00:00 2024-04-28T03:44:00.990064920Z [2024-04-28T03:44:00.989+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:44:01.063026872Z [2024-04-28T03:44:01.062+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:44:01.063086168Z 2024-04-28T03:44:01.063097187Z 2024-04-28T03:44:01.063106836Z 2024-04-28T03:44:01.063118896Z [2024-04-28T03:44:01.062+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:44:01.063144251Z [2024-04-28T03:44:01.062+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:44:01.063153335Z [2024-04-28T03:44:01.062+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:44:01.064129185Z [2024-04-28T03:44:01.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:44:01.064151239Z 2024-04-28T03:44:01.064161369Z 2024-04-28T03:44:01.064170025Z 2024-04-28T03:44:01.068155905Z [2024-04-28T03:44:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:44:01.068251921Z [2024-04-28T03:44:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:44:01.069016678Z [2024-04-28T03:44:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:44:01.069035907Z [2024-04-28T03:44:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:44:01.069380599Z [2024-04-28T03:44:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:44:01.069529438Z [2024-04-28T03:44:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:44:01.335027020Z [2024-04-28T03:44:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:42:00+00:00 exited with status queued for try_number 1 2024-04-28T03:44:01.335227989Z [2024-04-28T03:44:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:43:00+00:00 exited with status queued for try_number 1 2024-04-28T03:44:01.335389073Z [2024-04-28T03:44:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:43:00+00:00 exited with status queued for try_number 1 2024-04-28T03:44:01.348834712Z [2024-04-28T03:44:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b89e492-f689-403d-968a-564747a8627e 2024-04-28T03:44:01.349378847Z [2024-04-28T03:44:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1585949-2de0-4fd9-bf2a-9e39fc2bf1fc 2024-04-28T03:44:01.349789343Z [2024-04-28T03:44:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80c8480e-3d86-46f2-a1ef-b6cfad82ea83 2024-04-28T03:44:03.074700678Z [2024-04-28T03:44:03.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:44:03.075105260Z [2024-04-28T03:44:03.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:42:00+00:00, run_id=scheduled__2024-04-28T03:42:00+00:00, run_start_date=2024-04-28 03:44:00.999058+00:00, run_end_date=2024-04-28 03:44:03.074645+00:00, run_duration=2.075587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:42:00+00:00, data_interval_end=2024-04-28 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:44:03.087781768Z [2024-04-28T03:44:03.087+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:44:00+00:00, run_after=2024-04-28T03:46:00+00:00 2024-04-28T03:44:03.220865590Z [2024-04-28T03:44:03.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:42:00+00:00 exited with status success for try_number 1 2024-04-28T03:44:03.239300140Z [2024-04-28T03:44:03.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:42:00+00:00, map_index=-1, run_start_date=2024-04-28 03:44:01.861098+00:00, run_end_date=2024-04-28 03:44:02.288063+00:00, run_duration=0.426965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:44:01.065044+00:00, queued_by_job_id=1, pid=10416 2024-04-28T03:44:05.380410419Z [2024-04-28T03:44:05.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:44:05.381821679Z [2024-04-28T03:44:05.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:43:00+00:00, run_id=scheduled__2024-04-28T03:43:00+00:00, run_start_date=2024-04-28 03:44:01.002449+00:00, run_end_date=2024-04-28 03:44:05.380280+00:00, run_duration=4.377831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:43:00+00:00, data_interval_end=2024-04-28 03:44:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:44:05.397028102Z [2024-04-28T03:44:05.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:44:00+00:00, run_after=2024-04-28T03:45:00+00:00 2024-04-28T03:44:05.412126991Z [2024-04-28T03:44:05.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:44:05.412255590Z [2024-04-28T03:44:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:43:00+00:00, run_id=scheduled__2024-04-28T03:43:00+00:00, run_start_date=2024-04-28 03:44:01.003853+00:00, run_end_date=2024-04-28 03:44:05.412023+00:00, run_duration=4.40817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:43:00+00:00, data_interval_end=2024-04-28 03:44:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:44:05.427948942Z [2024-04-28T03:44:05.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:44:00+00:00, run_after=2024-04-28T03:45:00+00:00 2024-04-28T03:44:05.498976990Z [2024-04-28T03:44:05.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:43:00+00:00 exited with status success for try_number 1 2024-04-28T03:44:05.499047619Z [2024-04-28T03:44:05.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:43:00+00:00 exited with status success for try_number 1 2024-04-28T03:44:05.517011996Z [2024-04-28T03:44:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:43:00+00:00, map_index=-1, run_start_date=2024-04-28 03:44:03.265166+00:00, run_end_date=2024-04-28 03:44:04.589761+00:00, run_duration=1.324595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:44:01.065044+00:00, queued_by_job_id=1, pid=10447 2024-04-28T03:44:05.517231530Z [2024-04-28T03:44:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:43:00+00:00, map_index=-1, run_start_date=2024-04-28 03:44:03.248004+00:00, run_end_date=2024-04-28 03:44:04.869128+00:00, run_duration=1.621124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:44:01.065044+00:00, queued_by_job_id=1, pid=10446 2024-04-28T03:45:00.979191043Z [2024-04-28T03:45:00.978+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:45:00.993090522Z [2024-04-28T03:45:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:45:00+00:00, run_after=2024-04-28T03:46:00+00:00 2024-04-28T03:45:01.003780741Z [2024-04-28T03:45:01.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:45:00+00:00, run_after=2024-04-28T03:50:00+00:00 2024-04-28T03:45:01.088553000Z [2024-04-28T03:45:01.088+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:45:01.088587136Z 2024-04-28T03:45:01.088598953Z 2024-04-28T03:45:01.088605586Z 2024-04-28T03:45:01.088936120Z [2024-04-28T03:45:01.088+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:45:01.089329634Z [2024-04-28T03:45:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:45:01.089643421Z [2024-04-28T03:45:01.089+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:45:01.090943739Z [2024-04-28T03:45:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:45:01.090964607Z 2024-04-28T03:45:01.090988964Z 2024-04-28T03:45:01.090995861Z 2024-04-28T03:45:01.097629227Z [2024-04-28T03:45:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:45:01.097668920Z [2024-04-28T03:45:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:45:01.097961433Z [2024-04-28T03:45:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:45:01.098005703Z [2024-04-28T03:45:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:45:01.098479510Z [2024-04-28T03:45:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:45:01.098644188Z [2024-04-28T03:45:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:45:01.318783247Z [2024-04-28T03:45:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:45:01.319084162Z [2024-04-28T03:45:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:44:00+00:00 exited with status queued for try_number 1 2024-04-28T03:45:01.319240325Z [2024-04-28T03:45:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:44:00+00:00 exited with status queued for try_number 1 2024-04-28T03:45:01.327393591Z [2024-04-28T03:45:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d548673-aca1-42d0-9f99-c09bf30bad3e 2024-04-28T03:45:01.327706094Z [2024-04-28T03:45:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16eeaadf-7114-475e-854c-a92f11d86b0e 2024-04-28T03:45:01.327898604Z [2024-04-28T03:45:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 711cbbd5-d99d-455b-b287-5cfc213047a2 2024-04-28T03:45:04.048984597Z [2024-04-28T03:45:04.048+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:45:04.049028683Z 2024-04-28T03:45:04.049042098Z [2024-04-28T03:45:04.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:45:04.049653672Z [2024-04-28T03:45:04.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:45:04.049665494Z 2024-04-28T03:45:04.053755003Z [2024-04-28T03:45:04.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:45:04.053951301Z [2024-04-28T03:45:04.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:45:04.146756631Z [2024-04-28T03:45:04.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:45:04.146841877Z [2024-04-28T03:45:04.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:45:04.155655357Z [2024-04-28T03:45:04.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 015f4f03-824a-4a1a-b019-4df267bb4ba7 2024-04-28T03:45:04.155909605Z [2024-04-28T03:45:04.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=-1, run_start_date=2024-04-28 03:45:02.902914+00:00, run_end_date=2024-04-28 03:45:03.263228+00:00, run_duration=0.360314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:45:01.092776+00:00, queued_by_job_id=1, pid=10503 2024-04-28T03:45:05.416340630Z [2024-04-28T03:45:05.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:45:05.420718542Z [2024-04-28T03:45:05.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:44:00+00:00, run_id=scheduled__2024-04-28T03:44:00+00:00, run_start_date=2024-04-28 03:45:01.019859+00:00, run_end_date=2024-04-28 03:45:05.416250+00:00, run_duration=4.396391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:44:00+00:00, data_interval_end=2024-04-28 03:45:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:45:05.443525822Z [2024-04-28T03:45:05.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:45:00+00:00, run_after=2024-04-28T03:46:00+00:00 2024-04-28T03:45:05.464836448Z [2024-04-28T03:45:05.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:45:05.465929807Z [2024-04-28T03:45:05.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:44:00+00:00, run_id=scheduled__2024-04-28T03:44:00+00:00, run_start_date=2024-04-28 03:45:01.022189+00:00, run_end_date=2024-04-28 03:45:05.465013+00:00, run_duration=4.442824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:44:00+00:00, data_interval_end=2024-04-28 03:45:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:45:05.488799946Z [2024-04-28T03:45:05.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:45:00+00:00, run_after=2024-04-28T03:46:00+00:00 2024-04-28T03:45:05.552342385Z [2024-04-28T03:45:05.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:44:00+00:00 exited with status success for try_number 1 2024-04-28T03:45:05.552408196Z [2024-04-28T03:45:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:44:00+00:00 exited with status success for try_number 1 2024-04-28T03:45:05.562871750Z [2024-04-28T03:45:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:44:00+00:00, map_index=-1, run_start_date=2024-04-28 03:45:03.038264+00:00, run_end_date=2024-04-28 03:45:04.336880+00:00, run_duration=1.298616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:45:01.092776+00:00, queued_by_job_id=1, pid=10504 2024-04-28T03:45:05.562980853Z [2024-04-28T03:45:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:44:00+00:00, map_index=-1, run_start_date=2024-04-28 03:45:03.386284+00:00, run_end_date=2024-04-28 03:45:05.016084+00:00, run_duration=1.6298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:45:01.092776+00:00, queued_by_job_id=1, pid=10532 2024-04-28T03:45:07.070728092Z [2024-04-28T03:45:07.070+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:45:07.070786926Z 2024-04-28T03:45:07.071287693Z [2024-04-28T03:45:07.070+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:45:07.072443892Z [2024-04-28T03:45:07.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:45:07.072460419Z 2024-04-28T03:45:07.076591858Z [2024-04-28T03:45:07.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:45:07.076860511Z [2024-04-28T03:45:07.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:45:07.137286149Z [2024-04-28T03:45:07.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:45:07.137483945Z [2024-04-28T03:45:07.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:45:07.143589968Z [2024-04-28T03:45:07.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 030cd51b-301d-44bc-833c-a77407f8a39c 2024-04-28T03:45:07.143888030Z [2024-04-28T03:45:07.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=-1, run_start_date=2024-04-28 03:45:06.248095+00:00, run_end_date=2024-04-28 03:45:06.566551+00:00, run_duration=0.318456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:45:04.050295+00:00, queued_by_job_id=1, pid=10556 2024-04-28T03:45:09.137284739Z [2024-04-28T03:45:09.136+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:45:09.137344446Z 2024-04-28T03:45:09.137355245Z [2024-04-28T03:45:09.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:45:09.138120572Z [2024-04-28T03:45:09.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:45:09.138143535Z 2024-04-28T03:45:09.140929809Z [2024-04-28T03:45:09.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:45:09.140975701Z [2024-04-28T03:45:09.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:45:09.201024587Z [2024-04-28T03:45:09.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status queued for try_number 1 2024-04-28T03:45:09.213101012Z [2024-04-28T03:45:09.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to d047c614-05d7-4d0f-b3c5-b407e20b4e61 2024-04-28T03:45:09.302235198Z [2024-04-28T03:45:09.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:45:09.311194788Z [2024-04-28T03:45:09.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=0, run_start_date=2024-04-28 03:45:08.688993+00:00, run_end_date=2024-04-28 03:45:09.087836+00:00, run_duration=0.398843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:45:07.073180+00:00, queued_by_job_id=1, pid=10568 2024-04-28T03:45:11.607723620Z [2024-04-28T03:45:11.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:45:11.607976913Z [2024-04-28T03:45:11.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:40:00+00:00, run_id=scheduled__2024-04-28T03:40:00+00:00, run_start_date=2024-04-28 03:45:01.017587+00:00, run_end_date=2024-04-28 03:45:11.607606+00:00, run_duration=10.590019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:40:00+00:00, data_interval_end=2024-04-28 03:45:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:45:11.614002004Z [2024-04-28T03:45:11.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:45:00+00:00, run_after=2024-04-28T03:50:00+00:00 2024-04-28T03:45:11.645890170Z [2024-04-28T03:45:11.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:40:00+00:00 exited with status success for try_number 1 2024-04-28T03:45:11.650908488Z [2024-04-28T03:45:11.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:40:00+00:00, map_index=-1, run_start_date=2024-04-28 03:45:10.756180+00:00, run_end_date=2024-04-28 03:45:11.086589+00:00, run_duration=0.330409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:45:09.138497+00:00, queued_by_job_id=1, pid=10580 2024-04-28T03:46:00.949011638Z [2024-04-28T03:46:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:46:00+00:00, run_after=2024-04-28T03:47:00+00:00 2024-04-28T03:46:00.960220254Z [2024-04-28T03:46:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:46:00.969464060Z [2024-04-28T03:46:00.968+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:46:01.096489735Z [2024-04-28T03:46:01.095+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:46:01.096534490Z 2024-04-28T03:46:01.096545269Z 2024-04-28T03:46:01.096554195Z 2024-04-28T03:46:01.096614367Z [2024-04-28T03:46:01.096+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:46:01.096953328Z [2024-04-28T03:46:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:46:01.097138557Z [2024-04-28T03:46:01.096+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:46:01.098455517Z [2024-04-28T03:46:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:46:01.098484424Z 2024-04-28T03:46:01.098494604Z 2024-04-28T03:46:01.098503164Z 2024-04-28T03:46:01.107161763Z [2024-04-28T03:46:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:46:01.107844263Z [2024-04-28T03:46:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:46:01.108916434Z [2024-04-28T03:46:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:46:01.109446772Z [2024-04-28T03:46:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:46:01.110833065Z [2024-04-28T03:46:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:46:01.111339931Z [2024-04-28T03:46:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:46:01.349636106Z [2024-04-28T03:46:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:44:00+00:00 exited with status queued for try_number 1 2024-04-28T03:46:01.349687287Z [2024-04-28T03:46:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status queued for try_number 1 2024-04-28T03:46:01.349784947Z [2024-04-28T03:46:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status queued for try_number 1 2024-04-28T03:46:01.361188115Z [2024-04-28T03:46:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a099b53-a2ff-4428-a6af-7a1d916f759d 2024-04-28T03:46:01.361218734Z [2024-04-28T03:46:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88548d64-b59d-4ce4-b4b2-c817a13d5cf5 2024-04-28T03:46:01.361305291Z [2024-04-28T03:46:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to db9aea16-7197-4423-ab28-6b6250219ae7 2024-04-28T03:46:02.537112123Z [2024-04-28T03:46:02.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:46:02.537501626Z [2024-04-28T03:46:02.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:44:00+00:00, run_id=scheduled__2024-04-28T03:44:00+00:00, run_start_date=2024-04-28 03:46:00.983906+00:00, run_end_date=2024-04-28 03:46:02.536974+00:00, run_duration=1.553068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:44:00+00:00, data_interval_end=2024-04-28 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:46:02.546949682Z [2024-04-28T03:46:02.546+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:46:00+00:00, run_after=2024-04-28T03:48:00+00:00 2024-04-28T03:46:02.604898073Z [2024-04-28T03:46:02.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:44:00+00:00 exited with status success for try_number 1 2024-04-28T03:46:02.611580473Z [2024-04-28T03:46:02.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:44:00+00:00, map_index=-1, run_start_date=2024-04-28 03:46:01.848495+00:00, run_end_date=2024-04-28 03:46:02.269251+00:00, run_duration=0.420756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:46:01.101352+00:00, queued_by_job_id=1, pid=10595 2024-04-28T03:46:06.147694111Z [2024-04-28T03:46:06.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:46:06.148115611Z [2024-04-28T03:46:06.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:45:00+00:00, run_id=scheduled__2024-04-28T03:45:00+00:00, run_start_date=2024-04-28 03:46:00.988523+00:00, run_end_date=2024-04-28 03:46:06.147611+00:00, run_duration=5.159088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:45:00+00:00, data_interval_end=2024-04-28 03:46:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:46:06.159676699Z [2024-04-28T03:46:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:46:00+00:00, run_after=2024-04-28T03:47:00+00:00 2024-04-28T03:46:06.166652556Z [2024-04-28T03:46:06.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:46:06.166945191Z [2024-04-28T03:46:06.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:45:00+00:00, run_id=scheduled__2024-04-28T03:45:00+00:00, run_start_date=2024-04-28 03:46:00.986056+00:00, run_end_date=2024-04-28 03:46:06.166517+00:00, run_duration=5.180461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:45:00+00:00, data_interval_end=2024-04-28 03:46:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:46:06.178915366Z [2024-04-28T03:46:06.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:46:00+00:00, run_after=2024-04-28T03:47:00+00:00 2024-04-28T03:46:06.206498139Z [2024-04-28T03:46:06.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status success for try_number 1 2024-04-28T03:46:06.206591318Z [2024-04-28T03:46:06.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status success for try_number 1 2024-04-28T03:46:06.220076214Z [2024-04-28T03:46:06.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:45:00+00:00, map_index=-1, run_start_date=2024-04-28 03:46:03.167588+00:00, run_end_date=2024-04-28 03:46:05.013709+00:00, run_duration=1.846121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:46:01.101352+00:00, queued_by_job_id=1, pid=10625 2024-04-28T03:46:06.220404349Z [2024-04-28T03:46:06.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:45:00+00:00, map_index=-1, run_start_date=2024-04-28 03:46:03.254694+00:00, run_end_date=2024-04-28 03:46:05.001114+00:00, run_duration=1.74642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:46:01.101352+00:00, queued_by_job_id=1, pid=10626 2024-04-28T03:46:17.300532071Z [2024-04-28T03:46:17.299+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:47:00.733340274Z [2024-04-28T03:47:00.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:47:00.751912599Z [2024-04-28T03:47:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:47:00+00:00, run_after=2024-04-28T03:48:00+00:00 2024-04-28T03:47:00.815076579Z [2024-04-28T03:47:00.814+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:47:00.815105684Z 2024-04-28T03:47:00.815111449Z 2024-04-28T03:47:00.815485135Z [2024-04-28T03:47:00.814+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:47:00.815714849Z [2024-04-28T03:47:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:47:00.816409208Z [2024-04-28T03:47:00.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:47:00.816432178Z 2024-04-28T03:47:00.816439123Z 2024-04-28T03:47:00.820973889Z [2024-04-28T03:47:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:47:00.821064735Z [2024-04-28T03:47:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:47:00.821414783Z [2024-04-28T03:47:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:47:00.821476564Z [2024-04-28T03:47:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:47:00.976866399Z [2024-04-28T03:47:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:46:00+00:00 exited with status queued for try_number 1 2024-04-28T03:47:00.976929932Z [2024-04-28T03:47:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:46:00+00:00 exited with status queued for try_number 1 2024-04-28T03:47:00.983275711Z [2024-04-28T03:47:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 218aee74-cfde-446f-9066-b6e9bc4e0d35 2024-04-28T03:47:00.983438416Z [2024-04-28T03:47:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c6b6485-8d3c-4c0c-bf04-d67ef536090a 2024-04-28T03:47:04.321280092Z [2024-04-28T03:47:04.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:47:04.321702991Z [2024-04-28T03:47:04.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:46:00+00:00, run_id=scheduled__2024-04-28T03:46:00+00:00, run_start_date=2024-04-28 03:47:00.763719+00:00, run_end_date=2024-04-28 03:47:04.321189+00:00, run_duration=3.55747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:46:00+00:00, data_interval_end=2024-04-28 03:47:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:47:04.332285743Z [2024-04-28T03:47:04.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:47:00+00:00, run_after=2024-04-28T03:48:00+00:00 2024-04-28T03:47:04.339466403Z [2024-04-28T03:47:04.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:47:04.339716916Z [2024-04-28T03:47:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:46:00+00:00, run_id=scheduled__2024-04-28T03:46:00+00:00, run_start_date=2024-04-28 03:47:00.762515+00:00, run_end_date=2024-04-28 03:47:04.339395+00:00, run_duration=3.57688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:46:00+00:00, data_interval_end=2024-04-28 03:47:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:47:04.350088766Z [2024-04-28T03:47:04.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:47:00+00:00, run_after=2024-04-28T03:48:00+00:00 2024-04-28T03:47:04.410847454Z [2024-04-28T03:47:04.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:46:00+00:00 exited with status success for try_number 1 2024-04-28T03:47:04.410894883Z [2024-04-28T03:47:04.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:46:00+00:00 exited with status success for try_number 1 2024-04-28T03:47:04.419628687Z [2024-04-28T03:47:04.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:46:00+00:00, map_index=-1, run_start_date=2024-04-28 03:47:02.536042+00:00, run_end_date=2024-04-28 03:47:04.150922+00:00, run_duration=1.61488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:47:00.817026+00:00, queued_by_job_id=1, pid=10680 2024-04-28T03:47:04.419905736Z [2024-04-28T03:47:04.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:46:00+00:00, map_index=-1, run_start_date=2024-04-28 03:47:02.589871+00:00, run_end_date=2024-04-28 03:47:04.168014+00:00, run_duration=1.578143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:47:00.817026+00:00, queued_by_job_id=1, pid=10681 2024-04-28T03:48:00.279103534Z [2024-04-28T03:48:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:48:00+00:00, run_after=2024-04-28T03:49:00+00:00 2024-04-28T03:48:00.286121821Z [2024-04-28T03:48:00.285+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:48:00.292917641Z [2024-04-28T03:48:00.292+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:48:00.353275226Z [2024-04-28T03:48:00.352+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:48:00.353320689Z 2024-04-28T03:48:00.353331235Z 2024-04-28T03:48:00.353340454Z 2024-04-28T03:48:00.353365808Z [2024-04-28T03:48:00.353+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:48:00.353503863Z [2024-04-28T03:48:00.353+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:48:00.353604017Z [2024-04-28T03:48:00.353+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:48:00.354306466Z [2024-04-28T03:48:00.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:48:00.354325798Z 2024-04-28T03:48:00.354335368Z 2024-04-28T03:48:00.354343973Z 2024-04-28T03:48:00.358483285Z [2024-04-28T03:48:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:48:00.358620212Z [2024-04-28T03:48:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:48:00.358924518Z [2024-04-28T03:48:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:48:00.359075630Z [2024-04-28T03:48:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:48:00.359310226Z [2024-04-28T03:48:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:48:00.359481955Z [2024-04-28T03:48:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:48:00.653508412Z [2024-04-28T03:48:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:46:00+00:00 exited with status queued for try_number 1 2024-04-28T03:48:00.653538721Z [2024-04-28T03:48:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:47:00+00:00 exited with status queued for try_number 1 2024-04-28T03:48:00.653597065Z [2024-04-28T03:48:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:47:00+00:00 exited with status queued for try_number 1 2024-04-28T03:48:00.663695255Z [2024-04-28T03:48:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 001cf442-3342-4854-8618-775ed66ad193 2024-04-28T03:48:00.663725569Z [2024-04-28T03:48:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 803d66ce-c1fa-4a25-80ab-ed22df0bf322 2024-04-28T03:48:00.663850562Z [2024-04-28T03:48:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c4e5a08-7a86-49c8-92ec-c8caa886512b 2024-04-28T03:48:01.811153038Z [2024-04-28T03:48:01.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:48:01.811964185Z [2024-04-28T03:48:01.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:46:00+00:00, run_id=scheduled__2024-04-28T03:46:00+00:00, run_start_date=2024-04-28 03:48:00.302761+00:00, run_end_date=2024-04-28 03:48:01.810997+00:00, run_duration=1.508236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:46:00+00:00, data_interval_end=2024-04-28 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:48:01.821335396Z [2024-04-28T03:48:01.818+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:48:00+00:00, run_after=2024-04-28T03:50:00+00:00 2024-04-28T03:48:01.893143388Z [2024-04-28T03:48:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:46:00+00:00 exited with status success for try_number 1 2024-04-28T03:48:01.898999865Z [2024-04-28T03:48:01.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:46:00+00:00, map_index=-1, run_start_date=2024-04-28 03:48:01.114863+00:00, run_end_date=2024-04-28 03:48:01.498411+00:00, run_duration=0.383548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:48:00.354985+00:00, queued_by_job_id=1, pid=10706 2024-04-28T03:48:04.026624444Z [2024-04-28T03:48:04.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:48:04.027266401Z [2024-04-28T03:48:04.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:47:00+00:00, run_id=scheduled__2024-04-28T03:47:00+00:00, run_start_date=2024-04-28 03:48:00.304075+00:00, run_end_date=2024-04-28 03:48:04.026434+00:00, run_duration=3.722359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:47:00+00:00, data_interval_end=2024-04-28 03:48:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:48:04.040070689Z [2024-04-28T03:48:04.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:48:00+00:00, run_after=2024-04-28T03:49:00+00:00 2024-04-28T03:48:04.094891673Z [2024-04-28T03:48:04.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:47:00+00:00 exited with status success for try_number 1 2024-04-28T03:48:04.105777090Z [2024-04-28T03:48:04.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:47:00+00:00, map_index=-1, run_start_date=2024-04-28 03:48:02.339830+00:00, run_end_date=2024-04-28 03:48:03.807229+00:00, run_duration=1.467399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:48:00.354985+00:00, queued_by_job_id=1, pid=10746 2024-04-28T03:48:05.190316255Z [2024-04-28T03:48:05.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:48:05.190627186Z [2024-04-28T03:48:05.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:47:00+00:00, run_id=scheduled__2024-04-28T03:47:00+00:00, run_start_date=2024-04-28 03:48:00.305259+00:00, run_end_date=2024-04-28 03:48:05.190219+00:00, run_duration=4.88496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:47:00+00:00, data_interval_end=2024-04-28 03:48:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:48:05.206702068Z [2024-04-28T03:48:05.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:48:00+00:00, run_after=2024-04-28T03:49:00+00:00 2024-04-28T03:48:05.256778611Z [2024-04-28T03:48:05.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:47:00+00:00 exited with status success for try_number 1 2024-04-28T03:48:05.272208244Z [2024-04-28T03:48:05.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:47:00+00:00, map_index=-1, run_start_date=2024-04-28 03:48:02.469824+00:00, run_end_date=2024-04-28 03:48:04.178416+00:00, run_duration=1.708592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:48:00.354985+00:00, queued_by_job_id=1, pid=10747 2024-04-28T03:49:00.693241316Z [2024-04-28T03:49:00.692+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:49:00.714825550Z [2024-04-28T03:49:00.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:49:00+00:00, run_after=2024-04-28T03:50:00+00:00 2024-04-28T03:49:00.791925307Z [2024-04-28T03:49:00.791+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:49:00.791982604Z 2024-04-28T03:49:00.791992453Z 2024-04-28T03:49:00.792351685Z [2024-04-28T03:49:00.791+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:49:00.792740446Z [2024-04-28T03:49:00.792+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:49:00.794947840Z [2024-04-28T03:49:00.794+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:49:00.794975740Z 2024-04-28T03:49:00.794984352Z 2024-04-28T03:49:00.801018789Z [2024-04-28T03:49:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:49:00.801532242Z [2024-04-28T03:49:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:49:00.802130285Z [2024-04-28T03:49:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:49:00.802472352Z [2024-04-28T03:49:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:49:00.989638220Z [2024-04-28T03:49:00.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:48:00+00:00 exited with status queued for try_number 1 2024-04-28T03:49:00.990311923Z [2024-04-28T03:49:00.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:48:00+00:00 exited with status queued for try_number 1 2024-04-28T03:49:01.000220836Z [2024-04-28T03:49:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51abae25-4d9b-47a4-8626-18bbf0b36892 2024-04-28T03:49:01.002444521Z [2024-04-28T03:49:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to af8ae38b-85b3-4e1d-86d6-d641653bb103 2024-04-28T03:49:04.920959402Z [2024-04-28T03:49:04.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:49:04.921873673Z [2024-04-28T03:49:04.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:48:00+00:00, run_id=scheduled__2024-04-28T03:48:00+00:00, run_start_date=2024-04-28 03:49:00.729421+00:00, run_end_date=2024-04-28 03:49:04.921435+00:00, run_duration=4.192014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:48:00+00:00, data_interval_end=2024-04-28 03:49:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:49:04.934772192Z [2024-04-28T03:49:04.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:49:00+00:00, run_after=2024-04-28T03:50:00+00:00 2024-04-28T03:49:04.951055376Z [2024-04-28T03:49:04.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:49:04.951078612Z [2024-04-28T03:49:04.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:48:00+00:00, run_id=scheduled__2024-04-28T03:48:00+00:00, run_start_date=2024-04-28 03:49:00.727138+00:00, run_end_date=2024-04-28 03:49:04.947378+00:00, run_duration=4.22024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:48:00+00:00, data_interval_end=2024-04-28 03:49:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:49:04.967183431Z [2024-04-28T03:49:04.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:49:00+00:00, run_after=2024-04-28T03:50:00+00:00 2024-04-28T03:49:05.029317126Z [2024-04-28T03:49:05.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:48:00+00:00 exited with status success for try_number 1 2024-04-28T03:49:05.029554565Z [2024-04-28T03:49:05.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:48:00+00:00 exited with status success for try_number 1 2024-04-28T03:49:05.048415486Z [2024-04-28T03:49:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:48:00+00:00, map_index=-1, run_start_date=2024-04-28 03:49:02.803384+00:00, run_end_date=2024-04-28 03:49:04.510527+00:00, run_duration=1.707143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:49:00.796349+00:00, queued_by_job_id=1, pid=10801 2024-04-28T03:49:05.048895153Z [2024-04-28T03:49:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:48:00+00:00, map_index=-1, run_start_date=2024-04-28 03:49:02.563222+00:00, run_end_date=2024-04-28 03:49:03.959293+00:00, run_duration=1.396071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:49:00.796349+00:00, queued_by_job_id=1, pid=10800 2024-04-28T03:50:00.047208687Z [2024-04-28T03:50:00.046+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:50:00.064047586Z [2024-04-28T03:50:00.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:50:00.088142744Z [2024-04-28T03:50:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:50:00+00:00, run_after=2024-04-28T03:55:00+00:00 2024-04-28T03:50:00.113914552Z [2024-04-28T03:50:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:50:00+00:00, run_after=2024-04-28T03:51:00+00:00 2024-04-28T03:50:00.231163086Z [2024-04-28T03:50:00.230+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-28T03:50:00.231193333Z 2024-04-28T03:50:00.231198830Z 2024-04-28T03:50:00.231206223Z 2024-04-28T03:50:00.231211020Z 2024-04-28T03:50:00.231286810Z [2024-04-28T03:50:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:50:00.231383662Z [2024-04-28T03:50:00.231+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:50:00.231575060Z [2024-04-28T03:50:00.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:50:00.231700738Z [2024-04-28T03:50:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:50:00.232369566Z [2024-04-28T03:50:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:50:00.232383591Z 2024-04-28T03:50:00.232388723Z 2024-04-28T03:50:00.232393574Z 2024-04-28T03:50:00.232398295Z 2024-04-28T03:50:00.236464256Z [2024-04-28T03:50:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:50:00.236607350Z [2024-04-28T03:50:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:50:00.236924344Z [2024-04-28T03:50:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:50:00.237042618Z [2024-04-28T03:50:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:50:00.237449827Z [2024-04-28T03:50:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:50:00.237606643Z [2024-04-28T03:50:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:50:00.237801881Z [2024-04-28T03:50:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:50:00.237876872Z [2024-04-28T03:50:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:50:00.797573620Z [2024-04-28T03:50:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:00.797928122Z [2024-04-28T03:50:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:48:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:00.798196856Z [2024-04-28T03:50:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:49:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:00.798431957Z [2024-04-28T03:50:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:49:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:00.817050589Z [2024-04-28T03:50:00.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54450d44-b814-4aab-8119-f318d0e8a346 2024-04-28T03:50:00.817436336Z [2024-04-28T03:50:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef6b9ab1-cf65-456b-a28d-1d60064f7eb0 2024-04-28T03:50:00.817693319Z [2024-04-28T03:50:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 580c5cca-36f9-49db-91b9-12c742660c05 2024-04-28T03:50:00.817925947Z [2024-04-28T03:50:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87b38078-b19f-4cb7-a7c6-878c55a2ae40 2024-04-28T03:50:02.061810833Z [2024-04-28T03:50:02.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:50:02.061838143Z [2024-04-28T03:50:02.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:48:00+00:00, run_id=scheduled__2024-04-28T03:48:00+00:00, run_start_date=2024-04-28 03:50:00.133788+00:00, run_end_date=2024-04-28 03:50:02.059792+00:00, run_duration=1.926004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:48:00+00:00, data_interval_end=2024-04-28 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:50:02.081347924Z [2024-04-28T03:50:02.081+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:50:00+00:00, run_after=2024-04-28T03:52:00+00:00 2024-04-28T03:50:02.170703036Z [2024-04-28T03:50:02.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:48:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:02.178807916Z [2024-04-28T03:50:02.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:48:00+00:00, map_index=-1, run_start_date=2024-04-28 03:50:01.269427+00:00, run_end_date=2024-04-28 03:50:01.712568+00:00, run_duration=0.443141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:00.233205+00:00, queued_by_job_id=1, pid=10827 2024-04-28T03:50:03.584694957Z [2024-04-28T03:50:03.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:50:03.584764669Z 2024-04-28T03:50:03.584774897Z [2024-04-28T03:50:03.584+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:50:03.585508012Z [2024-04-28T03:50:03.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:50:03.585519563Z 2024-04-28T03:50:03.589075009Z [2024-04-28T03:50:03.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:50:03.589223491Z [2024-04-28T03:50:03.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:50:03.647989795Z [2024-04-28T03:50:03.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:03.648089047Z [2024-04-28T03:50:03.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:03.654162790Z [2024-04-28T03:50:03.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d746967-9704-4cad-8533-f1c9fd34d543 2024-04-28T03:50:03.654469967Z [2024-04-28T03:50:03.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:45:00+00:00, map_index=-1, run_start_date=2024-04-28 03:50:02.729226+00:00, run_end_date=2024-04-28 03:50:03.214787+00:00, run_duration=0.485561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:00.233205+00:00, queued_by_job_id=1, pid=10878 2024-04-28T03:50:04.809529951Z [2024-04-28T03:50:04.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:50:04.809772184Z [2024-04-28T03:50:04.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:49:00+00:00, run_id=scheduled__2024-04-28T03:49:00+00:00, run_start_date=2024-04-28 03:50:00.136325+00:00, run_end_date=2024-04-28 03:50:04.809442+00:00, run_duration=4.673117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:49:00+00:00, data_interval_end=2024-04-28 03:50:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:50:04.828213447Z [2024-04-28T03:50:04.827+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:50:00+00:00, run_after=2024-04-28T03:51:00+00:00 2024-04-28T03:50:04.841283597Z [2024-04-28T03:50:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:50:04.841668109Z [2024-04-28T03:50:04.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:49:00+00:00, run_id=scheduled__2024-04-28T03:49:00+00:00, run_start_date=2024-04-28 03:50:00.135040+00:00, run_end_date=2024-04-28 03:50:04.841194+00:00, run_duration=4.706154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:49:00+00:00, data_interval_end=2024-04-28 03:50:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:50:04.860461059Z [2024-04-28T03:50:04.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:50:00+00:00, run_after=2024-04-28T03:51:00+00:00 2024-04-28T03:50:04.977388429Z [2024-04-28T03:50:04.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:49:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:04.977423104Z [2024-04-28T03:50:04.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:49:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:04.987296001Z [2024-04-28T03:50:04.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:49:00+00:00, map_index=-1, run_start_date=2024-04-28 03:50:02.792710+00:00, run_end_date=2024-04-28 03:50:04.331767+00:00, run_duration=1.539057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:00.233205+00:00, queued_by_job_id=1, pid=10888 2024-04-28T03:50:04.987321914Z [2024-04-28T03:50:04.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:49:00+00:00, map_index=-1, run_start_date=2024-04-28 03:50:02.347735+00:00, run_end_date=2024-04-28 03:50:04.342625+00:00, run_duration=1.99489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:00.233205+00:00, queued_by_job_id=1, pid=10859 2024-04-28T03:50:07.183602624Z [2024-04-28T03:50:07.182+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:50:07.183637839Z 2024-04-28T03:50:07.183995148Z [2024-04-28T03:50:07.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:50:07.185188572Z [2024-04-28T03:50:07.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:50:07.185232220Z 2024-04-28T03:50:07.189044919Z [2024-04-28T03:50:07.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:50:07.189523699Z [2024-04-28T03:50:07.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:50:07.255631535Z [2024-04-28T03:50:07.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:07.255731389Z [2024-04-28T03:50:07.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:07.267120451Z [2024-04-28T03:50:07.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43c5574f-25af-45cb-b358-a6ec61a0af99 2024-04-28T03:50:07.267555382Z [2024-04-28T03:50:07.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:45:00+00:00, map_index=-1, run_start_date=2024-04-28 03:50:05.866674+00:00, run_end_date=2024-04-28 03:50:06.296332+00:00, run_duration=0.429658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:03.585928+00:00, queued_by_job_id=1, pid=10921 2024-04-28T03:50:10.161463688Z [2024-04-28T03:50:10.160+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:50:10.161492213Z 2024-04-28T03:50:10.162274307Z [2024-04-28T03:50:10.161+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:50:10.164874438Z [2024-04-28T03:50:10.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:50:10.164889427Z 2024-04-28T03:50:10.170259962Z [2024-04-28T03:50:10.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:50:10.170814425Z [2024-04-28T03:50:10.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:50:10.247401125Z [2024-04-28T03:50:10.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status queued for try_number 1 2024-04-28T03:50:10.247597107Z [2024-04-28T03:50:10.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:10.253368513Z [2024-04-28T03:50:10.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03e4daf4-3aba-4754-b1e9-babd1888923c 2024-04-28T03:50:10.253612729Z [2024-04-28T03:50:10.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:45:00+00:00, map_index=0, run_start_date=2024-04-28 03:50:08.855470+00:00, run_end_date=2024-04-28 03:50:09.262356+00:00, run_duration=0.406886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:07.185845+00:00, queued_by_job_id=1, pid=10933 2024-04-28T03:50:12.657448258Z [2024-04-28T03:50:12.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:50:12.658023303Z [2024-04-28T03:50:12.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:45:00+00:00, run_id=scheduled__2024-04-28T03:45:00+00:00, run_start_date=2024-04-28 03:50:00.132393+00:00, run_end_date=2024-04-28 03:50:12.657318+00:00, run_duration=12.524925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:45:00+00:00, data_interval_end=2024-04-28 03:50:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:50:12.667722714Z [2024-04-28T03:50:12.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:50:00+00:00, run_after=2024-04-28T03:55:00+00:00 2024-04-28T03:50:12.722344632Z [2024-04-28T03:50:12.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:45:00+00:00 exited with status success for try_number 1 2024-04-28T03:50:12.731591129Z [2024-04-28T03:50:12.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:45:00+00:00, map_index=-1, run_start_date=2024-04-28 03:50:11.760136+00:00, run_end_date=2024-04-28 03:50:12.079607+00:00, run_duration=0.319471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:50:10.166051+00:00, queued_by_job_id=1, pid=10945 2024-04-28T03:51:00.484932914Z [2024-04-28T03:51:00.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:51:00+00:00, run_after=2024-04-28T03:52:00+00:00 2024-04-28T03:51:00.496196358Z [2024-04-28T03:51:00.495+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:51:00.565478292Z [2024-04-28T03:51:00.565+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:51:00.565503921Z 2024-04-28T03:51:00.565508261Z 2024-04-28T03:51:00.565611195Z [2024-04-28T03:51:00.565+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:51:00.565859488Z [2024-04-28T03:51:00.565+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:51:00.566656288Z [2024-04-28T03:51:00.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:51:00.566664455Z 2024-04-28T03:51:00.566667837Z 2024-04-28T03:51:00.569489598Z [2024-04-28T03:51:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:51:00.569805049Z [2024-04-28T03:51:00.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:51:00.569987705Z [2024-04-28T03:51:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:51:00.570220336Z [2024-04-28T03:51:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:51:00.746450010Z [2024-04-28T03:51:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:51:00.746854847Z [2024-04-28T03:51:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:51:00.758004338Z [2024-04-28T03:51:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdce652f-c9cc-4953-9f87-787377322a84 2024-04-28T03:51:00.758647280Z [2024-04-28T03:51:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8af0c6e9-972d-485b-802c-48678024429a 2024-04-28T03:51:04.627070604Z [2024-04-28T03:51:04.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:51:04.627663498Z [2024-04-28T03:51:04.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:50:00+00:00, run_id=scheduled__2024-04-28T03:50:00+00:00, run_start_date=2024-04-28 03:51:00.514276+00:00, run_end_date=2024-04-28 03:51:04.627199+00:00, run_duration=4.112923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:50:00+00:00, data_interval_end=2024-04-28 03:51:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:51:04.637311762Z [2024-04-28T03:51:04.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:51:00+00:00, run_after=2024-04-28T03:52:00+00:00 2024-04-28T03:51:04.643668250Z [2024-04-28T03:51:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:51:04.644354191Z [2024-04-28T03:51:04.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:50:00+00:00, run_id=scheduled__2024-04-28T03:50:00+00:00, run_start_date=2024-04-28 03:51:00.517138+00:00, run_end_date=2024-04-28 03:51:04.644010+00:00, run_duration=4.126872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:50:00+00:00, data_interval_end=2024-04-28 03:51:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:51:04.653724604Z [2024-04-28T03:51:04.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:51:00+00:00, run_after=2024-04-28T03:52:00+00:00 2024-04-28T03:51:04.711283528Z [2024-04-28T03:51:04.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:51:04.711759156Z [2024-04-28T03:51:04.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:51:04.724637752Z [2024-04-28T03:51:04.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=-1, run_start_date=2024-04-28 03:51:02.342943+00:00, run_end_date=2024-04-28 03:51:04.018700+00:00, run_duration=1.675757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:51:00.567181+00:00, queued_by_job_id=1, pid=10969 2024-04-28T03:51:04.725139846Z [2024-04-28T03:51:04.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=-1, run_start_date=2024-04-28 03:51:02.654433+00:00, run_end_date=2024-04-28 03:51:04.174693+00:00, run_duration=1.52026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:51:00.567181+00:00, queued_by_job_id=1, pid=10988 2024-04-28T03:51:17.367543453Z [2024-04-28T03:51:17.367+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:52:00.854905247Z [2024-04-28T03:52:00.854+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:52:00.885329890Z [2024-04-28T03:52:00.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:52:00+00:00, run_after=2024-04-28T03:53:00+00:00 2024-04-28T03:52:00.899069658Z [2024-04-28T03:52:00.898+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:52:00.990321425Z [2024-04-28T03:52:00.989+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:52:00.990343452Z 2024-04-28T03:52:00.990348587Z 2024-04-28T03:52:00.990352675Z 2024-04-28T03:52:00.991148625Z [2024-04-28T03:52:00.990+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:52:00.991551561Z [2024-04-28T03:52:00.991+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:52:00.991930056Z [2024-04-28T03:52:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:52:00.993036162Z [2024-04-28T03:52:00.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:52:00.993063423Z 2024-04-28T03:52:00.993070631Z 2024-04-28T03:52:00.993075471Z 2024-04-28T03:52:00.999181435Z [2024-04-28T03:52:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:52:01.000018010Z [2024-04-28T03:52:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:52:01.001503312Z [2024-04-28T03:52:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:52:01.003284769Z [2024-04-28T03:52:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:52:01.003696652Z [2024-04-28T03:52:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:52:01.003977484Z [2024-04-28T03:52:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:52:01.375518140Z [2024-04-28T03:52:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:52:01.375893094Z [2024-04-28T03:52:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:51:00+00:00 exited with status queued for try_number 1 2024-04-28T03:52:01.376099222Z [2024-04-28T03:52:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:51:00+00:00 exited with status queued for try_number 1 2024-04-28T03:52:01.395266921Z [2024-04-28T03:52:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f3a60b8-6967-45eb-adf4-5ae00cfaebca 2024-04-28T03:52:01.395459941Z [2024-04-28T03:52:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43b7c104-634f-4f88-8591-ff865fa60d6a 2024-04-28T03:52:01.395630185Z [2024-04-28T03:52:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d33745e-d7b1-4b1f-801b-83aa18662643 2024-04-28T03:52:02.575053194Z [2024-04-28T03:52:02.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:52:02.575759380Z [2024-04-28T03:52:02.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:50:00+00:00, run_id=scheduled__2024-04-28T03:50:00+00:00, run_start_date=2024-04-28 03:52:00.911956+00:00, run_end_date=2024-04-28 03:52:02.575004+00:00, run_duration=1.663048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:50:00+00:00, data_interval_end=2024-04-28 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:52:02.593221463Z [2024-04-28T03:52:02.592+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:52:00+00:00, run_after=2024-04-28T03:54:00+00:00 2024-04-28T03:52:02.707435545Z [2024-04-28T03:52:02.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:52:02.713751172Z [2024-04-28T03:52:02.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=-1, run_start_date=2024-04-28 03:52:01.954589+00:00, run_end_date=2024-04-28 03:52:02.345127+00:00, run_duration=0.390538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:52:00.994629+00:00, queued_by_job_id=1, pid=11014 2024-04-28T03:52:05.535835068Z [2024-04-28T03:52:05.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:52:05.536073883Z [2024-04-28T03:52:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:51:00+00:00, run_id=scheduled__2024-04-28T03:51:00+00:00, run_start_date=2024-04-28 03:52:00.915040+00:00, run_end_date=2024-04-28 03:52:05.535769+00:00, run_duration=4.620729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:51:00+00:00, data_interval_end=2024-04-28 03:52:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:52:05.564606130Z [2024-04-28T03:52:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:52:00+00:00, run_after=2024-04-28T03:53:00+00:00 2024-04-28T03:52:05.583457041Z [2024-04-28T03:52:05.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:52:05.583771122Z [2024-04-28T03:52:05.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:51:00+00:00, run_id=scheduled__2024-04-28T03:51:00+00:00, run_start_date=2024-04-28 03:52:00.913600+00:00, run_end_date=2024-04-28 03:52:05.583493+00:00, run_duration=4.669893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:51:00+00:00, data_interval_end=2024-04-28 03:52:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:52:05.634449911Z [2024-04-28T03:52:05.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:52:00+00:00, run_after=2024-04-28T03:53:00+00:00 2024-04-28T03:52:05.741063364Z [2024-04-28T03:52:05.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:51:00+00:00 exited with status success for try_number 1 2024-04-28T03:52:05.741087623Z [2024-04-28T03:52:05.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:51:00+00:00 exited with status success for try_number 1 2024-04-28T03:52:05.751184487Z [2024-04-28T03:52:05.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:51:00+00:00, map_index=-1, run_start_date=2024-04-28 03:52:03.081144+00:00, run_end_date=2024-04-28 03:52:05.384177+00:00, run_duration=2.303033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:52:00.994629+00:00, queued_by_job_id=1, pid=11044 2024-04-28T03:52:05.751394006Z [2024-04-28T03:52:05.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:51:00+00:00, map_index=-1, run_start_date=2024-04-28 03:52:03.168457+00:00, run_end_date=2024-04-28 03:52:04.767279+00:00, run_duration=1.598822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:52:00.994629+00:00, queued_by_job_id=1, pid=11045 2024-04-28T03:53:00.175483298Z [2024-04-28T03:53:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:53:00.189524383Z [2024-04-28T03:53:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:53:00+00:00, run_after=2024-04-28T03:54:00+00:00 2024-04-28T03:53:00.243634715Z [2024-04-28T03:53:00.243+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:53:00.243692720Z 2024-04-28T03:53:00.243712184Z 2024-04-28T03:53:00.243765009Z [2024-04-28T03:53:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:53:00.243865138Z [2024-04-28T03:53:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:53:00.244914125Z [2024-04-28T03:53:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:53:00.244920580Z 2024-04-28T03:53:00.244923791Z 2024-04-28T03:53:00.248861773Z [2024-04-28T03:53:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:53:00.248979777Z [2024-04-28T03:53:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:53:00.249448496Z [2024-04-28T03:53:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:53:00.249532338Z [2024-04-28T03:53:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:53:00.491105891Z [2024-04-28T03:53:00.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:52:00+00:00 exited with status queued for try_number 1 2024-04-28T03:53:00.491510707Z [2024-04-28T03:53:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:52:00+00:00 exited with status queued for try_number 1 2024-04-28T03:53:00.501014688Z [2024-04-28T03:53:00.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9afdf4d9-1c65-4569-a5be-c63391e0f152 2024-04-28T03:53:00.501336539Z [2024-04-28T03:53:00.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24952f07-eca8-4eac-9574-d2562f9d6abc 2024-04-28T03:53:03.855740189Z [2024-04-28T03:53:03.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:53:03.856979336Z [2024-04-28T03:53:03.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:52:00+00:00, run_id=scheduled__2024-04-28T03:52:00+00:00, run_start_date=2024-04-28 03:53:00.200623+00:00, run_end_date=2024-04-28 03:53:03.855633+00:00, run_duration=3.65501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:52:00+00:00, data_interval_end=2024-04-28 03:53:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:53:03.870762038Z [2024-04-28T03:53:03.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:53:00+00:00, run_after=2024-04-28T03:54:00+00:00 2024-04-28T03:53:03.901933977Z [2024-04-28T03:53:03.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:52:00+00:00 exited with status success for try_number 1 2024-04-28T03:53:03.911671796Z [2024-04-28T03:53:03.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:52:00+00:00, map_index=-1, run_start_date=2024-04-28 03:53:02.196390+00:00, run_end_date=2024-04-28 03:53:03.392622+00:00, run_duration=1.196232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:53:00.245852+00:00, queued_by_job_id=1, pid=11099 2024-04-28T03:53:04.970071310Z [2024-04-28T03:53:04.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:53:04.975003963Z [2024-04-28T03:53:04.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:52:00+00:00, run_id=scheduled__2024-04-28T03:52:00+00:00, run_start_date=2024-04-28 03:53:00.202057+00:00, run_end_date=2024-04-28 03:53:04.970267+00:00, run_duration=4.76821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:52:00+00:00, data_interval_end=2024-04-28 03:53:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:53:04.990239353Z [2024-04-28T03:53:04.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:53:00+00:00, run_after=2024-04-28T03:54:00+00:00 2024-04-28T03:53:05.036452672Z [2024-04-28T03:53:05.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:52:00+00:00 exited with status success for try_number 1 2024-04-28T03:53:05.063483302Z [2024-04-28T03:53:05.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:52:00+00:00, map_index=-1, run_start_date=2024-04-28 03:53:02.210228+00:00, run_end_date=2024-04-28 03:53:03.785207+00:00, run_duration=1.574979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:53:00.245852+00:00, queued_by_job_id=1, pid=11100 2024-04-28T03:54:00.823289953Z [2024-04-28T03:54:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:54:00+00:00, run_after=2024-04-28T03:55:00+00:00 2024-04-28T03:54:00.838943456Z [2024-04-28T03:54:00.838+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:54:00.849920006Z [2024-04-28T03:54:00.849+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:54:00.932775212Z [2024-04-28T03:54:00.932+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:54:00.932807807Z 2024-04-28T03:54:00.932817964Z 2024-04-28T03:54:00.932822988Z 2024-04-28T03:54:00.933446663Z [2024-04-28T03:54:00.933+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:54:00.933640017Z [2024-04-28T03:54:00.933+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:54:00.933908864Z [2024-04-28T03:54:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:54:00.935107523Z [2024-04-28T03:54:00.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:54:00.935130791Z 2024-04-28T03:54:00.935163626Z 2024-04-28T03:54:00.935170492Z 2024-04-28T03:54:00.941069206Z [2024-04-28T03:54:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:54:00.941431700Z [2024-04-28T03:54:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:54:00.941846878Z [2024-04-28T03:54:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:54:00.942136474Z [2024-04-28T03:54:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:54:00.942877616Z [2024-04-28T03:54:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:54:00.943120668Z [2024-04-28T03:54:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:54:01.389833178Z [2024-04-28T03:54:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:52:00+00:00 exited with status queued for try_number 1 2024-04-28T03:54:01.389876735Z [2024-04-28T03:54:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:53:00+00:00 exited with status queued for try_number 1 2024-04-28T03:54:01.389996617Z [2024-04-28T03:54:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:53:00+00:00 exited with status queued for try_number 1 2024-04-28T03:54:01.401498465Z [2024-04-28T03:54:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44c919a6-ff62-46aa-afff-543dccac43f0 2024-04-28T03:54:01.401607666Z [2024-04-28T03:54:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to af1af743-d3d3-4f52-96d6-b28f411ec906 2024-04-28T03:54:01.401879753Z [2024-04-28T03:54:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5781a49-5ad5-4fcd-bd73-8f176957112a 2024-04-28T03:54:02.565527938Z [2024-04-28T03:54:02.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:54:02.565794580Z [2024-04-28T03:54:02.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:52:00+00:00, run_id=scheduled__2024-04-28T03:52:00+00:00, run_start_date=2024-04-28 03:54:00.861064+00:00, run_end_date=2024-04-28 03:54:02.565450+00:00, run_duration=1.704386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:52:00+00:00, data_interval_end=2024-04-28 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:54:02.573000716Z [2024-04-28T03:54:02.572+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:54:00+00:00, run_after=2024-04-28T03:56:00+00:00 2024-04-28T03:54:02.617920832Z [2024-04-28T03:54:02.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:52:00+00:00 exited with status success for try_number 1 2024-04-28T03:54:02.623324473Z [2024-04-28T03:54:02.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:52:00+00:00, map_index=-1, run_start_date=2024-04-28 03:54:01.830681+00:00, run_end_date=2024-04-28 03:54:02.246683+00:00, run_duration=0.416002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:54:00.936534+00:00, queued_by_job_id=1, pid=11132 2024-04-28T03:54:04.768233187Z [2024-04-28T03:54:04.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:54:04.768595814Z [2024-04-28T03:54:04.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:53:00+00:00, run_id=scheduled__2024-04-28T03:53:00+00:00, run_start_date=2024-04-28 03:54:00.862747+00:00, run_end_date=2024-04-28 03:54:04.768266+00:00, run_duration=3.905519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:53:00+00:00, data_interval_end=2024-04-28 03:54:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:54:04.784234429Z [2024-04-28T03:54:04.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:54:00+00:00, run_after=2024-04-28T03:55:00+00:00 2024-04-28T03:54:04.826338076Z [2024-04-28T03:54:04.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:53:00+00:00 exited with status success for try_number 1 2024-04-28T03:54:04.831853902Z [2024-04-28T03:54:04.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:53:00+00:00, map_index=-1, run_start_date=2024-04-28 03:54:02.950750+00:00, run_end_date=2024-04-28 03:54:04.388483+00:00, run_duration=1.437733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:54:00.936534+00:00, queued_by_job_id=1, pid=11165 2024-04-28T03:54:05.886691208Z [2024-04-28T03:54:05.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:54:05.887142120Z [2024-04-28T03:54:05.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:53:00+00:00, run_id=scheduled__2024-04-28T03:53:00+00:00, run_start_date=2024-04-28 03:54:00.863960+00:00, run_end_date=2024-04-28 03:54:05.886824+00:00, run_duration=5.022864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:53:00+00:00, data_interval_end=2024-04-28 03:54:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:54:05.896675118Z [2024-04-28T03:54:05.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:54:00+00:00, run_after=2024-04-28T03:55:00+00:00 2024-04-28T03:54:05.921456881Z [2024-04-28T03:54:05.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:53:00+00:00 exited with status success for try_number 1 2024-04-28T03:54:05.929965062Z [2024-04-28T03:54:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:53:00+00:00, map_index=-1, run_start_date=2024-04-28 03:54:03.175847+00:00, run_end_date=2024-04-28 03:54:05.050088+00:00, run_duration=1.874241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:54:00.936534+00:00, queued_by_job_id=1, pid=11166 2024-04-28T03:55:00.446145065Z [2024-04-28T03:55:00.445+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:55:00.463031392Z [2024-04-28T03:55:00.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:55:00+00:00, run_after=2024-04-28T04:00:00+00:00 2024-04-28T03:55:00.476296641Z [2024-04-28T03:55:00.475+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:55:00+00:00, run_after=2024-04-28T03:56:00+00:00 2024-04-28T03:55:00.569691683Z [2024-04-28T03:55:00.569+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:55:00.569718549Z 2024-04-28T03:55:00.569723836Z 2024-04-28T03:55:00.569727919Z 2024-04-28T03:55:00.570164611Z [2024-04-28T03:55:00.569+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:55:00.570560479Z [2024-04-28T03:55:00.570+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:55:00.570859280Z [2024-04-28T03:55:00.570+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:55:00.571940915Z [2024-04-28T03:55:00.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:55:00.571984917Z 2024-04-28T03:55:00.571991047Z 2024-04-28T03:55:00.571995038Z 2024-04-28T03:55:00.577315268Z [2024-04-28T03:55:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-28T03:55:00.577699325Z [2024-04-28T03:55:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:55:00.578365409Z [2024-04-28T03:55:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:55:00.578693590Z [2024-04-28T03:55:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:55:00.579062626Z [2024-04-28T03:55:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:55:00.579419252Z [2024-04-28T03:55:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:55:00.823710133Z [2024-04-28T03:55:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:55:00.823909064Z [2024-04-28T03:55:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:54:00+00:00 exited with status queued for try_number 1 2024-04-28T03:55:00.824061270Z [2024-04-28T03:55:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:54:00+00:00 exited with status queued for try_number 1 2024-04-28T03:55:00.831338876Z [2024-04-28T03:55:00.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to f85a7cfc-96fa-491e-a57f-b0842e4277dc 2024-04-28T03:55:00.831666599Z [2024-04-28T03:55:00.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to 467feda3-c0fb-48cb-b85d-c099bcf98bbc 2024-04-28T03:55:00.831866861Z [2024-04-28T03:55:00.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cc48540-c296-4046-9a28-3b7698efb9da 2024-04-28T03:55:03.574526398Z [2024-04-28T03:55:03.574+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:55:03.574553097Z 2024-04-28T03:55:03.574638933Z [2024-04-28T03:55:03.574+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:55:03.575182775Z [2024-04-28T03:55:03.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:55:03.575194980Z 2024-04-28T03:55:03.577669447Z [2024-04-28T03:55:03.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='split_metrics', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-28T03:55:03.577683711Z [2024-04-28T03:55:03.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'split_metrics', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:55:03.683871386Z [2024-04-28T03:55:03.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:55:03.690155940Z [2024-04-28T03:55:03.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.extract_metrics_from_vnfrs run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:55:03.695716543Z [2024-04-28T03:55:03.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4ed1feb-1bd2-4703-8951-276c406d3adb 2024-04-28T03:55:03.696146839Z [2024-04-28T03:55:03.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=-1, run_start_date=2024-04-28 03:55:02.585226+00:00, run_end_date=2024-04-28 03:55:03.012087+00:00, run_duration=0.426861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:55:00.573524+00:00, queued_by_job_id=1, pid=11231 2024-04-28T03:55:06.023982269Z [2024-04-28T03:55:06.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:55:06.024314897Z [2024-04-28T03:55:06.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:54:00+00:00, run_id=scheduled__2024-04-28T03:54:00+00:00, run_start_date=2024-04-28 03:55:00.489726+00:00, run_end_date=2024-04-28 03:55:06.023971+00:00, run_duration=5.534245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:54:00+00:00, data_interval_end=2024-04-28 03:55:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:55:06.036200405Z [2024-04-28T03:55:06.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:55:00+00:00, run_after=2024-04-28T03:56:00+00:00 2024-04-28T03:55:06.054279676Z [2024-04-28T03:55:06.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:55:06.054711041Z [2024-04-28T03:55:06.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:54:00+00:00, run_id=scheduled__2024-04-28T03:54:00+00:00, run_start_date=2024-04-28 03:55:00.488646+00:00, run_end_date=2024-04-28 03:55:06.054365+00:00, run_duration=5.565719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:54:00+00:00, data_interval_end=2024-04-28 03:55:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:55:06.075304617Z [2024-04-28T03:55:06.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:55:00+00:00, run_after=2024-04-28T03:56:00+00:00 2024-04-28T03:55:06.148667712Z [2024-04-28T03:55:06.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:54:00+00:00 exited with status success for try_number 1 2024-04-28T03:55:06.148812505Z [2024-04-28T03:55:06.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:54:00+00:00 exited with status success for try_number 1 2024-04-28T03:55:06.163122128Z [2024-04-28T03:55:06.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:54:00+00:00, map_index=-1, run_start_date=2024-04-28 03:55:02.738097+00:00, run_end_date=2024-04-28 03:55:05.186701+00:00, run_duration=2.448604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:55:00.573524+00:00, queued_by_job_id=1, pid=11233 2024-04-28T03:55:06.163657414Z [2024-04-28T03:55:06.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:54:00+00:00, map_index=-1, run_start_date=2024-04-28 03:55:02.661876+00:00, run_end_date=2024-04-28 03:55:05.490279+00:00, run_duration=2.828403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:55:00.573524+00:00, queued_by_job_id=1, pid=11232 2024-04-28T03:55:07.250969323Z [2024-04-28T03:55:07.250+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:55:07.251018367Z 2024-04-28T03:55:07.251572623Z [2024-04-28T03:55:07.251+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:55:07.252646642Z [2024-04-28T03:55:07.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:55:07.252702659Z 2024-04-28T03:55:07.256475366Z [2024-04-28T03:55:07.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='collect_metrics', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-28T03:55:07.256877651Z [2024-04-28T03:55:07.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'collect_metrics', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-28T03:55:07.322037240Z [2024-04-28T03:55:07.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:55:07.322110492Z [2024-04-28T03:55:07.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.split_metrics run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:55:07.331402865Z [2024-04-28T03:55:07.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to d755f5dd-1999-4eee-9704-99d2caf0df90 2024-04-28T03:55:07.331569833Z [2024-04-28T03:55:07.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=split_metrics, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=-1, run_start_date=2024-04-28 03:55:06.400054+00:00, run_end_date=2024-04-28 03:55:06.764671+00:00, run_duration=0.364617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:55:03.575486+00:00, queued_by_job_id=1, pid=11275 2024-04-28T03:55:09.765185800Z [2024-04-28T03:55:09.764+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-28T03:55:09.765216390Z 2024-04-28T03:55:09.765825856Z [2024-04-28T03:55:09.765+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:55:09.767061653Z [2024-04-28T03:55:09.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:55:09.767071731Z 2024-04-28T03:55:09.770575245Z [2024-04-28T03:55:09.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='send_prometheus', run_id='scheduled__2024-04-28T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:55:09.770768498Z [2024-04-28T03:55:09.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'send_prometheus', 'scheduled__2024-04-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-28T03:55:09.856773539Z [2024-04-28T03:55:09.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status queued for try_number 1 2024-04-28T03:55:09.858063338Z [2024-04-28T03:55:09.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.collect_metrics run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:55:09.872624312Z [2024-04-28T03:55:09.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8464c9b-6b7d-4c3d-9409-5f46273d505f 2024-04-28T03:55:09.872936062Z [2024-04-28T03:55:09.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=collect_metrics, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=0, run_start_date=2024-04-28 03:55:08.952401+00:00, run_end_date=2024-04-28 03:55:09.244214+00:00, run_duration=0.291813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:55:07.253416+00:00, queued_by_job_id=1, pid=11287 2024-04-28T03:55:11.902367560Z [2024-04-28T03:55:11.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:55:11.902615359Z [2024-04-28T03:55:11.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:50:00+00:00, run_id=scheduled__2024-04-28T03:50:00+00:00, run_start_date=2024-04-28 03:55:00.487317+00:00, run_end_date=2024-04-28 03:55:11.902215+00:00, run_duration=11.414898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:50:00+00:00, data_interval_end=2024-04-28 03:55:00+00:00, dag_hash=2f85f2ce0acefa57ff4241df62c02bc7 2024-04-28T03:55:11.908313598Z [2024-04-28T03:55:11.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:55:00+00:00, run_after=2024-04-28T04:00:00+00:00 2024-04-28T03:55:11.935980433Z [2024-04-28T03:55:11.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0.send_prometheus run_id=scheduled__2024-04-28T03:50:00+00:00 exited with status success for try_number 1 2024-04-28T03:55:11.943480040Z [2024-04-28T03:55:11.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=send_prometheus, run_id=scheduled__2024-04-28T03:50:00+00:00, map_index=-1, run_start_date=2024-04-28 03:55:11.362577+00:00, run_end_date=2024-04-28 03:55:11.668032+00:00, run_duration=0.305455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:55:09.767623+00:00, queued_by_job_id=1, pid=11299 2024-04-28T03:56:00.401647962Z [2024-04-28T03:56:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:56:00+00:00, run_after=2024-04-28T03:57:00+00:00 2024-04-28T03:56:00.407648618Z [2024-04-28T03:56:00.407+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:56:00.413521601Z [2024-04-28T03:56:00.413+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:56:00.467273534Z [2024-04-28T03:56:00.466+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:56:00.467300194Z 2024-04-28T03:56:00.467305647Z 2024-04-28T03:56:00.467310038Z 2024-04-28T03:56:00.467435177Z [2024-04-28T03:56:00.467+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:56:00.467673533Z [2024-04-28T03:56:00.467+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:56:00.468613591Z [2024-04-28T03:56:00.468+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:56:00.469143108Z [2024-04-28T03:56:00.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:56:00.469154330Z 2024-04-28T03:56:00.469158997Z 2024-04-28T03:56:00.469163276Z 2024-04-28T03:56:00.473078688Z [2024-04-28T03:56:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:56:00.473159927Z [2024-04-28T03:56:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:56:00.473378292Z [2024-04-28T03:56:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:56:00.473606219Z [2024-04-28T03:56:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:56:00.473927450Z [2024-04-28T03:56:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:56:00.474141639Z [2024-04-28T03:56:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:56:00.686862033Z [2024-04-28T03:56:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:54:00+00:00 exited with status queued for try_number 1 2024-04-28T03:56:00.687123074Z [2024-04-28T03:56:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:55:00+00:00 exited with status queued for try_number 1 2024-04-28T03:56:00.687323177Z [2024-04-28T03:56:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:55:00+00:00 exited with status queued for try_number 1 2024-04-28T03:56:00.695698533Z [2024-04-28T03:56:00.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 330dda33-c479-4c03-bf83-2934dfcfd141 2024-04-28T03:56:00.696055056Z [2024-04-28T03:56:00.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14cde1f6-31c8-4e83-b1da-a91f1e780754 2024-04-28T03:56:00.696311077Z [2024-04-28T03:56:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b766db1-768e-47bb-9cb3-fb5c7822b39a 2024-04-28T03:56:01.838268983Z [2024-04-28T03:56:01.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:56:01.838925509Z [2024-04-28T03:56:01.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:54:00+00:00, run_id=scheduled__2024-04-28T03:54:00+00:00, run_start_date=2024-04-28 03:56:00.422736+00:00, run_end_date=2024-04-28 03:56:01.838162+00:00, run_duration=1.415426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:54:00+00:00, data_interval_end=2024-04-28 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:56:01.851319913Z [2024-04-28T03:56:01.850+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:56:00+00:00, run_after=2024-04-28T03:58:00+00:00 2024-04-28T03:56:01.911162871Z [2024-04-28T03:56:01.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:54:00+00:00 exited with status success for try_number 1 2024-04-28T03:56:01.918667718Z [2024-04-28T03:56:01.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:54:00+00:00, map_index=-1, run_start_date=2024-04-28 03:56:01.190091+00:00, run_end_date=2024-04-28 03:56:01.556209+00:00, run_duration=0.366118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:56:00.469769+00:00, queued_by_job_id=1, pid=11303 2024-04-28T03:56:04.413965556Z [2024-04-28T03:56:04.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:56:04.416070752Z [2024-04-28T03:56:04.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:55:00+00:00, run_id=scheduled__2024-04-28T03:55:00+00:00, run_start_date=2024-04-28 03:56:00.424773+00:00, run_end_date=2024-04-28 03:56:04.413881+00:00, run_duration=3.989108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:55:00+00:00, data_interval_end=2024-04-28 03:56:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:56:04.425133958Z [2024-04-28T03:56:04.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:56:00+00:00, run_after=2024-04-28T03:57:00+00:00 2024-04-28T03:56:04.431713941Z [2024-04-28T03:56:04.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:56:04.433751268Z [2024-04-28T03:56:04.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:55:00+00:00, run_id=scheduled__2024-04-28T03:55:00+00:00, run_start_date=2024-04-28 03:56:00.423817+00:00, run_end_date=2024-04-28 03:56:04.431635+00:00, run_duration=4.007818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:55:00+00:00, data_interval_end=2024-04-28 03:56:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:56:04.451841085Z [2024-04-28T03:56:04.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:56:00+00:00, run_after=2024-04-28T03:57:00+00:00 2024-04-28T03:56:04.487547854Z [2024-04-28T03:56:04.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:55:00+00:00 exited with status success for try_number 1 2024-04-28T03:56:04.487576954Z [2024-04-28T03:56:04.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:55:00+00:00 exited with status success for try_number 1 2024-04-28T03:56:04.494484706Z [2024-04-28T03:56:04.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:55:00+00:00, map_index=-1, run_start_date=2024-04-28 03:56:02.518898+00:00, run_end_date=2024-04-28 03:56:03.924980+00:00, run_duration=1.406082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:56:00.469769+00:00, queued_by_job_id=1, pid=11343 2024-04-28T03:56:04.494726605Z [2024-04-28T03:56:04.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:55:00+00:00, map_index=-1, run_start_date=2024-04-28 03:56:02.531032+00:00, run_end_date=2024-04-28 03:56:04.261197+00:00, run_duration=1.730165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:56:00.469769+00:00, queued_by_job_id=1, pid=11344 2024-04-28T03:56:17.423555227Z [2024-04-28T03:56:17.423+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-28T03:57:00.200774966Z [2024-04-28T03:57:00.200+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:57:00.223869777Z [2024-04-28T03:57:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:57:00+00:00, run_after=2024-04-28T03:58:00+00:00 2024-04-28T03:57:00.305653566Z [2024-04-28T03:57:00.305+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:57:00.305697132Z 2024-04-28T03:57:00.305706475Z 2024-04-28T03:57:00.305799275Z [2024-04-28T03:57:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:57:00.305809022Z [2024-04-28T03:57:00.305+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:57:00.306544209Z [2024-04-28T03:57:00.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:57:00.306568923Z 2024-04-28T03:57:00.306576832Z 2024-04-28T03:57:00.309670407Z [2024-04-28T03:57:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:57:00.310134689Z [2024-04-28T03:57:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:57:00.310518049Z [2024-04-28T03:57:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:57:00.310735310Z [2024-04-28T03:57:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:57:00.501716294Z [2024-04-28T03:57:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:56:00+00:00 exited with status queued for try_number 1 2024-04-28T03:57:00.501789011Z [2024-04-28T03:57:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:56:00+00:00 exited with status queued for try_number 1 2024-04-28T03:57:00.510280142Z [2024-04-28T03:57:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd03e42e-5c3a-4a7c-b38f-d5b9cf0b300b 2024-04-28T03:57:00.510365702Z [2024-04-28T03:57:00.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0657d2d-2ce0-4f1a-9430-1df601a40545 2024-04-28T03:57:03.733675009Z [2024-04-28T03:57:03.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:57:03.734572867Z [2024-04-28T03:57:03.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:56:00+00:00, run_id=scheduled__2024-04-28T03:56:00+00:00, run_start_date=2024-04-28 03:57:00.250467+00:00, run_end_date=2024-04-28 03:57:03.733592+00:00, run_duration=3.483125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:56:00+00:00, data_interval_end=2024-04-28 03:57:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:57:03.744740309Z [2024-04-28T03:57:03.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:57:00+00:00, run_after=2024-04-28T03:58:00+00:00 2024-04-28T03:57:03.751507013Z [2024-04-28T03:57:03.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:57:03.751906051Z [2024-04-28T03:57:03.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:56:00+00:00, run_id=scheduled__2024-04-28T03:56:00+00:00, run_start_date=2024-04-28 03:57:00.252624+00:00, run_end_date=2024-04-28 03:57:03.751441+00:00, run_duration=3.498817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:56:00+00:00, data_interval_end=2024-04-28 03:57:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:57:03.761994564Z [2024-04-28T03:57:03.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:57:00+00:00, run_after=2024-04-28T03:58:00+00:00 2024-04-28T03:57:03.793163269Z [2024-04-28T03:57:03.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:56:00+00:00 exited with status success for try_number 1 2024-04-28T03:57:03.793198455Z [2024-04-28T03:57:03.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:56:00+00:00 exited with status success for try_number 1 2024-04-28T03:57:03.799867863Z [2024-04-28T03:57:03.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:56:00+00:00, map_index=-1, run_start_date=2024-04-28 03:57:02.029288+00:00, run_end_date=2024-04-28 03:57:03.345356+00:00, run_duration=1.316068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:57:00.307007+00:00, queued_by_job_id=1, pid=11397 2024-04-28T03:57:03.800178498Z [2024-04-28T03:57:03.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:56:00+00:00, map_index=-1, run_start_date=2024-04-28 03:57:02.061922+00:00, run_end_date=2024-04-28 03:57:03.593697+00:00, run_duration=1.531775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:57:00.307007+00:00, queued_by_job_id=1, pid=11398 2024-04-28T03:58:00.042460729Z [2024-04-28T03:58:00.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:58:00.052861819Z [2024-04-28T03:58:00.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:58:00.066450272Z [2024-04-28T03:58:00.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:58:00+00:00, run_after=2024-04-28T03:59:00+00:00 2024-04-28T03:58:00.195429282Z [2024-04-28T03:58:00.195+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-28T03:58:00.195452078Z 2024-04-28T03:58:00.195458225Z 2024-04-28T03:58:00.195461619Z 2024-04-28T03:58:00.195472095Z [2024-04-28T03:58:00.195+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-28T03:58:00.195569079Z [2024-04-28T03:58:00.195+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:58:00.195633952Z [2024-04-28T03:58:00.195+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:58:00.196121571Z [2024-04-28T03:58:00.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:58:00.196127287Z 2024-04-28T03:58:00.196132177Z 2024-04-28T03:58:00.196135598Z 2024-04-28T03:58:00.200159894Z [2024-04-28T03:58:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-28T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:58:00.200257795Z [2024-04-28T03:58:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-28T03:58:00.200427685Z [2024-04-28T03:58:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:58:00.200519133Z [2024-04-28T03:58:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:58:00.200651640Z [2024-04-28T03:58:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:58:00.200729234Z [2024-04-28T03:58:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:58:00.496674286Z [2024-04-28T03:58:00.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:56:00+00:00 exited with status queued for try_number 1 2024-04-28T03:58:00.497005834Z [2024-04-28T03:58:00.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:57:00+00:00 exited with status queued for try_number 1 2024-04-28T03:58:00.497195348Z [2024-04-28T03:58:00.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:57:00+00:00 exited with status queued for try_number 1 2024-04-28T03:58:00.504486850Z [2024-04-28T03:58:00.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to edd7e87e-3fae-4d6b-abab-460fa7470afb 2024-04-28T03:58:00.504850930Z [2024-04-28T03:58:00.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d916347-a60a-438c-a240-a0a7580046f6 2024-04-28T03:58:00.505052344Z [2024-04-28T03:58:00.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ff52228-e792-4265-bc24-c6c2cfa3c2b2 2024-04-28T03:58:01.655497121Z [2024-04-28T03:58:01.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:58:01.655902378Z [2024-04-28T03:58:01.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-28 03:56:00+00:00, run_id=scheduled__2024-04-28T03:56:00+00:00, run_start_date=2024-04-28 03:58:00.078667+00:00, run_end_date=2024-04-28 03:58:01.655313+00:00, run_duration=1.576646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:56:00+00:00, data_interval_end=2024-04-28 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-28T03:58:01.667351177Z [2024-04-28T03:58:01.666+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-28T03:58:00+00:00, run_after=2024-04-28T04:00:00+00:00 2024-04-28T03:58:01.720710368Z [2024-04-28T03:58:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-28T03:56:00+00:00 exited with status success for try_number 1 2024-04-28T03:58:01.727557331Z [2024-04-28T03:58:01.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-28T03:56:00+00:00, map_index=-1, run_start_date=2024-04-28 03:58:01.061106+00:00, run_end_date=2024-04-28 03:58:01.412384+00:00, run_duration=0.351278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:58:00.197309+00:00, queued_by_job_id=1, pid=11423 2024-04-28T03:58:04.121742384Z [2024-04-28T03:58:04.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:58:04.122157391Z [2024-04-28T03:58:04.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:57:00+00:00, run_id=scheduled__2024-04-28T03:57:00+00:00, run_start_date=2024-04-28 03:58:00.087172+00:00, run_end_date=2024-04-28 03:58:04.121647+00:00, run_duration=4.034475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:57:00+00:00, data_interval_end=2024-04-28 03:58:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:58:04.132371586Z [2024-04-28T03:58:04.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:58:00+00:00, run_after=2024-04-28T03:59:00+00:00 2024-04-28T03:58:04.138726900Z [2024-04-28T03:58:04.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:58:04.139127634Z [2024-04-28T03:58:04.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:57:00+00:00, run_id=scheduled__2024-04-28T03:57:00+00:00, run_start_date=2024-04-28 03:58:00.082750+00:00, run_end_date=2024-04-28 03:58:04.138650+00:00, run_duration=4.0559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:57:00+00:00, data_interval_end=2024-04-28 03:58:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:58:04.148305092Z [2024-04-28T03:58:04.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:58:00+00:00, run_after=2024-04-28T03:59:00+00:00 2024-04-28T03:58:04.180967784Z [2024-04-28T03:58:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:57:00+00:00 exited with status success for try_number 1 2024-04-28T03:58:04.181419922Z [2024-04-28T03:58:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:57:00+00:00 exited with status success for try_number 1 2024-04-28T03:58:04.191829242Z [2024-04-28T03:58:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:57:00+00:00, map_index=-1, run_start_date=2024-04-28 03:58:02.253646+00:00, run_end_date=2024-04-28 03:58:03.951092+00:00, run_duration=1.697446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:58:00.197309+00:00, queued_by_job_id=1, pid=11463 2024-04-28T03:58:04.192258593Z [2024-04-28T03:58:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:57:00+00:00, map_index=-1, run_start_date=2024-04-28 03:58:02.246115+00:00, run_end_date=2024-04-28 03:58:03.573768+00:00, run_duration=1.327653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:58:00.197309+00:00, queued_by_job_id=1, pid=11462 2024-04-28T03:59:01.026029935Z [2024-04-28T03:59:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-28T03:59:01.044420367Z [2024-04-28T03:59:01.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:59:00+00:00, run_after=2024-04-28T04:00:00+00:00 2024-04-28T03:59:01.111999339Z [2024-04-28T03:59:01.111+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-28T03:59:01.112045596Z 2024-04-28T03:59:01.112055666Z 2024-04-28T03:59:01.112064598Z [2024-04-28T03:59:01.111+0000] {scheduler_job.py:425} INFO - DAG vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:59:01.112087248Z [2024-04-28T03:59:01.111+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 has 0/16 running and queued tasks 2024-04-28T03:59:01.112900177Z [2024-04-28T03:59:01.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-28T03:59:01.112923724Z 2024-04-28T03:59:01.112933325Z 2024-04-28T03:59:01.116761868Z [2024-04-28T03:59:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:59:01.116803759Z [2024-04-28T03:59:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-28T03:59:01.117214472Z [2024-04-28T03:59:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-28T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-28T03:59:01.117324665Z [2024-04-28T03:59:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-28T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-28T03:59:01.317512017Z [2024-04-28T03:59:01.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:58:00+00:00 exited with status queued for try_number 1 2024-04-28T03:59:01.319855570Z [2024-04-28T03:59:01.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:58:00+00:00 exited with status queued for try_number 1 2024-04-28T03:59:01.327970188Z [2024-04-28T03:59:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40465649-912f-48b4-974e-ebe02c6933f9 2024-04-28T03:59:01.328250751Z [2024-04-28T03:59:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cdac5fe-e718-4cd7-ad16-823ed112e523 2024-04-28T03:59:05.688463336Z [2024-04-28T03:59:05.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:59:05.689159497Z [2024-04-28T03:59:05.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:58:00+00:00, run_id=scheduled__2024-04-28T03:58:00+00:00, run_start_date=2024-04-28 03:59:01.060517+00:00, run_end_date=2024-04-28 03:59:05.688280+00:00, run_duration=4.627763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:58:00+00:00, data_interval_end=2024-04-28 03:59:00+00:00, dag_hash=ebdb5e235776f4d01ed15a627b478182 2024-04-28T03:59:05.705696454Z [2024-04-28T03:59:05.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:59:00+00:00, run_after=2024-04-28T04:00:00+00:00 2024-04-28T03:59:05.767795821Z [2024-04-28T03:59:05.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_938f336e-4085-47df-91ff-aa53f1a254a0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:58:00+00:00 exited with status success for try_number 1 2024-04-28T03:59:05.774195687Z [2024-04-28T03:59:05.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:58:00+00:00, map_index=-1, run_start_date=2024-04-28 03:59:03.237873+00:00, run_end_date=2024-04-28 03:59:04.478733+00:00, run_duration=1.24086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:59:01.113494+00:00, queued_by_job_id=1, pid=11518 2024-04-28T03:59:06.390061149Z [2024-04-28T03:59:06.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-28T03:59:06.390636765Z [2024-04-28T03:59:06.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, execution_date=2024-04-28 03:58:00+00:00, run_id=scheduled__2024-04-28T03:58:00+00:00, run_start_date=2024-04-28 03:59:01.062054+00:00, run_end_date=2024-04-28 03:59:06.390183+00:00, run_duration=5.328129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-28 03:58:00+00:00, data_interval_end=2024-04-28 03:59:00+00:00, dag_hash=eb7e5ff326012cb9a8f119aad61e6b18 2024-04-28T03:59:06.399706418Z [2024-04-28T03:59:06.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0 to 2024-04-28T03:59:00+00:00, run_after=2024-04-28T04:00:00+00:00 2024-04-28T03:59:06.428290811Z [2024-04-28T03:59:06.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-28T03:58:00+00:00 exited with status success for try_number 1 2024-04-28T03:59:06.433207027Z [2024-04-28T03:59:06.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_938f336e-4085-47df-91ff-aa53f1a254a0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-28T03:58:00+00:00, map_index=-1, run_start_date=2024-04-28 03:59:03.120530+00:00, run_end_date=2024-04-28 03:59:05.863996+00:00, run_duration=2.743466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-28 03:59:01.113494+00:00, queued_by_job_id=1, pid=11517 2024-04-28T01:30:58.817064430Z 2024-04-28T01:30:58.837901814Z Cleaning logs every 900 seconds 2024-04-28T01:30:58.838441916Z Trimming airflow logs to 15 days. 2024-04-28T01:45:01.060648498Z Trimming airflow logs to 15 days. 2024-04-28T02:00:00.098044845Z Trimming airflow logs to 15 days. 2024-04-28T02:00:01.127713222Z Trimming airflow logs to 15 days. 2024-04-28T02:15:00.166466487Z Trimming airflow logs to 15 days. 2024-04-28T02:15:01.187516680Z Trimming airflow logs to 15 days. 2024-04-28T02:30:00.225981645Z Trimming airflow logs to 15 days. 2024-04-28T02:30:01.247079655Z Trimming airflow logs to 15 days. 2024-04-28T02:45:00.325477325Z Trimming airflow logs to 15 days. 2024-04-28T02:45:01.354802688Z Trimming airflow logs to 15 days. 2024-04-28T03:00:00.391006226Z Trimming airflow logs to 15 days. 2024-04-28T03:00:01.413387566Z Trimming airflow logs to 15 days. 2024-04-28T03:15:00.446782996Z Trimming airflow logs to 15 days. 2024-04-28T03:15:01.466888359Z Trimming airflow logs to 15 days. 2024-04-28T03:30:00.501763377Z Trimming airflow logs to 15 days. 2024-04-28T03:30:01.518653863Z Trimming airflow logs to 15 days. 2024-04-28T03:45:00.562331424Z Trimming airflow logs to 15 days. 2024-04-28T03:45:01.598187083Z Trimming airflow logs to 15 days.