2024-05-10T22:25:26.241516865Z 2024-05-10T22:25:26.727666332Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-10T22:25:27.611650140Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-10T22:25:32.401510806Z ____________ _____________ 2024-05-10T22:25:32.401529654Z ____ |__( )_________ __/__ /________ __ 2024-05-10T22:25:32.401533026Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-05-10T22:25:32.401536208Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-05-10T22:25:32.401539227Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-05-10T22:25:32.401542690Z [2024-05-10T22:25:32.400+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-05-10T22:25:32.402090615Z [2024-05-10T22:25:32.401+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-05-10T22:25:32.748360967Z [2024-05-10T22:25:32.747+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-05-10T22:25:32.769344624Z [2024-05-10T22:25:32.760+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-05-10T22:25:32.770502229Z [2024-05-10T22:25:32.770+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:25:32.804663835Z [2024-05-10T22:25:32.791+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-05-10T22:25:32.814385240Z [2024-05-10T22:25:32.814+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-05-10T22:26:13.292914930Z [2024-05-10T22:26:13.292+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:26:13.404010228Z [2024-05-10T22:26:13.403+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:26:13.404028226Z 2024-05-10T22:26:13.409082526Z [2024-05-10T22:26:13.408+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:26:13.410771898Z [2024-05-10T22:26:13.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:26:13.410785128Z 2024-05-10T22:26:13.422611143Z [2024-05-10T22:26:13.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:26:13.423203285Z [2024-05-10T22:26:13.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:26:14.189280467Z [2024-05-10T22:26:14.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:24:00+00:00 exited with status queued for try_number 1 2024-05-10T22:26:14.238756514Z [2024-05-10T22:26:14.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03ea077b-8f51-4362-9798-d81456401c3c 2024-05-10T22:26:17.577473183Z [2024-05-10T22:26:17.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:24:00+00:00 exited with status success for try_number 1 2024-05-10T22:26:17.588140456Z [2024-05-10T22:26:17.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:24:00+00:00, map_index=-1, run_start_date=2024-05-10 22:26:16.074758+00:00, run_end_date=2024-05-10 22:26:16.775012+00:00, run_duration=0.700254, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:26:13.417349+00:00, queued_by_job_id=2, pid=50 2024-05-10T22:26:27.855561462Z [2024-05-10T22:26:27.854+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:26:27.855579398Z 2024-05-10T22:26:27.855769181Z [2024-05-10T22:26:27.855+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:26:27.856732130Z [2024-05-10T22:26:27.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:26:27.856742985Z 2024-05-10T22:26:27.860453814Z [2024-05-10T22:26:27.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:24:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:26:27.860666799Z [2024-05-10T22:26:27.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:26:27.954927541Z [2024-05-10T22:26:27.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:24:00+00:00 exited with status queued for try_number 2 2024-05-10T22:26:27.960597071Z [2024-05-10T22:26:27.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d25e802-ed5b-48f4-b593-768b8249c0a1 2024-05-10T22:26:29.599672395Z [2024-05-10T22:26:29.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:26:29.600395402Z [2024-05-10T22:26:29.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:24:00+00:00, run_id=scheduled__2024-05-10T22:24:00+00:00, run_start_date=2024-05-10 22:26:13.313221+00:00, run_end_date=2024-05-10 22:26:29.600067+00:00, run_duration=16.286846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:24:00+00:00, data_interval_end=2024-05-10 22:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:26:29.610517385Z [2024-05-10T22:26:29.610+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:26:00+00:00, run_after=2024-05-10T22:28:00+00:00 2024-05-10T22:26:29.653773363Z [2024-05-10T22:26:29.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:24:00+00:00 exited with status success for try_number 2 2024-05-10T22:26:29.658539305Z [2024-05-10T22:26:29.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:24:00+00:00, map_index=-1, run_start_date=2024-05-10 22:26:28.862471+00:00, run_end_date=2024-05-10 22:26:29.262752+00:00, run_duration=0.400281, state=success, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:26:27.857322+00:00, queued_by_job_id=2, pid=57 2024-05-10T22:28:00.388561659Z [2024-05-10T22:28:00.388+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:28:00.445700414Z [2024-05-10T22:28:00.445+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:28:00.445724072Z 2024-05-10T22:28:00.446200006Z [2024-05-10T22:28:00.445+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:28:00.446858546Z [2024-05-10T22:28:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:28:00.446870528Z 2024-05-10T22:28:00.449271493Z [2024-05-10T22:28:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:28:00.449515304Z [2024-05-10T22:28:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:28:00.565372607Z [2024-05-10T22:28:00.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:26:00+00:00 exited with status queued for try_number 1 2024-05-10T22:28:00.583399758Z [2024-05-10T22:28:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to efa118e1-451a-4598-ac9e-b14754f7ad5c 2024-05-10T22:28:02.371906987Z [2024-05-10T22:28:02.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:28:02.372066811Z [2024-05-10T22:28:02.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:26:00+00:00, run_id=scheduled__2024-05-10T22:26:00+00:00, run_start_date=2024-05-10 22:28:00.403360+00:00, run_end_date=2024-05-10 22:28:02.371776+00:00, run_duration=1.968416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:26:00+00:00, data_interval_end=2024-05-10 22:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:28:02.381099206Z [2024-05-10T22:28:02.379+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:28:00+00:00, run_after=2024-05-10T22:30:00+00:00 2024-05-10T22:28:02.413141651Z [2024-05-10T22:28:02.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:26:00+00:00 exited with status success for try_number 1 2024-05-10T22:28:02.418411903Z [2024-05-10T22:28:02.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:26:00+00:00, map_index=-1, run_start_date=2024-05-10 22:28:01.334036+00:00, run_end_date=2024-05-10 22:28:01.761303+00:00, run_duration=0.427267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:28:00.447334+00:00, queued_by_job_id=2, pid=77 2024-05-10T22:30:00.947725463Z [2024-05-10T22:30:00.947+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:30:00.991303404Z [2024-05-10T22:30:00.991+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:30:00.991318309Z 2024-05-10T22:30:00.991432397Z [2024-05-10T22:30:00.991+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:30:00.992023550Z [2024-05-10T22:30:00.991+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:30:00.992036983Z 2024-05-10T22:30:00.994077007Z [2024-05-10T22:30:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:30:00.994155848Z [2024-05-10T22:30:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:30:01.112748780Z [2024-05-10T22:30:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:28:00+00:00 exited with status queued for try_number 1 2024-05-10T22:30:01.121805368Z [2024-05-10T22:30:01.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64d5ec3e-b914-4737-9cd3-fb9713ad7e3c 2024-05-10T22:30:02.262965236Z [2024-05-10T22:30:02.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:30:02.263524130Z [2024-05-10T22:30:02.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:28:00+00:00, run_id=scheduled__2024-05-10T22:28:00+00:00, run_start_date=2024-05-10 22:30:00.962215+00:00, run_end_date=2024-05-10 22:30:02.263200+00:00, run_duration=1.300985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:28:00+00:00, data_interval_end=2024-05-10 22:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:30:02.276752463Z [2024-05-10T22:30:02.275+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:32:00+00:00 2024-05-10T22:30:02.307499037Z [2024-05-10T22:30:02.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:28:00+00:00 exited with status success for try_number 1 2024-05-10T22:30:02.318030674Z [2024-05-10T22:30:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:28:00+00:00, map_index=-1, run_start_date=2024-05-10 22:30:01.732983+00:00, run_end_date=2024-05-10 22:30:02.106064+00:00, run_duration=0.373081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:30:00.992338+00:00, queued_by_job_id=2, pid=110 2024-05-10T22:30:33.025306184Z [2024-05-10T22:30:33.024+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:32:00.362476407Z [2024-05-10T22:32:00.362+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:32:00.416076030Z [2024-05-10T22:32:00.415+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:00.416096080Z 2024-05-10T22:32:00.416737345Z [2024-05-10T22:32:00.416+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:32:00.417358111Z [2024-05-10T22:32:00.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:00.417369169Z 2024-05-10T22:32:00.420126238Z [2024-05-10T22:32:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:32:00.420368483Z [2024-05-10T22:32:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:32:00.503048795Z [2024-05-10T22:32:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:00.511440221Z [2024-05-10T22:32:00.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d790a2-0204-48d4-aefb-4c6728fe948c 2024-05-10T22:32:01.729026876Z [2024-05-10T22:32:01.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:32:01.729483592Z [2024-05-10T22:32:01.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:30:00+00:00, run_id=scheduled__2024-05-10T22:30:00+00:00, run_start_date=2024-05-10 22:32:00.371443+00:00, run_end_date=2024-05-10 22:32:01.729100+00:00, run_duration=1.357657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:30:00+00:00, data_interval_end=2024-05-10 22:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:32:01.739154267Z [2024-05-10T22:32:01.738+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:32:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:32:01.774282302Z [2024-05-10T22:32:01.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:01.780014252Z [2024-05-10T22:32:01.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:01.218840+00:00, run_end_date=2024-05-10 22:32:01.537386+00:00, run_duration=0.318546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:00.417930+00:00, queued_by_job_id=2, pid=144 2024-05-10T22:32:29.529306491Z [2024-05-10T22:32:29.528+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:32:29.563690869Z [2024-05-10T22:32:29.563+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:29.563729077Z 2024-05-10T22:32:29.563829173Z [2024-05-10T22:32:29.563+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:32:29.564451802Z [2024-05-10T22:32:29.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:29.564465008Z 2024-05-10T22:32:29.566278067Z [2024-05-10T22:32:29.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:32:29.566440167Z [2024-05-10T22:32:29.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:32:29.629667564Z [2024-05-10T22:32:29.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:31:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:29.642561976Z [2024-05-10T22:32:29.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to c462bbf3-42c8-48aa-bd6a-6ee1121f610a 2024-05-10T22:32:31.899696433Z [2024-05-10T22:32:31.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:32:00+00:00, run_after=2024-05-10T22:33:00+00:00 2024-05-10T22:32:31.947323802Z [2024-05-10T22:32:31.947+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:31.947342445Z 2024-05-10T22:32:31.947623438Z [2024-05-10T22:32:31.947+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:32:31.948253194Z [2024-05-10T22:32:31.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:31.948265268Z 2024-05-10T22:32:31.950253404Z [2024-05-10T22:32:31.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:32:31.950479100Z [2024-05-10T22:32:31.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:32:32.022848882Z [2024-05-10T22:32:32.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:31:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:32.028904530Z [2024-05-10T22:32:32.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1646b7ad-b579-4d97-a957-0679d8d9daee 2024-05-10T22:32:33.338891559Z [2024-05-10T22:32:33.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:32:33.339607765Z [2024-05-10T22:32:33.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:31:00+00:00, run_id=scheduled__2024-05-10T22:31:00+00:00, run_start_date=2024-05-10 22:32:29.542099+00:00, run_end_date=2024-05-10 22:32:33.338829+00:00, run_duration=3.79673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:31:00+00:00, data_interval_end=2024-05-10 22:32:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:32:33.355405268Z [2024-05-10T22:32:33.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:32:00+00:00, run_after=2024-05-10T22:33:00+00:00 2024-05-10T22:32:33.401629651Z [2024-05-10T22:32:33.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:31:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:33.410158205Z [2024-05-10T22:32:33.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:31:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:31.551075+00:00, run_end_date=2024-05-10 22:32:33.187890+00:00, run_duration=1.636815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:29.564772+00:00, queued_by_job_id=2, pid=170 2024-05-10T22:32:35.904146378Z [2024-05-10T22:32:35.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:32:35.904576405Z [2024-05-10T22:32:35.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:31:00+00:00, run_id=scheduled__2024-05-10T22:31:00+00:00, run_start_date=2024-05-10 22:32:31.907696+00:00, run_end_date=2024-05-10 22:32:35.904280+00:00, run_duration=3.996584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:31:00+00:00, data_interval_end=2024-05-10 22:32:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:32:35.914391532Z [2024-05-10T22:32:35.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:32:00+00:00, run_after=2024-05-10T22:33:00+00:00 2024-05-10T22:32:35.939594762Z [2024-05-10T22:32:35.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:31:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:35.945355790Z [2024-05-10T22:32:35.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:31:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:33.684073+00:00, run_end_date=2024-05-10 22:32:34.986678+00:00, run_duration=1.302605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:31.948695+00:00, queued_by_job_id=2, pid=183 2024-05-10T22:32:37.515371977Z [2024-05-10T22:32:37.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:32:37.552350622Z [2024-05-10T22:32:37.552+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:37.552373613Z 2024-05-10T22:32:37.552538610Z [2024-05-10T22:32:37.552+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:32:37.553094482Z [2024-05-10T22:32:37.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:37.553106107Z 2024-05-10T22:32:37.556475534Z [2024-05-10T22:32:37.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:32:37.556703487Z [2024-05-10T22:32:37.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:32:37.604053117Z [2024-05-10T22:32:37.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:37.611187634Z [2024-05-10T22:32:37.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34d3dc81-4c4a-4585-a9f2-7fe6b573ca7b 2024-05-10T22:32:39.833326562Z [2024-05-10T22:32:39.832+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:39.833353527Z 2024-05-10T22:32:39.833368650Z [2024-05-10T22:32:39.833+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:32:39.833965819Z [2024-05-10T22:32:39.833+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:39.833979772Z 2024-05-10T22:32:39.836105699Z [2024-05-10T22:32:39.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:32:39.836202822Z [2024-05-10T22:32:39.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:32:39.975267569Z [2024-05-10T22:32:39.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:39.975582705Z [2024-05-10T22:32:39.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:39.984959624Z [2024-05-10T22:32:39.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83521526-6a60-49e7-88a1-6bd9a5a7edbd 2024-05-10T22:32:39.985635578Z [2024-05-10T22:32:39.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:39.061233+00:00, run_end_date=2024-05-10 22:32:39.398919+00:00, run_duration=0.337686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:37.553821+00:00, queued_by_job_id=2, pid=196 2024-05-10T22:32:42.253980288Z [2024-05-10T22:32:42.252+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:42.254003971Z 2024-05-10T22:32:42.254008036Z [2024-05-10T22:32:42.253+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:32:42.254011568Z [2024-05-10T22:32:42.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:42.254014540Z 2024-05-10T22:32:42.255997869Z [2024-05-10T22:32:42.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:32:42.256128360Z [2024-05-10T22:32:42.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:32:42.303134493Z [2024-05-10T22:32:42.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:42.303157120Z [2024-05-10T22:32:42.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:42.316832841Z [2024-05-10T22:32:42.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to 523458ec-3795-46d8-aa11-c3cef5f775d3 2024-05-10T22:32:42.317009585Z [2024-05-10T22:32:42.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:41.718877+00:00, run_end_date=2024-05-10 22:32:42.054691+00:00, run_duration=0.335814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:39.834301+00:00, queued_by_job_id=2, pid=209 2024-05-10T22:32:44.533217804Z [2024-05-10T22:32:44.532+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:44.533250785Z 2024-05-10T22:32:44.533264588Z [2024-05-10T22:32:44.533+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:32:44.533778627Z [2024-05-10T22:32:44.533+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:44.533792970Z 2024-05-10T22:32:44.535740946Z [2024-05-10T22:32:44.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:32:44.535758410Z [2024-05-10T22:32:44.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:32:44.611370912Z [2024-05-10T22:32:44.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:44.611987599Z [2024-05-10T22:32:44.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:44.619722616Z [2024-05-10T22:32:44.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba04ea3e-e2ca-4f88-9f43-1cb7e1d535ca 2024-05-10T22:32:44.620033323Z [2024-05-10T22:32:44.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=0, run_start_date=2024-05-10 22:32:44.011755+00:00, run_end_date=2024-05-10 22:32:44.385205+00:00, run_duration=0.37345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:42.254177+00:00, queued_by_job_id=2, pid=217 2024-05-10T22:32:46.504741976Z [2024-05-10T22:32:46.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:32:46.505291139Z [2024-05-10T22:32:46.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:25:00+00:00, run_id=scheduled__2024-05-10T22:25:00+00:00, run_start_date=2024-05-10 22:32:37.524039+00:00, run_end_date=2024-05-10 22:32:46.504983+00:00, run_duration=8.980944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:25:00+00:00, data_interval_end=2024-05-10 22:30:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T22:32:46.511353635Z [2024-05-10T22:32:46.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:32:47.629248142Z [2024-05-10T22:32:47.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:47.635200964Z [2024-05-10T22:32:47.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:46.096211+00:00, run_end_date=2024-05-10 22:32:46.414525+00:00, run_duration=0.318314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:44.534063+00:00, queued_by_job_id=2, pid=225 2024-05-10T22:32:52.322970951Z [2024-05-10T22:32:52.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:32:00+00:00, run_after=2024-05-10T22:33:00+00:00 2024-05-10T22:32:52.364152890Z [2024-05-10T22:32:52.363+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:32:52.364180047Z 2024-05-10T22:32:52.364192918Z [2024-05-10T22:32:52.363+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:32:52.364709623Z [2024-05-10T22:32:52.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:32:52.364717555Z 2024-05-10T22:32:52.367251627Z [2024-05-10T22:32:52.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:32:52.367299656Z [2024-05-10T22:32:52.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:32:52.439746990Z [2024-05-10T22:32:52.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:31:00+00:00 exited with status queued for try_number 1 2024-05-10T22:32:52.446524704Z [2024-05-10T22:32:52.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eeb1653-d1b1-4f71-989c-efcdb8599fe5 2024-05-10T22:32:53.605053313Z [2024-05-10T22:32:53.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:32:53.605554553Z [2024-05-10T22:32:53.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:31:00+00:00, run_id=scheduled__2024-05-10T22:31:00+00:00, run_start_date=2024-05-10 22:32:52.332195+00:00, run_end_date=2024-05-10 22:32:53.604958+00:00, run_duration=1.272763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:31:00+00:00, data_interval_end=2024-05-10 22:32:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:32:53.618745210Z [2024-05-10T22:32:53.618+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:32:00+00:00, run_after=2024-05-10T22:33:00+00:00 2024-05-10T22:32:53.646558012Z [2024-05-10T22:32:53.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:31:00+00:00 exited with status success for try_number 1 2024-05-10T22:32:53.652061221Z [2024-05-10T22:32:53.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:31:00+00:00, map_index=-1, run_start_date=2024-05-10 22:32:53.129780+00:00, run_end_date=2024-05-10 22:32:53.498100+00:00, run_duration=0.36832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:32:52.364965+00:00, queued_by_job_id=2, pid=232 2024-05-10T22:33:00.310076682Z [2024-05-10T22:33:00.304+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:33:00.317981571Z [2024-05-10T22:33:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:00.330025086Z [2024-05-10T22:33:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:00.416232837Z [2024-05-10T22:33:00.415+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:33:00.416252015Z 2024-05-10T22:33:00.416255833Z 2024-05-10T22:33:00.416259358Z 2024-05-10T22:33:00.416377650Z [2024-05-10T22:33:00.416+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:33:00.416704181Z [2024-05-10T22:33:00.416+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:33:00.416712527Z [2024-05-10T22:33:00.416+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:33:00.417154023Z [2024-05-10T22:33:00.416+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:00.417159120Z 2024-05-10T22:33:00.417180231Z 2024-05-10T22:33:00.417183556Z 2024-05-10T22:33:00.421323384Z [2024-05-10T22:33:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:00.434487506Z [2024-05-10T22:33:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:33:00.434788314Z [2024-05-10T22:33:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:00.435245958Z [2024-05-10T22:33:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:33:00.435570825Z [2024-05-10T22:33:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:00.435596288Z [2024-05-10T22:33:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:33:01.030087008Z [2024-05-10T22:33:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:01.030097105Z [2024-05-10T22:33:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:01.030100257Z [2024-05-10T22:33:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:01.040150285Z [2024-05-10T22:33:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec8c7fd8-ac94-4f43-915b-ddaf9d848263 2024-05-10T22:33:01.040169301Z [2024-05-10T22:33:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7294b624-ec61-4cca-a9ca-92d241787e50 2024-05-10T22:33:01.040186335Z [2024-05-10T22:33:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17ed4b91-3ae2-4294-93ca-2579925ac813 2024-05-10T22:33:03.423510255Z [2024-05-10T22:33:03.423+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:33:03.494011109Z [2024-05-10T22:33:03.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:03.494022502Z [2024-05-10T22:33:03.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:00.345300+00:00, run_end_date=2024-05-10 22:33:03.482431+00:00, run_duration=3.137131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:33:03.497986435Z [2024-05-10T22:33:03.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:03.585239185Z [2024-05-10T22:33:03.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:03.585260131Z 2024-05-10T22:33:03.585396478Z [2024-05-10T22:33:03.585+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:33:03.586115191Z [2024-05-10T22:33:03.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:03.586127310Z 2024-05-10T22:33:03.588634879Z [2024-05-10T22:33:03.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:03.588836916Z [2024-05-10T22:33:03.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:33:03.707978637Z [2024-05-10T22:33:03.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:03.709466891Z [2024-05-10T22:33:03.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:03.719509798Z [2024-05-10T22:33:03.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:02.152182+00:00, run_end_date=2024-05-10 22:33:02.686754+00:00, run_duration=0.534572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:00.417743+00:00, queued_by_job_id=2, pid=247 2024-05-10T22:33:03.719535457Z [2024-05-10T22:33:03.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b52ed2-9864-42c9-a026-1a8b931c8e54 2024-05-10T22:33:04.646118278Z [2024-05-10T22:33:04.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:04.702723516Z [2024-05-10T22:33:04.702+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:04.702758304Z 2024-05-10T22:33:04.702914516Z [2024-05-10T22:33:04.702+0000] {scheduler_job.py:425} INFO - DAG vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:33:04.703517197Z [2024-05-10T22:33:04.703+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:04.703528208Z 2024-05-10T22:33:04.705445583Z [2024-05-10T22:33:04.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:04.705583977Z [2024-05-10T22:33:04.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:33:04.747770107Z [2024-05-10T22:33:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:04.759121421Z [2024-05-10T22:33:04.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb569ef7-1ecf-40aa-b8d1-a809b948fbb3 2024-05-10T22:33:05.943484189Z [2024-05-10T22:33:05.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:05.944412659Z [2024-05-10T22:33:05.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:00.343236+00:00, run_end_date=2024-05-10 22:33:05.943943+00:00, run_duration=5.600707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:33:05.955106767Z [2024-05-10T22:33:05.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:05.969433146Z [2024-05-10T22:33:05.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:05.969716241Z [2024-05-10T22:33:05.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:00.344990+00:00, run_end_date=2024-05-10 22:33:05.969417+00:00, run_duration=5.624427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:33:05.982683779Z [2024-05-10T22:33:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:06.028346763Z [2024-05-10T22:33:06.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:06.029049741Z [2024-05-10T22:33:06.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:06.052525492Z [2024-05-10T22:33:06.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:03.364769+00:00, run_end_date=2024-05-10 22:33:04.907160+00:00, run_duration=1.542391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:00.417743+00:00, queued_by_job_id=2, pid=265 2024-05-10T22:33:06.052950129Z [2024-05-10T22:33:06.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:03.237327+00:00, run_end_date=2024-05-10 22:33:05.488486+00:00, run_duration=2.251159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:00.417743+00:00, queued_by_job_id=2, pid=264 2024-05-10T22:33:07.758621164Z [2024-05-10T22:33:07.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:07.758780575Z [2024-05-10T22:33:07.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:03.443834+00:00, run_end_date=2024-05-10 22:33:07.758547+00:00, run_duration=4.314713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=0c030b88c1c48ff6a79928506a91a2bb 2024-05-10T22:33:07.768241094Z [2024-05-10T22:33:07.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:07.806655042Z [2024-05-10T22:33:07.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:07.812752554Z [2024-05-10T22:33:07.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:05.436905+00:00, run_end_date=2024-05-10 22:33:07.222629+00:00, run_duration=1.785724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:03.586565+00:00, queued_by_job_id=2, pid=294 2024-05-10T22:33:08.875404070Z [2024-05-10T22:33:08.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:33:08.919246246Z [2024-05-10T22:33:08.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:08.919758865Z [2024-05-10T22:33:08.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:04.656585+00:00, run_end_date=2024-05-10 22:33:08.919179+00:00, run_duration=4.262594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=ce919cf8e811aef77dfb65671aec6397 2024-05-10T22:33:08.932807252Z [2024-05-10T22:33:08.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:08.947703760Z [2024-05-10T22:33:08.947+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:08.947720741Z 2024-05-10T22:33:08.947736079Z [2024-05-10T22:33:08.947+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:33:08.948324360Z [2024-05-10T22:33:08.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:08.948339723Z 2024-05-10T22:33:08.951260574Z [2024-05-10T22:33:08.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:33:08.951351479Z [2024-05-10T22:33:08.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:09.011582747Z [2024-05-10T22:33:09.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:09.012081551Z [2024-05-10T22:33:09.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:09.030422257Z [2024-05-10T22:33:09.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:06.695862+00:00, run_end_date=2024-05-10 22:33:07.998991+00:00, run_duration=1.303129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:04.703854+00:00, queued_by_job_id=2, pid=306 2024-05-10T22:33:09.034263600Z [2024-05-10T22:33:09.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0809d4aa-d28f-4fbf-af32-2a031f90c186 2024-05-10T22:33:11.230502688Z [2024-05-10T22:33:11.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:11.230539021Z 2024-05-10T22:33:11.230547845Z [2024-05-10T22:33:11.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:33:11.230948570Z [2024-05-10T22:33:11.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:11.230967278Z 2024-05-10T22:33:11.232791868Z [2024-05-10T22:33:11.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='split_metrics', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:33:11.232822040Z [2024-05-10T22:33:11.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'split_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:11.274145608Z [2024-05-10T22:33:11.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.split_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:11.275870980Z [2024-05-10T22:33:11.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:11.281158856Z [2024-05-10T22:33:11.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:10.644174+00:00, run_end_date=2024-05-10 22:33:10.957344+00:00, run_duration=0.31317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:08.948650+00:00, queued_by_job_id=2, pid=322 2024-05-10T22:33:11.282110578Z [2024-05-10T22:33:11.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c0e1bd4-3747-4e71-a80e-cc4a509d6eb2 2024-05-10T22:33:13.495798763Z [2024-05-10T22:33:13.495+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:13.495818231Z 2024-05-10T22:33:13.495996920Z [2024-05-10T22:33:13.495+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:33:13.496569559Z [2024-05-10T22:33:13.496+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:13.496575911Z 2024-05-10T22:33:13.498452843Z [2024-05-10T22:33:13.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:33:13.498623834Z [2024-05-10T22:33:13.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'collect_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:33:13.550572191Z [2024-05-10T22:33:13.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.collect_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:13.551259412Z [2024-05-10T22:33:13.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.split_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:13.559606183Z [2024-05-10T22:33:13.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=split_metrics, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:12.937285+00:00, run_end_date=2024-05-10 22:33:13.281142+00:00, run_duration=0.343857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:11.231215+00:00, queued_by_job_id=2, pid=335 2024-05-10T22:33:13.559921289Z [2024-05-10T22:33:13.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f327409-b592-4532-a55d-8d67760abfec 2024-05-10T22:33:15.817755285Z [2024-05-10T22:33:15.817+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:15.817773562Z 2024-05-10T22:33:15.818072015Z [2024-05-10T22:33:15.817+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:33:15.818944590Z [2024-05-10T22:33:15.818+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:15.818967235Z 2024-05-10T22:33:15.821052955Z [2024-05-10T22:33:15.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:15.821361092Z [2024-05-10T22:33:15.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'send_prometheus', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:15.878774979Z [2024-05-10T22:33:15.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.send_prometheus run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:15.878895680Z [2024-05-10T22:33:15.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.collect_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:15.883296859Z [2024-05-10T22:33:15.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9c34d85-be56-4f74-ac70-a9e627bfddd9 2024-05-10T22:33:15.883528955Z [2024-05-10T22:33:15.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=0, run_start_date=2024-05-10 22:33:15.130439+00:00, run_end_date=2024-05-10 22:33:15.450994+00:00, run_duration=0.320555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:13.496929+00:00, queued_by_job_id=2, pid=343 2024-05-10T22:33:19.012537805Z [2024-05-10T22:33:19.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:19.012613311Z [2024-05-10T22:33:19.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, execution_date=2024-05-10 22:25:00+00:00, run_id=scheduled__2024-05-10T22:25:00+00:00, run_start_date=2024-05-10 22:33:08.887294+00:00, run_end_date=2024-05-10 22:33:19.005897+00:00, run_duration=10.118603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:25:00+00:00, data_interval_end=2024-05-10 22:30:00+00:00, dag_hash=3e685b07a0ea56d9146ecaf4ec957045 2024-05-10T22:33:19.019871477Z [2024-05-10T22:33:19.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:33:19.053354882Z [2024-05-10T22:33:19.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.send_prometheus run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:19.059585004Z [2024-05-10T22:33:19.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:17.567049+00:00, run_end_date=2024-05-10 22:33:17.953416+00:00, run_duration=0.386367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:15.819312+00:00, queued_by_job_id=2, pid=351 2024-05-10T22:33:34.877028821Z [2024-05-10T22:33:34.876+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:33:34.930021725Z [2024-05-10T22:33:34.929+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:34.930045573Z 2024-05-10T22:33:34.930049347Z [2024-05-10T22:33:34.929+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:33:34.931485219Z [2024-05-10T22:33:34.930+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:34.931493039Z 2024-05-10T22:33:34.932464952Z [2024-05-10T22:33:34.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:34.932569390Z [2024-05-10T22:33:34.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:33:34.990180742Z [2024-05-10T22:33:34.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:34.996844995Z [2024-05-10T22:33:34.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e9e45ac-733f-4c17-966b-367c9015e899 2024-05-10T22:33:36.113297182Z [2024-05-10T22:33:36.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:36.152232842Z [2024-05-10T22:33:36.151+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:36.152275232Z 2024-05-10T22:33:36.152413299Z [2024-05-10T22:33:36.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:33:36.153773794Z [2024-05-10T22:33:36.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:36.153783520Z 2024-05-10T22:33:36.159079111Z [2024-05-10T22:33:36.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:36.159848716Z [2024-05-10T22:33:36.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:33:36.210050032Z [2024-05-10T22:33:36.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:36.215062104Z [2024-05-10T22:33:36.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ca738b1-7f63-4ed7-9d3e-8fe834ad6b31 2024-05-10T22:33:39.141554947Z [2024-05-10T22:33:39.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:39.141808508Z [2024-05-10T22:33:39.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:36.121545+00:00, run_end_date=2024-05-10 22:33:39.141512+00:00, run_duration=3.019967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=e91c14597a26dfb504bdef55399898ec 2024-05-10T22:33:39.151149736Z [2024-05-10T22:33:39.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:39.181912488Z [2024-05-10T22:33:39.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:39.187587864Z [2024-05-10T22:33:39.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:37.786984+00:00, run_end_date=2024-05-10 22:33:38.952533+00:00, run_duration=1.165549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:36.154656+00:00, queued_by_job_id=2, pid=372 2024-05-10T22:33:40.252942203Z [2024-05-10T22:33:40.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:33:40.298913945Z [2024-05-10T22:33:40.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:40.299081380Z [2024-05-10T22:33:40.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:33:34.887399+00:00, run_end_date=2024-05-10 22:33:40.298799+00:00, run_duration=5.4114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:33:00+00:00, dag_hash=c30663e5f9a5776de9fefb1a0d111eba 2024-05-10T22:33:40.338939643Z [2024-05-10T22:33:40.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:33:00+00:00, run_after=2024-05-10T22:34:00+00:00 2024-05-10T22:33:40.351091413Z [2024-05-10T22:33:40.350+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:40.351132181Z 2024-05-10T22:33:40.351142129Z [2024-05-10T22:33:40.350+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:33:40.351494062Z [2024-05-10T22:33:40.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:40.351506998Z 2024-05-10T22:33:40.353423782Z [2024-05-10T22:33:40.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:33:40.353444998Z [2024-05-10T22:33:40.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:40.395885704Z [2024-05-10T22:33:40.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:40.396150662Z [2024-05-10T22:33:40.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:40.403550929Z [2024-05-10T22:33:40.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:36.545285+00:00, run_end_date=2024-05-10 22:33:39.196890+00:00, run_duration=2.651605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:34.930651+00:00, queued_by_job_id=2, pid=360 2024-05-10T22:33:40.403739889Z [2024-05-10T22:33:40.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcfb5e46-3019-42d6-9b60-898f1b0b725c 2024-05-10T22:33:42.859782117Z [2024-05-10T22:33:42.859+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:42.859839681Z 2024-05-10T22:33:42.859855558Z [2024-05-10T22:33:42.859+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:33:42.860762380Z [2024-05-10T22:33:42.860+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:42.860787483Z 2024-05-10T22:33:42.864125263Z [2024-05-10T22:33:42.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='split_metrics', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:33:42.864185162Z [2024-05-10T22:33:42.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'split_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:42.922623974Z [2024-05-10T22:33:42.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.split_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:42.922687544Z [2024-05-10T22:33:42.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:42.928934153Z [2024-05-10T22:33:42.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:41.926799+00:00, run_end_date=2024-05-10 22:33:42.274146+00:00, run_duration=0.347347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:40.351681+00:00, queued_by_job_id=2, pid=385 2024-05-10T22:33:42.929046733Z [2024-05-10T22:33:42.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8165dd25-0659-450f-8b78-2a79eeb26da4 2024-05-10T22:33:45.163625787Z [2024-05-10T22:33:45.163+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:45.163657018Z 2024-05-10T22:33:45.163660816Z [2024-05-10T22:33:45.163+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:33:45.164181107Z [2024-05-10T22:33:45.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:45.164192425Z 2024-05-10T22:33:45.166033379Z [2024-05-10T22:33:45.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:33:45.166122376Z [2024-05-10T22:33:45.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'collect_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:33:45.208938650Z [2024-05-10T22:33:45.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.collect_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:45.209029148Z [2024-05-10T22:33:45.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.split_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:45.214724943Z [2024-05-10T22:33:45.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=split_metrics, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:44.460231+00:00, run_end_date=2024-05-10 22:33:44.839831+00:00, run_duration=0.3796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:42.861351+00:00, queued_by_job_id=2, pid=398 2024-05-10T22:33:45.214815326Z [2024-05-10T22:33:45.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b8f5a1b-465d-4dd1-bdff-208c5018f0b0 2024-05-10T22:33:47.079355373Z [2024-05-10T22:33:47.078+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:33:47.079394429Z 2024-05-10T22:33:47.079415887Z [2024-05-10T22:33:47.079+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:33:47.080054633Z [2024-05-10T22:33:47.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:33:47.080071575Z 2024-05-10T22:33:47.082551267Z [2024-05-10T22:33:47.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:33:47.082821193Z [2024-05-10T22:33:47.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'send_prometheus', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:47.148278500Z [2024-05-10T22:33:47.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.send_prometheus run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status queued for try_number 1 2024-05-10T22:33:47.154300572Z [2024-05-10T22:33:47.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7085980f-23c3-4f31-abaf-c73eb52d9867 2024-05-10T22:33:47.250887723Z [2024-05-10T22:33:47.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.collect_metrics run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:47.257591906Z [2024-05-10T22:33:47.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=0, run_start_date=2024-05-10 22:33:46.698433+00:00, run_end_date=2024-05-10 22:33:47.035540+00:00, run_duration=0.337107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:45.164354+00:00, queued_by_job_id=2, pid=406 2024-05-10T22:33:49.379058852Z [2024-05-10T22:33:49.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:33:49.379437502Z [2024-05-10T22:33:49.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:25:00+00:00, run_id=scheduled__2024-05-10T22:25:00+00:00, run_start_date=2024-05-10 22:33:40.263051+00:00, run_end_date=2024-05-10 22:33:49.378873+00:00, run_duration=9.115822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:25:00+00:00, data_interval_end=2024-05-10 22:30:00+00:00, dag_hash=379c796f8877b58f7f1a5de95faf9c88 2024-05-10T22:33:49.390497316Z [2024-05-10T22:33:49.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:30:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:33:49.431754058Z [2024-05-10T22:33:49.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.send_prometheus run_id=scheduled__2024-05-10T22:25:00+00:00 exited with status success for try_number 1 2024-05-10T22:33:49.436932820Z [2024-05-10T22:33:49.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:25:00+00:00, map_index=-1, run_start_date=2024-05-10 22:33:48.580927+00:00, run_end_date=2024-05-10 22:33:48.917356+00:00, run_duration=0.336429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:33:47.080380+00:00, queued_by_job_id=2, pid=414 2024-05-10T22:34:00.369567328Z [2024-05-10T22:34:00.369+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:34:00.381550746Z [2024-05-10T22:34:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:00.393911635Z [2024-05-10T22:34:00.393+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:00.401205855Z [2024-05-10T22:34:00.400+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:34:00.413016851Z [2024-05-10T22:34:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:00.420000614Z [2024-05-10T22:34:00.419+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:34:00.425701525Z [2024-05-10T22:34:00.425+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:34:00.437677552Z [2024-05-10T22:34:00.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:00.552951214Z [2024-05-10T22:34:00.552+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-10T22:34:00.552983333Z 2024-05-10T22:34:00.553011632Z 2024-05-10T22:34:00.553017638Z 2024-05-10T22:34:00.553023241Z 2024-05-10T22:34:00.553028760Z 2024-05-10T22:34:00.553034740Z 2024-05-10T22:34:00.553040507Z 2024-05-10T22:34:00.553046093Z 2024-05-10T22:34:00.553125392Z [2024-05-10T22:34:00.552+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:34:00.553454533Z [2024-05-10T22:34:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:34:00.553627151Z [2024-05-10T22:34:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:34:00.553885775Z [2024-05-10T22:34:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:34:00.553975928Z [2024-05-10T22:34:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:34:00.554220362Z [2024-05-10T22:34:00.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:34:00.554553913Z [2024-05-10T22:34:00.554+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:34:00.554758137Z [2024-05-10T22:34:00.554+0000] {scheduler_job.py:425} INFO - DAG vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:34:00.555480685Z [2024-05-10T22:34:00.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:34:00.555492466Z 2024-05-10T22:34:00.555496361Z 2024-05-10T22:34:00.555499680Z 2024-05-10T22:34:00.555502903Z 2024-05-10T22:34:00.555506570Z 2024-05-10T22:34:00.555509706Z 2024-05-10T22:34:00.555534237Z 2024-05-10T22:34:00.555537496Z 2024-05-10T22:34:00.562795886Z [2024-05-10T22:34:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.563039594Z [2024-05-10T22:34:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:34:00.563355018Z [2024-05-10T22:34:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.563569920Z [2024-05-10T22:34:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:00.563873042Z [2024-05-10T22:34:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.564088192Z [2024-05-10T22:34:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:00.564417098Z [2024-05-10T22:34:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.564645450Z [2024-05-10T22:34:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:00.564998886Z [2024-05-10T22:34:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.565210503Z [2024-05-10T22:34:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:34:00.565514463Z [2024-05-10T22:34:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.565720028Z [2024-05-10T22:34:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:00.566047617Z [2024-05-10T22:34:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.566233519Z [2024-05-10T22:34:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:00.566534621Z [2024-05-10T22:34:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:00.566737465Z [2024-05-10T22:34:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:01.599140888Z [2024-05-10T22:34:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.599376101Z [2024-05-10T22:34:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.599580112Z [2024-05-10T22:34:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.599754483Z [2024-05-10T22:34:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.599967193Z [2024-05-10T22:34:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.600142026Z [2024-05-10T22:34:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.600316884Z [2024-05-10T22:34:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.600483118Z [2024-05-10T22:34:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 1 2024-05-10T22:34:01.639506149Z [2024-05-10T22:34:01.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d97ec12-da25-4e8c-a75a-2194df8fb27b 2024-05-10T22:34:01.640524765Z [2024-05-10T22:34:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5f12e53-5576-413c-9c36-cd1fac8d9863 2024-05-10T22:34:01.640790102Z [2024-05-10T22:34:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b577dfb-28d2-457b-8b56-634d7d9dae98 2024-05-10T22:34:01.641056583Z [2024-05-10T22:34:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to abafafb4-d869-4a65-bfcc-0273ff4f3387 2024-05-10T22:34:01.641610284Z [2024-05-10T22:34:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1103136d-dedf-4ca3-bf0a-341b7ebc7e15 2024-05-10T22:34:01.641853720Z [2024-05-10T22:34:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1d07de4-3b05-49b9-9038-af552b9967de 2024-05-10T22:34:01.642209755Z [2024-05-10T22:34:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67a4dcea-b54e-4091-a228-f849b7dc098e 2024-05-10T22:34:01.642445504Z [2024-05-10T22:34:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to e32d4655-3880-4d09-be17-245081281586 2024-05-10T22:34:03.460450233Z [2024-05-10T22:34:03.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 1 2024-05-10T22:34:03.468600990Z [2024-05-10T22:34:03.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:03.469137261Z [2024-05-10T22:34:03.468+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:03.471286759Z [2024-05-10T22:34:03.471+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:03.518024305Z [2024-05-10T22:34:03.509+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223403 2024-05-10T22:34:04.573459074Z [2024-05-10T22:34:04.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:34:04.573716016Z [2024-05-10T22:34:04.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:32:00+00:00, run_id=scheduled__2024-05-10T22:32:00+00:00, run_start_date=2024-05-10 22:34:00.449400+00:00, run_end_date=2024-05-10 22:34:04.573377+00:00, run_duration=4.123977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:32:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:34:04.581785518Z [2024-05-10T22:34:04.581+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:34:04.596457000Z [2024-05-10T22:34:04.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:34:04.596619905Z [2024-05-10T22:34:04.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.457559+00:00, run_end_date=2024-05-10 22:34:04.596387+00:00, run_duration=4.138828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:34:04.606988838Z [2024-05-10T22:34:04.606+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:04.689394445Z [2024-05-10T22:34:04.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:32:00+00:00 exited with status success for try_number 1 2024-05-10T22:34:04.689603593Z [2024-05-10T22:34:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 1 2024-05-10T22:34:04.689725181Z [2024-05-10T22:34:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status success for try_number 1 2024-05-10T22:34:04.689828954Z [2024-05-10T22:34:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 1 2024-05-10T22:34:04.689964150Z [2024-05-10T22:34:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 1 2024-05-10T22:34:04.703484728Z [2024-05-10T22:34:04.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:32:00+00:00, map_index=-1, run_start_date=2024-05-10 22:34:02.940041+00:00, run_end_date=2024-05-10 22:34:03.764911+00:00, run_duration=0.82487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=433 2024-05-10T22:34:04.703626118Z [2024-05-10T22:34:04.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=2024-05-10 22:34:02.815178+00:00, run_end_date=2024-05-10 22:34:03.646818+00:00, run_duration=0.83164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=432 2024-05-10T22:34:04.703765990Z [2024-05-10T22:34:04.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:04.704139409Z [2024-05-10T22:34:04.703+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:04.707012628Z [2024-05-10T22:34:04.706+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:04.723985052Z [2024-05-10T22:34:04.723+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223404 2024-05-10T22:34:04.733129095Z [2024-05-10T22:34:04.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:04.733439546Z [2024-05-10T22:34:04.733+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:04.738543944Z [2024-05-10T22:34:04.738+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:04.765163655Z [2024-05-10T22:34:04.764+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223404 2024-05-10T22:34:04.774751233Z [2024-05-10T22:34:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:04.775058427Z [2024-05-10T22:34:04.774+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:04.777776795Z [2024-05-10T22:34:04.777+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:04.789855543Z [2024-05-10T22:34:04.789+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223404 2024-05-10T22:34:06.238669977Z [2024-05-10T22:34:06.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:34:06.238890251Z [2024-05-10T22:34:06.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.460249+00:00, run_end_date=2024-05-10 22:34:06.238579+00:00, run_duration=5.77833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:34:06.248393850Z [2024-05-10T22:34:06.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:06.347458500Z [2024-05-10T22:34:06.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status success for try_number 1 2024-05-10T22:34:06.353377701Z [2024-05-10T22:34:06.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=2024-05-10 22:34:04.293801+00:00, run_end_date=2024-05-10 22:34:05.571014+00:00, run_duration=1.277213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=482 2024-05-10T22:34:07.272417234Z [2024-05-10T22:34:07.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:34:07.273195363Z [2024-05-10T22:34:07.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.452029+00:00, run_end_date=2024-05-10 22:34:07.272340+00:00, run_duration=6.820311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:34:07.289186747Z [2024-05-10T22:34:07.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:07.363594519Z [2024-05-10T22:34:07.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status success for try_number 1 2024-05-10T22:34:07.375330621Z [2024-05-10T22:34:07.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=2024-05-10 22:34:04.252737+00:00, run_end_date=2024-05-10 22:34:06.917571+00:00, run_duration=2.664834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:00.557129+00:00, queued_by_job_id=2, pid=478 2024-05-10T22:34:13.604767475Z [2024-05-10T22:34:13.604+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:34:13.604853525Z 2024-05-10T22:34:13.604865494Z [2024-05-10T22:34:13.604+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:34:13.605253103Z [2024-05-10T22:34:13.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:34:13.605276289Z 2024-05-10T22:34:13.607340173Z [2024-05-10T22:34:13.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:13.607392235Z [2024-05-10T22:34:13.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:13.668624652Z [2024-05-10T22:34:13.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 2 2024-05-10T22:34:13.675406250Z [2024-05-10T22:34:13.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3cc9500-5cce-4ec0-9660-a608720fe451 2024-05-10T22:34:14.903172529Z [2024-05-10T22:34:14.902+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:34:14.903218547Z 2024-05-10T22:34:14.903228083Z 2024-05-10T22:34:14.903236560Z 2024-05-10T22:34:14.903397462Z [2024-05-10T22:34:14.902+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:34:14.903570797Z [2024-05-10T22:34:14.903+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:34:14.903689627Z [2024-05-10T22:34:14.903+0000] {scheduler_job.py:425} INFO - DAG vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 has 0/16 running and queued tasks 2024-05-10T22:34:14.904453029Z [2024-05-10T22:34:14.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:34:14.904465346Z 2024-05-10T22:34:14.904468984Z 2024-05-10T22:34:14.904472390Z 2024-05-10T22:34:14.908220022Z [2024-05-10T22:34:14.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:14.908563709Z [2024-05-10T22:34:14.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:14.908932469Z [2024-05-10T22:34:14.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:14.909134097Z [2024-05-10T22:34:14.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:14.909429697Z [2024-05-10T22:34:14.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:34:14.909613603Z [2024-05-10T22:34:14.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:15.179722182Z [2024-05-10T22:34:15.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 2 2024-05-10T22:34:15.180075918Z [2024-05-10T22:34:15.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 2 2024-05-10T22:34:15.180306336Z [2024-05-10T22:34:15.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status queued for try_number 2 2024-05-10T22:34:15.180557075Z [2024-05-10T22:34:15.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 2 2024-05-10T22:34:15.197592202Z [2024-05-10T22:34:15.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:34:03.477916+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:13.605497+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:15.198470900Z [2024-05-10T22:34:15.198+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:15.200852536Z [2024-05-10T22:34:15.200+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:15.225319267Z [2024-05-10T22:34:15.224+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223415 2024-05-10T22:34:15.236978073Z [2024-05-10T22:34:15.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to fce308f5-f9de-4b76-ad09-ca9f917df794 2024-05-10T22:34:15.237206116Z [2024-05-10T22:34:15.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 396da22f-0e2a-4beb-bfdd-588cc2f0dd1b 2024-05-10T22:34:15.237376264Z [2024-05-10T22:34:15.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bf8bab4-fa9f-499f-9234-d225a5335ddd 2024-05-10T22:34:15.280810196Z [2024-05-10T22:34:15.280+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:34:15.281443848Z [2024-05-10T22:34:15.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.456095+00:00, run_end_date=2024-05-10 22:34:15.280843+00:00, run_duration=14.824748, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=e91c14597a26dfb504bdef55399898ec 2024-05-10T22:34:15.290740244Z [2024-05-10T22:34:15.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:17.477255433Z [2024-05-10T22:34:17.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 2 2024-05-10T22:34:17.477300005Z [2024-05-10T22:34:17.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 2 2024-05-10T22:34:17.477457814Z [2024-05-10T22:34:17.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:33:00+00:00 exited with status failed for try_number 2 2024-05-10T22:34:17.484217779Z [2024-05-10T22:34:17.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:34:04.710029+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:14.905178+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:17.484633389Z [2024-05-10T22:34:17.484+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:17.487103705Z [2024-05-10T22:34:17.486+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:17.499061023Z [2024-05-10T22:34:17.498+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223417 2024-05-10T22:34:17.505783178Z [2024-05-10T22:34:17.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:34:04.741655+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:14.905178+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:17.506185107Z [2024-05-10T22:34:17.505+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:17.508107339Z [2024-05-10T22:34:17.507+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:17.518487808Z [2024-05-10T22:34:17.518+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223417 2024-05-10T22:34:17.524953803Z [2024-05-10T22:34:17.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:34:04.779759+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:34:14.905178+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:34:17.525315861Z [2024-05-10T22:34:17.525+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:17.527429368Z [2024-05-10T22:34:17.527+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:34:17.539478036Z [2024-05-10T22:34:17.539+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T223300, start_date=, end_date=20240510T223417 2024-05-10T22:34:18.613340163Z [2024-05-10T22:34:18.612+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:34:18.614002191Z [2024-05-10T22:34:18.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.454434+00:00, run_end_date=2024-05-10 22:34:18.613203+00:00, run_duration=18.158769, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=c30663e5f9a5776de9fefb1a0d111eba 2024-05-10T22:34:18.633477405Z [2024-05-10T22:34:18.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:18.642654304Z [2024-05-10T22:34:18.642+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:34:18.643020527Z [2024-05-10T22:34:18.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.458933+00:00, run_end_date=2024-05-10 22:34:18.642546+00:00, run_duration=18.183613, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=0c030b88c1c48ff6a79928506a91a2bb 2024-05-10T22:34:18.653633742Z [2024-05-10T22:34:18.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:34:18.661631084Z [2024-05-10T22:34:18.661+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:34:18.661894060Z [2024-05-10T22:34:18.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27, execution_date=2024-05-10 22:33:00+00:00, run_id=scheduled__2024-05-10T22:33:00+00:00, run_start_date=2024-05-10 22:34:00.461507+00:00, run_end_date=2024-05-10 22:34:18.661557+00:00, run_duration=18.20005, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:33:00+00:00, data_interval_end=2024-05-10 22:34:00+00:00, dag_hash=ce919cf8e811aef77dfb65671aec6397 2024-05-10T22:34:18.671728423Z [2024-05-10T22:34:18.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 to 2024-05-10T22:34:00+00:00, run_after=2024-05-10T22:35:00+00:00 2024-05-10T22:35:00.267260697Z [2024-05-10T22:35:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:35:00.276300034Z [2024-05-10T22:35:00.275+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:35:00.294717051Z [2024-05-10T22:35:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:00.304916182Z [2024-05-10T22:35:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:00.318087235Z [2024-05-10T22:35:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:35:00.330823814Z [2024-05-10T22:35:00.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:35:00.341487270Z [2024-05-10T22:35:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:00.489108480Z [2024-05-10T22:35:00.488+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-05-10T22:35:00.489133901Z 2024-05-10T22:35:00.489155010Z 2024-05-10T22:35:00.489159911Z 2024-05-10T22:35:00.489169087Z 2024-05-10T22:35:00.489173038Z 2024-05-10T22:35:00.489177068Z 2024-05-10T22:35:00.489180732Z 2024-05-10T22:35:00.489382002Z [2024-05-10T22:35:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:35:00.489622870Z [2024-05-10T22:35:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:35:00.489824858Z [2024-05-10T22:35:00.489+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:35:00.489993927Z [2024-05-10T22:35:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:35:00.490190713Z [2024-05-10T22:35:00.490+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:35:00.490339554Z [2024-05-10T22:35:00.490+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:35:00.490517158Z [2024-05-10T22:35:00.490+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:35:00.491250355Z [2024-05-10T22:35:00.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:35:00.491263840Z 2024-05-10T22:35:00.491267830Z 2024-05-10T22:35:00.491272083Z 2024-05-10T22:35:00.491275640Z 2024-05-10T22:35:00.491279504Z 2024-05-10T22:35:00.491283159Z 2024-05-10T22:35:00.491286878Z 2024-05-10T22:35:00.497647054Z [2024-05-10T22:35:00.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:35:00.497674143Z [2024-05-10T22:35:00.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:00.497834263Z [2024-05-10T22:35:00.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:35:00.498053888Z [2024-05-10T22:35:00.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:00.498296391Z [2024-05-10T22:35:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:00.498405499Z [2024-05-10T22:35:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:35:00.498537551Z [2024-05-10T22:35:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:00.498634348Z [2024-05-10T22:35:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:35:00.498785087Z [2024-05-10T22:35:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:00.498889550Z [2024-05-10T22:35:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:35:00.499080052Z [2024-05-10T22:35:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:00.499258547Z [2024-05-10T22:35:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:35:00.499533807Z [2024-05-10T22:35:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:00.499716794Z [2024-05-10T22:35:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:35:01.335131051Z [2024-05-10T22:35:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.335416076Z [2024-05-10T22:35:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.335584727Z [2024-05-10T22:35:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.335735743Z [2024-05-10T22:35:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.335906304Z [2024-05-10T22:35:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.336051495Z [2024-05-10T22:35:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.336179153Z [2024-05-10T22:35:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:01.358524454Z [2024-05-10T22:35:01.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to de2a4431-2384-4cea-8d47-6e1d01d998d1 2024-05-10T22:35:01.358904345Z [2024-05-10T22:35:01.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to 130a47d2-d94e-41a9-9a2d-a27f8971ff39 2024-05-10T22:35:01.359198145Z [2024-05-10T22:35:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 203db765-b9d3-45a4-a8e3-dbed619e7dd8 2024-05-10T22:35:01.359379881Z [2024-05-10T22:35:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed31ebd-4703-4cb8-87a1-abea56e1181e 2024-05-10T22:35:01.359604788Z [2024-05-10T22:35:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to c117586b-2e67-4e1d-869d-18b76d8d749d 2024-05-10T22:35:01.359880040Z [2024-05-10T22:35:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to e46a6bf2-edc7-4793-855c-f913448e6fe3 2024-05-10T22:35:01.360149831Z [2024-05-10T22:35:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to cffe1d46-c5ef-460a-9410-49d709604360 2024-05-10T22:35:03.259546575Z [2024-05-10T22:35:03.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:35:03.259968517Z [2024-05-10T22:35:03.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:34:00+00:00, run_id=scheduled__2024-05-10T22:34:00+00:00, run_start_date=2024-05-10 22:35:00.364912+00:00, run_end_date=2024-05-10 22:35:03.259426+00:00, run_duration=2.894514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:34:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:35:03.273482624Z [2024-05-10T22:35:03.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:03.470205495Z [2024-05-10T22:35:03.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:03.478486775Z [2024-05-10T22:35:03.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=2024-05-10 22:35:02.491697+00:00, run_end_date=2024-05-10 22:35:03.062791+00:00, run_duration=0.571094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=584 2024-05-10T22:35:04.632838064Z [2024-05-10T22:35:04.632+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:35:04.632869328Z 2024-05-10T22:35:04.633035888Z [2024-05-10T22:35:04.632+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:35:04.633661075Z [2024-05-10T22:35:04.633+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:35:04.633672626Z 2024-05-10T22:35:04.636015652Z [2024-05-10T22:35:04.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:35:04.636231393Z [2024-05-10T22:35:04.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:04.692205036Z [2024-05-10T22:35:04.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:04.692269882Z [2024-05-10T22:35:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status failed for try_number 1 2024-05-10T22:35:04.692401101Z [2024-05-10T22:35:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:04.692484981Z [2024-05-10T22:35:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status failed for try_number 1 2024-05-10T22:35:04.692591221Z [2024-05-10T22:35:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status failed for try_number 1 2024-05-10T22:35:04.705824068Z [2024-05-10T22:35:04.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:35:04.706347253Z [2024-05-10T22:35:04.706+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:04.708628878Z [2024-05-10T22:35:04.708+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:04.722545228Z [2024-05-10T22:35:04.722+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T223400, start_date=, end_date=20240510T223504 2024-05-10T22:35:04.730483712Z [2024-05-10T22:35:04.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to b66c4713-fbe2-4220-a577-2125cd586744 2024-05-10T22:35:04.730661290Z [2024-05-10T22:35:04.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=-1, run_start_date=2024-05-10 22:35:03.646704+00:00, run_end_date=2024-05-10 22:35:04.039003+00:00, run_duration=0.392299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=624 2024-05-10T22:35:04.730859205Z [2024-05-10T22:35:04.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:35:04.731206474Z [2024-05-10T22:35:04.731+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:04.733267720Z [2024-05-10T22:35:04.732+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:04.742760042Z [2024-05-10T22:35:04.742+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=extract_metrics_from_vnfrs, execution_date=20240510T223000, start_date=, end_date=20240510T223504 2024-05-10T22:35:04.749807015Z [2024-05-10T22:35:04.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:35:04.750277976Z [2024-05-10T22:35:04.749+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:04.752563052Z [2024-05-10T22:35:04.752+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:04.764311130Z [2024-05-10T22:35:04.763+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T223400, start_date=, end_date=20240510T223504 2024-05-10T22:35:05.427888576Z [2024-05-10T22:35:05.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:35:05.428085069Z [2024-05-10T22:35:05.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:34:00+00:00, run_id=scheduled__2024-05-10T22:34:00+00:00, run_start_date=2024-05-10 22:35:00.362613+00:00, run_end_date=2024-05-10 22:35:05.427816+00:00, run_duration=5.065203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:34:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:35:05.436328983Z [2024-05-10T22:35:05.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:05.443898131Z [2024-05-10T22:35:05.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:35:05.444041558Z [2024-05-10T22:35:05.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:34:00+00:00, run_id=scheduled__2024-05-10T22:34:00+00:00, run_start_date=2024-05-10 22:35:00.361422+00:00, run_end_date=2024-05-10 22:35:05.443770+00:00, run_duration=5.082348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:34:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:35:05.455038255Z [2024-05-10T22:35:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:05.562779676Z [2024-05-10T22:35:05.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:05.568738620Z [2024-05-10T22:35:05.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=2024-05-10 22:35:03.392914+00:00, run_end_date=2024-05-10 22:35:05.088391+00:00, run_duration=1.695477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=608 2024-05-10T22:35:06.669552753Z [2024-05-10T22:35:06.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:06.674050145Z [2024-05-10T22:35:06.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=2024-05-10 22:35:04.156472+00:00, run_end_date=2024-05-10 22:35:05.383778+00:00, run_duration=1.227306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:00.493307+00:00, queued_by_job_id=2, pid=650 2024-05-10T22:35:07.766940236Z [2024-05-10T22:35:07.766+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:35:07.766979644Z 2024-05-10T22:35:07.767028527Z [2024-05-10T22:35:07.766+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:35:07.767366563Z [2024-05-10T22:35:07.767+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:35:07.767411781Z 2024-05-10T22:35:07.769339825Z [2024-05-10T22:35:07.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:35:07.769408168Z [2024-05-10T22:35:07.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:35:07.851441522Z [2024-05-10T22:35:07.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:07.851576948Z [2024-05-10T22:35:07.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:07.860956946Z [2024-05-10T22:35:07.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=-1, run_start_date=2024-05-10 22:35:06.195559+00:00, run_end_date=2024-05-10 22:35:06.543987+00:00, run_duration=0.348428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:04.634031+00:00, queued_by_job_id=2, pid=672 2024-05-10T22:35:07.861588509Z [2024-05-10T22:35:07.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07172466-32da-4d5c-9ab3-d7e854b6acc6 2024-05-10T22:35:09.750115894Z [2024-05-10T22:35:09.749+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:35:09.750139937Z 2024-05-10T22:35:09.750204342Z [2024-05-10T22:35:09.749+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:35:09.750820659Z [2024-05-10T22:35:09.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:35:09.750833429Z 2024-05-10T22:35:09.752816260Z [2024-05-10T22:35:09.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:09.753074645Z [2024-05-10T22:35:09.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:09.806016688Z [2024-05-10T22:35:09.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 1 2024-05-10T22:35:09.806045161Z [2024-05-10T22:35:09.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:09.814637460Z [2024-05-10T22:35:09.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=0, run_start_date=2024-05-10 22:35:09.262229+00:00, run_end_date=2024-05-10 22:35:09.582059+00:00, run_duration=0.31983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:07.767582+00:00, queued_by_job_id=2, pid=683 2024-05-10T22:35:09.814674354Z [2024-05-10T22:35:09.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to be85ca14-87f6-4469-ad56-b6cc0b54e789 2024-05-10T22:35:12.080363492Z [2024-05-10T22:35:12.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:35:12.080573307Z [2024-05-10T22:35:12.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:30:00+00:00, run_id=scheduled__2024-05-10T22:30:00+00:00, run_start_date=2024-05-10 22:35:00.360117+00:00, run_end_date=2024-05-10 22:35:12.080208+00:00, run_duration=11.720091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:30:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T22:35:12.096395142Z [2024-05-10T22:35:12.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:35:12.193394533Z [2024-05-10T22:35:12.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status success for try_number 1 2024-05-10T22:35:12.198407393Z [2024-05-10T22:35:12.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=-1, run_start_date=2024-05-10 22:35:11.289086+00:00, run_end_date=2024-05-10 22:35:11.633273+00:00, run_duration=0.344187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:09.751203+00:00, queued_by_job_id=2, pid=691 2024-05-10T22:35:14.871493731Z [2024-05-10T22:35:14.871+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:35:14.871531553Z 2024-05-10T22:35:14.871536225Z 2024-05-10T22:35:14.871554082Z 2024-05-10T22:35:14.871863746Z [2024-05-10T22:35:14.871+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:35:14.871926499Z [2024-05-10T22:35:14.871+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:35:14.871947697Z [2024-05-10T22:35:14.871+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 has 0/16 running and queued tasks 2024-05-10T22:35:14.872549265Z [2024-05-10T22:35:14.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:35:14.872580118Z 2024-05-10T22:35:14.872591001Z 2024-05-10T22:35:14.872599392Z 2024-05-10T22:35:14.875738550Z [2024-05-10T22:35:14.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:30:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:35:14.875775794Z [2024-05-10T22:35:14.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:14.875983509Z [2024-05-10T22:35:14.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:14.876055619Z [2024-05-10T22:35:14.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:35:14.876469366Z [2024-05-10T22:35:14.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:35:14.876498271Z [2024-05-10T22:35:14.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:35:15.065932636Z [2024-05-10T22:35:15.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status queued for try_number 2 2024-05-10T22:35:15.066215483Z [2024-05-10T22:35:15.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 2 2024-05-10T22:35:15.066461692Z [2024-05-10T22:35:15.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 2 2024-05-10T22:35:15.082772157Z [2024-05-10T22:35:15.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c9edb97-41bd-498c-b5b8-09b27d50f46d 2024-05-10T22:35:15.083268031Z [2024-05-10T22:35:15.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b6e3829-f4a4-4b9b-b269-9a7812ba48fb 2024-05-10T22:35:15.083543455Z [2024-05-10T22:35:15.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54b829ea-ca32-490c-96e6-07b9fc59767d 2024-05-10T22:35:17.478003503Z [2024-05-10T22:35:17.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:30:00+00:00 exited with status failed for try_number 2 2024-05-10T22:35:17.478050051Z [2024-05-10T22:35:17.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status failed for try_number 2 2024-05-10T22:35:17.478058592Z [2024-05-10T22:35:17.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status failed for try_number 2 2024-05-10T22:35:17.490168035Z [2024-05-10T22:35:17.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:35:04.710845+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:14.873320+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:35:17.491129846Z [2024-05-10T22:35:17.490+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:17.494389474Z [2024-05-10T22:35:17.494+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:17.507378490Z [2024-05-10T22:35:17.507+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T223400, start_date=, end_date=20240510T223517 2024-05-10T22:35:17.514916179Z [2024-05-10T22:35:17.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:35:04.735099+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:14.873320+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:35:17.515365943Z [2024-05-10T22:35:17.515+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:17.517534241Z [2024-05-10T22:35:17.517+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:17.527894601Z [2024-05-10T22:35:17.527+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=extract_metrics_from_vnfrs, execution_date=20240510T223000, start_date=, end_date=20240510T223517 2024-05-10T22:35:17.536233917Z [2024-05-10T22:35:17.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:35:04.754529+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:35:14.873320+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:35:17.536658359Z [2024-05-10T22:35:17.536+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:17.538990664Z [2024-05-10T22:35:17.538+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:35:17.563773963Z [2024-05-10T22:35:17.563+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T223400, start_date=, end_date=20240510T223517 2024-05-10T22:35:17.932270273Z [2024-05-10T22:35:17.931+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:35:17.932695124Z [2024-05-10T22:35:17.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:34:00+00:00, run_id=scheduled__2024-05-10T22:34:00+00:00, run_start_date=2024-05-10 22:35:00.363740+00:00, run_end_date=2024-05-10 22:35:17.932075+00:00, run_duration=17.568335, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:34:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=e91c14597a26dfb504bdef55399898ec 2024-05-10T22:35:17.943079295Z [2024-05-10T22:35:17.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:17.948586969Z [2024-05-10T22:35:17.948+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:35:17.948960645Z [2024-05-10T22:35:17.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:34:00+00:00, run_id=scheduled__2024-05-10T22:34:00+00:00, run_start_date=2024-05-10 22:35:00.366154+00:00, run_end_date=2024-05-10 22:35:17.948485+00:00, run_duration=17.582331, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:34:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=c30663e5f9a5776de9fefb1a0d111eba 2024-05-10T22:35:17.956554028Z [2024-05-10T22:35:17.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:36:00+00:00 2024-05-10T22:35:20.616214774Z [2024-05-10T22:35:20.615+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:35:20.618248165Z [2024-05-10T22:35:20.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09, execution_date=2024-05-10 22:30:00+00:00, run_id=scheduled__2024-05-10T22:30:00+00:00, run_start_date=2024-05-10 22:35:00.358504+00:00, run_end_date=2024-05-10 22:35:20.616325+00:00, run_duration=20.257821, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:30:00+00:00, data_interval_end=2024-05-10 22:35:00+00:00, dag_hash=379c796f8877b58f7f1a5de95faf9c88 2024-05-10T22:35:20.639916562Z [2024-05-10T22:35:20.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 to 2024-05-10T22:35:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:35:33.087982347Z [2024-05-10T22:35:33.087+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:36:00.532840448Z [2024-05-10T22:36:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:36:00+00:00, run_after=2024-05-10T22:37:00+00:00 2024-05-10T22:36:00.543066725Z [2024-05-10T22:36:00.542+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:36:00.569421693Z [2024-05-10T22:36:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:36:00+00:00, run_after=2024-05-10T22:37:00+00:00 2024-05-10T22:36:00.579488902Z [2024-05-10T22:36:00.578+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:36:00.672046792Z [2024-05-10T22:36:00.671+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:36:00.672071189Z 2024-05-10T22:36:00.672075627Z 2024-05-10T22:36:00.672078905Z 2024-05-10T22:36:00.672099246Z 2024-05-10T22:36:00.672102990Z [2024-05-10T22:36:00.671+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:36:00.672106176Z [2024-05-10T22:36:00.671+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:36:00.672366501Z [2024-05-10T22:36:00.672+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:36:00.672511443Z [2024-05-10T22:36:00.672+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:36:00.673140495Z [2024-05-10T22:36:00.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:36:00.673152418Z 2024-05-10T22:36:00.673156053Z 2024-05-10T22:36:00.673159333Z 2024-05-10T22:36:00.673162692Z 2024-05-10T22:36:00.677430644Z [2024-05-10T22:36:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:36:00.677560205Z [2024-05-10T22:36:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:36:00.677826752Z [2024-05-10T22:36:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:36:00.678106497Z [2024-05-10T22:36:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:36:00.678567874Z [2024-05-10T22:36:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:36:00.678777612Z [2024-05-10T22:36:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:36:00.679037888Z [2024-05-10T22:36:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:36:00.679265588Z [2024-05-10T22:36:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:36:00.947664613Z [2024-05-10T22:36:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status queued for try_number 1 2024-05-10T22:36:00.949636483Z [2024-05-10T22:36:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:36:00.949856714Z [2024-05-10T22:36:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:36:00.950068642Z [2024-05-10T22:36:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:36:00.957737692Z [2024-05-10T22:36:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1a734e2-bbbb-4bb6-8062-fe6423b029d6 2024-05-10T22:36:00.958033362Z [2024-05-10T22:36:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 094c9c71-4b36-45c1-a8fc-e3198e00fb2d 2024-05-10T22:36:00.958260943Z [2024-05-10T22:36:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 601543ed-a891-4d3c-a6b4-704c1ba57a7e 2024-05-10T22:36:00.958438852Z [2024-05-10T22:36:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08d867fc-52a9-4c1d-9c4c-ab86cd3deb2e 2024-05-10T22:36:02.177933256Z [2024-05-10T22:36:02.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:36:02.178647232Z [2024-05-10T22:36:02.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:35:00+00:00, run_id=scheduled__2024-05-10T22:35:00+00:00, run_start_date=2024-05-10 22:36:00.597807+00:00, run_end_date=2024-05-10 22:36:02.178099+00:00, run_duration=1.580292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:35:00+00:00, data_interval_end=2024-05-10 22:36:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:36:02.196445688Z [2024-05-10T22:36:02.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:36:00+00:00, run_after=2024-05-10T22:37:00+00:00 2024-05-10T22:36:03.326546273Z [2024-05-10T22:36:03.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:36:03.327006640Z [2024-05-10T22:36:03.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:34:00+00:00, run_id=scheduled__2024-05-10T22:34:00+00:00, run_start_date=2024-05-10 22:36:00.595240+00:00, run_end_date=2024-05-10 22:36:03.326380+00:00, run_duration=2.73114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:34:00+00:00, data_interval_end=2024-05-10 22:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:36:03.344774470Z [2024-05-10T22:36:03.344+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:36:00+00:00, run_after=2024-05-10T22:38:00+00:00 2024-05-10T22:36:03.394746960Z [2024-05-10T22:36:03.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:34:00+00:00 exited with status success for try_number 1 2024-05-10T22:36:03.394839394Z [2024-05-10T22:36:03.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:36:03.402253428Z [2024-05-10T22:36:03.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=-1, run_start_date=2024-05-10 22:36:01.682335+00:00, run_end_date=2024-05-10 22:36:02.153253+00:00, run_duration=0.470918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:36:00.673987+00:00, queued_by_job_id=2, pid=737 2024-05-10T22:36:03.402527092Z [2024-05-10T22:36:03.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:34:00+00:00, map_index=-1, run_start_date=2024-05-10 22:36:01.794627+00:00, run_end_date=2024-05-10 22:36:02.242334+00:00, run_duration=0.447707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:36:00.673987+00:00, queued_by_job_id=2, pid=738 2024-05-10T22:36:04.449246154Z [2024-05-10T22:36:04.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:36:04.449678526Z [2024-05-10T22:36:04.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:35:00+00:00, run_id=scheduled__2024-05-10T22:35:00+00:00, run_start_date=2024-05-10 22:36:00.601716+00:00, run_end_date=2024-05-10 22:36:04.449149+00:00, run_duration=3.847433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:35:00+00:00, data_interval_end=2024-05-10 22:36:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:36:04.458908200Z [2024-05-10T22:36:04.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:36:00+00:00, run_after=2024-05-10T22:37:00+00:00 2024-05-10T22:36:04.508924019Z [2024-05-10T22:36:04.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:36:04.513908178Z [2024-05-10T22:36:04.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=-1, run_start_date=2024-05-10 22:36:02.783773+00:00, run_end_date=2024-05-10 22:36:04.167825+00:00, run_duration=1.384052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:36:00.673987+00:00, queued_by_job_id=2, pid=762 2024-05-10T22:36:05.584220666Z [2024-05-10T22:36:05.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:36:05.584448264Z [2024-05-10T22:36:05.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:35:00+00:00, run_id=scheduled__2024-05-10T22:35:00+00:00, run_start_date=2024-05-10 22:36:00.600071+00:00, run_end_date=2024-05-10 22:36:05.584128+00:00, run_duration=4.984057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:35:00+00:00, data_interval_end=2024-05-10 22:36:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:36:05.592694018Z [2024-05-10T22:36:05.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:36:00+00:00, run_after=2024-05-10T22:37:00+00:00 2024-05-10T22:36:05.630821244Z [2024-05-10T22:36:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:36:05.635580302Z [2024-05-10T22:36:05.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=-1, run_start_date=2024-05-10 22:36:02.735486+00:00, run_end_date=2024-05-10 22:36:04.438420+00:00, run_duration=1.702934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:36:00.673987+00:00, queued_by_job_id=2, pid=761 2024-05-10T22:37:00.328577944Z [2024-05-10T22:37:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:37:00+00:00, run_after=2024-05-10T22:38:00+00:00 2024-05-10T22:37:00.332417472Z [2024-05-10T22:37:00.332+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:37:00.344976955Z [2024-05-10T22:37:00.344+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:37:00+00:00, run_after=2024-05-10T22:38:00+00:00 2024-05-10T22:37:00.412218165Z [2024-05-10T22:37:00.411+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:37:00.412251355Z 2024-05-10T22:37:00.412256283Z 2024-05-10T22:37:00.412260652Z 2024-05-10T22:37:00.412533437Z [2024-05-10T22:37:00.412+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:37:00.412757257Z [2024-05-10T22:37:00.412+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:37:00.413007365Z [2024-05-10T22:37:00.412+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:37:00.414025373Z [2024-05-10T22:37:00.413+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:37:00.414042695Z 2024-05-10T22:37:00.414047465Z 2024-05-10T22:37:00.414051942Z 2024-05-10T22:37:00.418263779Z [2024-05-10T22:37:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:37:00.418590218Z [2024-05-10T22:37:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:37:00.419007312Z [2024-05-10T22:37:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:37:00.419195265Z [2024-05-10T22:37:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:37:00.419498324Z [2024-05-10T22:37:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:37:00.419673601Z [2024-05-10T22:37:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:37:00.627886284Z [2024-05-10T22:37:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status queued for try_number 1 2024-05-10T22:37:00.627910809Z [2024-05-10T22:37:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status queued for try_number 1 2024-05-10T22:37:00.627914519Z [2024-05-10T22:37:00.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status queued for try_number 1 2024-05-10T22:37:00.647010232Z [2024-05-10T22:37:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1621267-91db-4714-bba0-4eab6e6712c2 2024-05-10T22:37:00.647313875Z [2024-05-10T22:37:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d745d38-d082-41ec-9d6a-cc1e460f5a60 2024-05-10T22:37:00.647607696Z [2024-05-10T22:37:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5044718a-5b8a-4236-af3c-4b8a7611c116 2024-05-10T22:37:01.803040500Z [2024-05-10T22:37:01.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:37:01.803593520Z [2024-05-10T22:37:01.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:36:00+00:00, run_id=scheduled__2024-05-10T22:36:00+00:00, run_start_date=2024-05-10 22:37:00.359828+00:00, run_end_date=2024-05-10 22:37:01.803197+00:00, run_duration=1.443369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:36:00+00:00, data_interval_end=2024-05-10 22:37:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:37:01.821578449Z [2024-05-10T22:37:01.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:37:00+00:00, run_after=2024-05-10T22:38:00+00:00 2024-05-10T22:37:01.847215770Z [2024-05-10T22:37:01.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status success for try_number 1 2024-05-10T22:37:01.852269246Z [2024-05-10T22:37:01.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:36:00+00:00, map_index=-1, run_start_date=2024-05-10 22:37:01.229106+00:00, run_end_date=2024-05-10 22:37:01.632127+00:00, run_duration=0.403021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:37:00.414964+00:00, queued_by_job_id=2, pid=794 2024-05-10T22:37:04.087341732Z [2024-05-10T22:37:04.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:37:04.087388010Z [2024-05-10T22:37:04.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:36:00+00:00, run_id=scheduled__2024-05-10T22:36:00+00:00, run_start_date=2024-05-10 22:37:00.357284+00:00, run_end_date=2024-05-10 22:37:04.086394+00:00, run_duration=3.72911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:36:00+00:00, data_interval_end=2024-05-10 22:37:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:37:04.103510370Z [2024-05-10T22:37:04.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:37:00+00:00, run_after=2024-05-10T22:38:00+00:00 2024-05-10T22:37:04.117599361Z [2024-05-10T22:37:04.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:37:04.117952030Z [2024-05-10T22:37:04.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:36:00+00:00, run_id=scheduled__2024-05-10T22:36:00+00:00, run_start_date=2024-05-10 22:37:00.358639+00:00, run_end_date=2024-05-10 22:37:04.117505+00:00, run_duration=3.758866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:36:00+00:00, data_interval_end=2024-05-10 22:37:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:37:04.141766065Z [2024-05-10T22:37:04.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:37:00+00:00, run_after=2024-05-10T22:38:00+00:00 2024-05-10T22:37:04.174835112Z [2024-05-10T22:37:04.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status success for try_number 1 2024-05-10T22:37:04.183458873Z [2024-05-10T22:37:04.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status success for try_number 1 2024-05-10T22:37:04.189795705Z [2024-05-10T22:37:04.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:36:00+00:00, map_index=-1, run_start_date=2024-05-10 22:37:02.234849+00:00, run_end_date=2024-05-10 22:37:03.584207+00:00, run_duration=1.349358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:37:00.414964+00:00, queued_by_job_id=2, pid=813 2024-05-10T22:37:04.190051049Z [2024-05-10T22:37:04.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:36:00+00:00, map_index=-1, run_start_date=2024-05-10 22:37:02.099419+00:00, run_end_date=2024-05-10 22:37:03.657068+00:00, run_duration=1.557649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:37:00.414964+00:00, queued_by_job_id=2, pid=812 2024-05-10T22:38:01.167606466Z [2024-05-10T22:38:01.167+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:38:01.210651102Z [2024-05-10T22:38:01.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:38:00+00:00, run_after=2024-05-10T22:39:00+00:00 2024-05-10T22:38:01.249507856Z [2024-05-10T22:38:01.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:38:00+00:00, run_after=2024-05-10T22:39:00+00:00 2024-05-10T22:38:01.267587169Z [2024-05-10T22:38:01.267+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:38:01.400044912Z [2024-05-10T22:38:01.399+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:38:01.400078521Z 2024-05-10T22:38:01.400082917Z 2024-05-10T22:38:01.400086589Z 2024-05-10T22:38:01.400089778Z 2024-05-10T22:38:01.400453285Z [2024-05-10T22:38:01.400+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:38:01.400678867Z [2024-05-10T22:38:01.400+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:38:01.400893445Z [2024-05-10T22:38:01.400+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:38:01.401089633Z [2024-05-10T22:38:01.400+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:38:01.401752532Z [2024-05-10T22:38:01.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:38:01.401763848Z 2024-05-10T22:38:01.401767525Z 2024-05-10T22:38:01.401770524Z 2024-05-10T22:38:01.401773589Z 2024-05-10T22:38:01.405890760Z [2024-05-10T22:38:01.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:38:01.408006568Z [2024-05-10T22:38:01.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:38:01.408366515Z [2024-05-10T22:38:01.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:38:01.408602914Z [2024-05-10T22:38:01.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:38:01.409169586Z [2024-05-10T22:38:01.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:38:01.409472548Z [2024-05-10T22:38:01.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:38:01.410088871Z [2024-05-10T22:38:01.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:38:01.410366492Z [2024-05-10T22:38:01.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:38:01.861086728Z [2024-05-10T22:38:01.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status queued for try_number 1 2024-05-10T22:38:01.861194926Z [2024-05-10T22:38:01.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:37:00+00:00 exited with status queued for try_number 1 2024-05-10T22:38:01.861389112Z [2024-05-10T22:38:01.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:37:00+00:00 exited with status queued for try_number 1 2024-05-10T22:38:01.861643411Z [2024-05-10T22:38:01.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:37:00+00:00 exited with status queued for try_number 1 2024-05-10T22:38:01.878884503Z [2024-05-10T22:38:01.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3902e74-c9c4-4ba0-958e-107fe8aaf44b 2024-05-10T22:38:01.879265629Z [2024-05-10T22:38:01.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89600b61-1992-4751-9f36-98f25b8c821e 2024-05-10T22:38:01.879481310Z [2024-05-10T22:38:01.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bd71e94-fc1d-491e-8254-731e2b80f495 2024-05-10T22:38:01.879761794Z [2024-05-10T22:38:01.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2277fee5-09d2-42c2-acf1-80409dfd3e23 2024-05-10T22:38:04.752346963Z [2024-05-10T22:38:04.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:38:04.752749161Z [2024-05-10T22:38:04.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:36:00+00:00, run_id=scheduled__2024-05-10T22:36:00+00:00, run_start_date=2024-05-10 22:38:01.299885+00:00, run_end_date=2024-05-10 22:38:04.752342+00:00, run_duration=3.452457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:36:00+00:00, data_interval_end=2024-05-10 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:38:04.788605614Z [2024-05-10T22:38:04.783+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:38:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:38:04.798160931Z [2024-05-10T22:38:04.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:38:04.798376529Z [2024-05-10T22:38:04.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:37:00+00:00, run_id=scheduled__2024-05-10T22:37:00+00:00, run_start_date=2024-05-10 22:38:01.305801+00:00, run_end_date=2024-05-10 22:38:04.798123+00:00, run_duration=3.492322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:37:00+00:00, data_interval_end=2024-05-10 22:38:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:38:04.810541689Z [2024-05-10T22:38:04.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:38:00+00:00, run_after=2024-05-10T22:39:00+00:00 2024-05-10T22:38:04.929991598Z [2024-05-10T22:38:04.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:36:00+00:00 exited with status success for try_number 1 2024-05-10T22:38:04.930012931Z [2024-05-10T22:38:04.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:37:00+00:00 exited with status success for try_number 1 2024-05-10T22:38:04.943371582Z [2024-05-10T22:38:04.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:36:00+00:00, map_index=-1, run_start_date=2024-05-10 22:38:03.594197+00:00, run_end_date=2024-05-10 22:38:04.003760+00:00, run_duration=0.409563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:38:01.402986+00:00, queued_by_job_id=2, pid=847 2024-05-10T22:38:04.943474256Z [2024-05-10T22:38:04.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:37:00+00:00, map_index=-1, run_start_date=2024-05-10 22:38:03.412463+00:00, run_end_date=2024-05-10 22:38:03.904377+00:00, run_duration=0.491914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:38:01.402986+00:00, queued_by_job_id=2, pid=846 2024-05-10T22:38:06.392269864Z [2024-05-10T22:38:06.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:38:06.392577948Z [2024-05-10T22:38:06.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:37:00+00:00, run_id=scheduled__2024-05-10T22:37:00+00:00, run_start_date=2024-05-10 22:38:01.302333+00:00, run_end_date=2024-05-10 22:38:06.392167+00:00, run_duration=5.089834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:37:00+00:00, data_interval_end=2024-05-10 22:38:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:38:06.405476949Z [2024-05-10T22:38:06.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:38:00+00:00, run_after=2024-05-10T22:39:00+00:00 2024-05-10T22:38:06.451927586Z [2024-05-10T22:38:06.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:37:00+00:00 exited with status success for try_number 1 2024-05-10T22:38:06.461793072Z [2024-05-10T22:38:06.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:37:00+00:00, map_index=-1, run_start_date=2024-05-10 22:38:04.646475+00:00, run_end_date=2024-05-10 22:38:06.070368+00:00, run_duration=1.423893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:38:01.402986+00:00, queued_by_job_id=2, pid=865 2024-05-10T22:38:08.148441964Z [2024-05-10T22:38:08.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:38:08.148715156Z [2024-05-10T22:38:08.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:37:00+00:00, run_id=scheduled__2024-05-10T22:37:00+00:00, run_start_date=2024-05-10 22:38:01.310052+00:00, run_end_date=2024-05-10 22:38:08.148330+00:00, run_duration=6.838278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:37:00+00:00, data_interval_end=2024-05-10 22:38:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:38:08.169080610Z [2024-05-10T22:38:08.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:38:00+00:00, run_after=2024-05-10T22:39:00+00:00 2024-05-10T22:38:08.200323210Z [2024-05-10T22:38:08.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:37:00+00:00 exited with status success for try_number 1 2024-05-10T22:38:08.205285548Z [2024-05-10T22:38:08.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:37:00+00:00, map_index=-1, run_start_date=2024-05-10 22:38:05.133000+00:00, run_end_date=2024-05-10 22:38:07.192372+00:00, run_duration=2.059372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:38:01.402986+00:00, queued_by_job_id=2, pid=882 2024-05-10T22:39:00.404622860Z [2024-05-10T22:39:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:39:00.427010947Z [2024-05-10T22:39:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:39:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:39:00.454136361Z [2024-05-10T22:39:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:39:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:39:00.571600013Z [2024-05-10T22:39:00.571+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:39:00.571634659Z 2024-05-10T22:39:00.571638435Z 2024-05-10T22:39:00.571641692Z 2024-05-10T22:39:00.571982863Z [2024-05-10T22:39:00.571+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:39:00.572225450Z [2024-05-10T22:39:00.572+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:39:00.572662188Z [2024-05-10T22:39:00.572+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:39:00.573390658Z [2024-05-10T22:39:00.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:39:00.573401456Z 2024-05-10T22:39:00.573404720Z 2024-05-10T22:39:00.573407721Z 2024-05-10T22:39:00.578473482Z [2024-05-10T22:39:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:39:00.578947942Z [2024-05-10T22:39:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:39:00.579628574Z [2024-05-10T22:39:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:39:00.580083667Z [2024-05-10T22:39:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:39:00.580690499Z [2024-05-10T22:39:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:39:00.580896993Z [2024-05-10T22:39:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:39:00.933642832Z [2024-05-10T22:39:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status queued for try_number 1 2024-05-10T22:39:00.933708061Z [2024-05-10T22:39:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status queued for try_number 1 2024-05-10T22:39:00.933711986Z [2024-05-10T22:39:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status queued for try_number 1 2024-05-10T22:39:00.950959255Z [2024-05-10T22:39:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe916727-f18c-4ab7-9f84-e2dbd87889f3 2024-05-10T22:39:00.951258290Z [2024-05-10T22:39:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to e123edbb-6f8e-4aac-a8ed-2d4bd1e55800 2024-05-10T22:39:00.951611568Z [2024-05-10T22:39:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80adf74d-1fb0-479a-bccf-91105bf1d30f 2024-05-10T22:39:02.193749926Z [2024-05-10T22:39:02.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:39:02.194213893Z [2024-05-10T22:39:02.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:38:00+00:00, run_id=scheduled__2024-05-10T22:38:00+00:00, run_start_date=2024-05-10 22:39:00.482810+00:00, run_end_date=2024-05-10 22:39:02.193818+00:00, run_duration=1.711008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:38:00+00:00, data_interval_end=2024-05-10 22:39:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:39:02.204911026Z [2024-05-10T22:39:02.204+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:39:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:39:02.877985127Z [2024-05-10T22:39:02.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status success for try_number 1 2024-05-10T22:39:02.882448527Z [2024-05-10T22:39:02.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:38:00+00:00, map_index=-1, run_start_date=2024-05-10 22:39:01.699777+00:00, run_end_date=2024-05-10 22:39:02.128603+00:00, run_duration=0.428826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:39:00.574415+00:00, queued_by_job_id=2, pid=903 2024-05-10T22:39:05.042536898Z [2024-05-10T22:39:05.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:39:05.042972445Z [2024-05-10T22:39:05.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:38:00+00:00, run_id=scheduled__2024-05-10T22:38:00+00:00, run_start_date=2024-05-10 22:39:00.481586+00:00, run_end_date=2024-05-10 22:39:05.042415+00:00, run_duration=4.560829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:38:00+00:00, data_interval_end=2024-05-10 22:39:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:39:05.052106127Z [2024-05-10T22:39:05.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:39:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:39:05.100177145Z [2024-05-10T22:39:05.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status success for try_number 1 2024-05-10T22:39:05.105622267Z [2024-05-10T22:39:05.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:38:00+00:00, map_index=-1, run_start_date=2024-05-10 22:39:02.632533+00:00, run_end_date=2024-05-10 22:39:04.880429+00:00, run_duration=2.247896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:39:00.574415+00:00, queued_by_job_id=2, pid=921 2024-05-10T22:39:06.157456960Z [2024-05-10T22:39:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:39:06.157718518Z [2024-05-10T22:39:06.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:38:00+00:00, run_id=scheduled__2024-05-10T22:38:00+00:00, run_start_date=2024-05-10 22:39:00.480366+00:00, run_end_date=2024-05-10 22:39:06.157289+00:00, run_duration=5.676923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:38:00+00:00, data_interval_end=2024-05-10 22:39:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:39:06.167471971Z [2024-05-10T22:39:06.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:39:00+00:00, run_after=2024-05-10T22:40:00+00:00 2024-05-10T22:39:06.198999599Z [2024-05-10T22:39:06.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status success for try_number 1 2024-05-10T22:39:06.205850263Z [2024-05-10T22:39:06.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:38:00+00:00, map_index=-1, run_start_date=2024-05-10 22:39:02.746213+00:00, run_end_date=2024-05-10 22:39:05.408160+00:00, run_duration=2.661947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:39:00.574415+00:00, queued_by_job_id=2, pid=922 2024-05-10T22:40:00.779989094Z [2024-05-10T22:40:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:41:00+00:00 2024-05-10T22:40:00.798161387Z [2024-05-10T22:40:00.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:40:00.812602777Z [2024-05-10T22:40:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:41:00+00:00 2024-05-10T22:40:00.819068567Z [2024-05-10T22:40:00.818+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:40:00.831397859Z [2024-05-10T22:40:00.830+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:40:00.956048029Z [2024-05-10T22:40:00.955+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T22:40:00.956242300Z 2024-05-10T22:40:00.956285738Z 2024-05-10T22:40:00.956294120Z 2024-05-10T22:40:00.956300796Z 2024-05-10T22:40:00.956307838Z 2024-05-10T22:40:00.956314312Z [2024-05-10T22:40:00.955+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:40:00.956409674Z [2024-05-10T22:40:00.955+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:40:00.956458938Z [2024-05-10T22:40:00.956+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:40:00.956496385Z [2024-05-10T22:40:00.956+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:40:00.956904959Z [2024-05-10T22:40:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:40:00.957572106Z [2024-05-10T22:40:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:40:00.957657976Z 2024-05-10T22:40:00.957666322Z 2024-05-10T22:40:00.957699158Z 2024-05-10T22:40:00.957706724Z 2024-05-10T22:40:00.957713369Z 2024-05-10T22:40:00.965316522Z [2024-05-10T22:40:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:40:00.966238984Z [2024-05-10T22:40:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:40:00.966342057Z [2024-05-10T22:40:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:40:00.966355577Z [2024-05-10T22:40:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:40:00.968823046Z [2024-05-10T22:40:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:40:00.968858351Z [2024-05-10T22:40:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:40:00.968871585Z [2024-05-10T22:40:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:40:00.968875716Z [2024-05-10T22:40:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:40:00.968879286Z [2024-05-10T22:40:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:40:00.968883015Z [2024-05-10T22:40:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:40:01.582022495Z [2024-05-10T22:40:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:01.582048670Z [2024-05-10T22:40:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:01.582055698Z [2024-05-10T22:40:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:39:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:01.582059121Z [2024-05-10T22:40:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:39:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:01.582075155Z [2024-05-10T22:40:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:39:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:01.605706549Z [2024-05-10T22:40:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9b7f256-5748-434a-993c-a0d686d9b5db 2024-05-10T22:40:01.605778123Z [2024-05-10T22:40:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f9d6d4d-2a5e-432b-ad25-a0f86ba726c5 2024-05-10T22:40:01.605900005Z [2024-05-10T22:40:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69a39852-ed95-4c0d-b42e-2b8bfe41828b 2024-05-10T22:40:01.606098304Z [2024-05-10T22:40:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00907766-c948-46ab-82f6-d0316490442b 2024-05-10T22:40:01.606190670Z [2024-05-10T22:40:01.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to a939313d-00c3-4a2d-bf6b-564965894dab 2024-05-10T22:40:02.978654659Z [2024-05-10T22:40:02.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:40:02.978874401Z [2024-05-10T22:40:02.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:38:00+00:00, run_id=scheduled__2024-05-10T22:38:00+00:00, run_start_date=2024-05-10 22:40:00.859870+00:00, run_end_date=2024-05-10 22:40:02.978584+00:00, run_duration=2.118714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:38:00+00:00, data_interval_end=2024-05-10 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:40:02.986806549Z [2024-05-10T22:40:02.986+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:42:00+00:00 2024-05-10T22:40:03.000127977Z [2024-05-10T22:40:02.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:40:03.000264209Z [2024-05-10T22:40:03.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:39:00+00:00, run_id=scheduled__2024-05-10T22:39:00+00:00, run_start_date=2024-05-10 22:40:00.862366+00:00, run_end_date=2024-05-10 22:40:03.000011+00:00, run_duration=2.137645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:39:00+00:00, data_interval_end=2024-05-10 22:40:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:40:03.012579892Z [2024-05-10T22:40:03.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:41:00+00:00 2024-05-10T22:40:03.076437868Z [2024-05-10T22:40:03.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:38:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:03.076470563Z [2024-05-10T22:40:03.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:39:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:03.087028579Z [2024-05-10T22:40:03.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:38:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:02.172409+00:00, run_end_date=2024-05-10 22:40:02.664480+00:00, run_duration=0.492071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:00.959111+00:00, queued_by_job_id=2, pid=957 2024-05-10T22:40:03.087146641Z [2024-05-10T22:40:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:39:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:02.116527+00:00, run_end_date=2024-05-10 22:40:02.530114+00:00, run_duration=0.413587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:00.959111+00:00, queued_by_job_id=2, pid=956 2024-05-10T22:40:05.009051165Z [2024-05-10T22:40:05.008+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:40:05.009092454Z 2024-05-10T22:40:05.009302084Z [2024-05-10T22:40:05.008+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:40:05.011722662Z [2024-05-10T22:40:05.010+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:40:05.011766129Z 2024-05-10T22:40:05.014374200Z [2024-05-10T22:40:05.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:40:05.014655702Z [2024-05-10T22:40:05.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:40:05.105581939Z [2024-05-10T22:40:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:05.105756112Z [2024-05-10T22:40:05.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:05.118883711Z [2024-05-10T22:40:05.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:03.407301+00:00, run_end_date=2024-05-10 22:40:03.915857+00:00, run_duration=0.508556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:00.959111+00:00, queued_by_job_id=2, pid=986 2024-05-10T22:40:05.118938655Z [2024-05-10T22:40:05.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71604965-2e90-4872-afcf-dc47853351da 2024-05-10T22:40:05.190973794Z [2024-05-10T22:40:05.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:40:05.191004249Z [2024-05-10T22:40:05.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:39:00+00:00, run_id=scheduled__2024-05-10T22:39:00+00:00, run_start_date=2024-05-10 22:40:00.864907+00:00, run_end_date=2024-05-10 22:40:05.185036+00:00, run_duration=4.320129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:39:00+00:00, data_interval_end=2024-05-10 22:40:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:40:05.218033888Z [2024-05-10T22:40:05.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:41:00+00:00 2024-05-10T22:40:05.281454682Z [2024-05-10T22:40:05.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:39:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:05.287973837Z [2024-05-10T22:40:05.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:39:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:03.637509+00:00, run_end_date=2024-05-10 22:40:04.985262+00:00, run_duration=1.347753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:00.959111+00:00, queued_by_job_id=2, pid=987 2024-05-10T22:40:06.327730478Z [2024-05-10T22:40:06.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:40:06.328093924Z [2024-05-10T22:40:06.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:39:00+00:00, run_id=scheduled__2024-05-10T22:39:00+00:00, run_start_date=2024-05-10 22:40:00.866328+00:00, run_end_date=2024-05-10 22:40:06.327592+00:00, run_duration=5.461264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:39:00+00:00, data_interval_end=2024-05-10 22:40:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:40:06.339216154Z [2024-05-10T22:40:06.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:41:00+00:00 2024-05-10T22:40:06.394064744Z [2024-05-10T22:40:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:39:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:06.402706518Z [2024-05-10T22:40:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:39:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:03.689229+00:00, run_end_date=2024-05-10 22:40:05.422937+00:00, run_duration=1.733708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:00.959111+00:00, queued_by_job_id=2, pid=988 2024-05-10T22:40:08.167148400Z [2024-05-10T22:40:08.166+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:40:08.167181550Z 2024-05-10T22:40:08.167252272Z [2024-05-10T22:40:08.167+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:40:08.168078265Z [2024-05-10T22:40:08.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:40:08.168090665Z 2024-05-10T22:40:08.171221627Z [2024-05-10T22:40:08.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:40:08.171415420Z [2024-05-10T22:40:08.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:40:08.239394275Z [2024-05-10T22:40:08.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:08.239748177Z [2024-05-10T22:40:08.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:08.245965789Z [2024-05-10T22:40:08.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:06.701215+00:00, run_end_date=2024-05-10 22:40:07.112259+00:00, run_duration=0.411044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:05.011055+00:00, queued_by_job_id=2, pid=1021 2024-05-10T22:40:08.246946490Z [2024-05-10T22:40:08.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 887862c4-8e91-4102-841d-8eb987689e38 2024-05-10T22:40:10.930433092Z [2024-05-10T22:40:10.929+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:40:10.930482114Z 2024-05-10T22:40:10.930609190Z [2024-05-10T22:40:10.930+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:40:10.931635201Z [2024-05-10T22:40:10.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:40:10.931658573Z 2024-05-10T22:40:10.935331666Z [2024-05-10T22:40:10.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:40:10.935456331Z [2024-05-10T22:40:10.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:40:10.999282752Z [2024-05-10T22:40:10.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status queued for try_number 1 2024-05-10T22:40:10.999455960Z [2024-05-10T22:40:10.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:11.012658611Z [2024-05-10T22:40:11.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70951df2-5a9a-4023-b4de-ceab664bb06b 2024-05-10T22:40:11.013828144Z [2024-05-10T22:40:11.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=0, run_start_date=2024-05-10 22:40:09.758166+00:00, run_end_date=2024-05-10 22:40:10.130358+00:00, run_duration=0.372192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:08.168534+00:00, queued_by_job_id=2, pid=1032 2024-05-10T22:40:13.333034671Z [2024-05-10T22:40:13.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:40:13.333738768Z [2024-05-10T22:40:13.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:35:00+00:00, run_id=scheduled__2024-05-10T22:35:00+00:00, run_start_date=2024-05-10 22:40:00.857141+00:00, run_end_date=2024-05-10 22:40:13.332854+00:00, run_duration=12.475713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:35:00+00:00, data_interval_end=2024-05-10 22:40:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T22:40:13.344544777Z [2024-05-10T22:40:13.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:40:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:40:13.401645779Z [2024-05-10T22:40:13.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:35:00+00:00 exited with status success for try_number 1 2024-05-10T22:40:13.406611312Z [2024-05-10T22:40:13.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:35:00+00:00, map_index=-1, run_start_date=2024-05-10 22:40:12.742819+00:00, run_end_date=2024-05-10 22:40:13.194215+00:00, run_duration=0.451396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:40:10.932327+00:00, queued_by_job_id=2, pid=1040 2024-05-10T22:40:33.160987182Z [2024-05-10T22:40:33.160+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:41:00.189560979Z [2024-05-10T22:41:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:41:00+00:00, run_after=2024-05-10T22:42:00+00:00 2024-05-10T22:41:00.197167997Z [2024-05-10T22:41:00.196+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:41:00.210953780Z [2024-05-10T22:41:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:41:00+00:00, run_after=2024-05-10T22:42:00+00:00 2024-05-10T22:41:00.311550625Z [2024-05-10T22:41:00.311+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:41:00.311595505Z 2024-05-10T22:41:00.311599800Z 2024-05-10T22:41:00.311603174Z 2024-05-10T22:41:00.311606207Z [2024-05-10T22:41:00.311+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:41:00.313963941Z [2024-05-10T22:41:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:41:00.313981843Z [2024-05-10T22:41:00.313+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:41:00.313987620Z [2024-05-10T22:41:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:41:00.313990910Z 2024-05-10T22:41:00.313994008Z 2024-05-10T22:41:00.313997170Z 2024-05-10T22:41:00.317836120Z [2024-05-10T22:41:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:41:00.318059240Z [2024-05-10T22:41:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:41:00.318348950Z [2024-05-10T22:41:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:41:00.318494030Z [2024-05-10T22:41:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:41:00.318736623Z [2024-05-10T22:41:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:41:00.318872864Z [2024-05-10T22:41:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:41:00.571600259Z [2024-05-10T22:41:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:41:00.571624125Z [2024-05-10T22:41:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:41:00.571746102Z [2024-05-10T22:41:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:41:00.580376136Z [2024-05-10T22:41:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67136972-86aa-4a19-9e8c-eebceb327fc4 2024-05-10T22:41:00.580594497Z [2024-05-10T22:41:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 092c0b3f-e8b8-4bed-9d0f-71742e6af93f 2024-05-10T22:41:00.580816918Z [2024-05-10T22:41:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2adcb37-7765-4ae8-981c-661fb85a40a9 2024-05-10T22:41:03.034491981Z [2024-05-10T22:41:03.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:41:03.038548389Z [2024-05-10T22:41:03.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:40:00+00:00, run_id=scheduled__2024-05-10T22:40:00+00:00, run_start_date=2024-05-10 22:41:00.228181+00:00, run_end_date=2024-05-10 22:41:03.037943+00:00, run_duration=2.809762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:40:00+00:00, data_interval_end=2024-05-10 22:41:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:41:03.056412012Z [2024-05-10T22:41:03.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:41:00+00:00, run_after=2024-05-10T22:42:00+00:00 2024-05-10T22:41:03.117068134Z [2024-05-10T22:41:03.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:41:03.138901752Z [2024-05-10T22:41:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:41:01.628683+00:00, run_end_date=2024-05-10 22:41:02.248824+00:00, run_duration=0.620141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:41:00.315261+00:00, queued_by_job_id=2, pid=1050 2024-05-10T22:41:04.863814810Z [2024-05-10T22:41:04.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:41:04.863933735Z [2024-05-10T22:41:04.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:40:00+00:00, run_id=scheduled__2024-05-10T22:40:00+00:00, run_start_date=2024-05-10 22:41:00.231370+00:00, run_end_date=2024-05-10 22:41:04.863530+00:00, run_duration=4.63216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:40:00+00:00, data_interval_end=2024-05-10 22:41:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:41:04.875584194Z [2024-05-10T22:41:04.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:41:00+00:00, run_after=2024-05-10T22:42:00+00:00 2024-05-10T22:41:04.945251034Z [2024-05-10T22:41:04.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:41:04.953118383Z [2024-05-10T22:41:04.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:41:02.791839+00:00, run_end_date=2024-05-10 22:41:04.664506+00:00, run_duration=1.872667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:41:00.315261+00:00, queued_by_job_id=2, pid=1067 2024-05-10T22:41:06.016449998Z [2024-05-10T22:41:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:41:06.017182863Z [2024-05-10T22:41:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:40:00+00:00, run_id=scheduled__2024-05-10T22:40:00+00:00, run_start_date=2024-05-10 22:41:00.229929+00:00, run_end_date=2024-05-10 22:41:06.016353+00:00, run_duration=5.786424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:40:00+00:00, data_interval_end=2024-05-10 22:41:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:41:06.025365400Z [2024-05-10T22:41:06.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:41:00+00:00, run_after=2024-05-10T22:42:00+00:00 2024-05-10T22:41:06.057103102Z [2024-05-10T22:41:06.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:41:06.062240520Z [2024-05-10T22:41:06.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:41:02.833914+00:00, run_end_date=2024-05-10 22:41:05.109178+00:00, run_duration=2.275264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:41:00.315261+00:00, queued_by_job_id=2, pid=1068 2024-05-10T22:42:00.747948662Z [2024-05-10T22:42:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:42:00+00:00, run_after=2024-05-10T22:43:00+00:00 2024-05-10T22:42:00.763339103Z [2024-05-10T22:42:00.762+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:42:00+00:00, run_after=2024-05-10T22:43:00+00:00 2024-05-10T22:42:00.774888891Z [2024-05-10T22:42:00.774+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:42:00.783359311Z [2024-05-10T22:42:00.782+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:42:00.905991380Z [2024-05-10T22:42:00.905+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:42:00.906026709Z 2024-05-10T22:42:00.906031047Z 2024-05-10T22:42:00.906043107Z 2024-05-10T22:42:00.906046486Z 2024-05-10T22:42:00.906521012Z [2024-05-10T22:42:00.906+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:42:00.906769495Z [2024-05-10T22:42:00.906+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:42:00.907008674Z [2024-05-10T22:42:00.906+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:42:00.907290466Z [2024-05-10T22:42:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:42:00.908020807Z [2024-05-10T22:42:00.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:42:00.908032929Z 2024-05-10T22:42:00.908062327Z 2024-05-10T22:42:00.908065941Z 2024-05-10T22:42:00.908068950Z 2024-05-10T22:42:00.912736824Z [2024-05-10T22:42:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:42:00.913155671Z [2024-05-10T22:42:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:42:00.913594956Z [2024-05-10T22:42:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:42:00.914028729Z [2024-05-10T22:42:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:42:00.914426550Z [2024-05-10T22:42:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:42:00.914734112Z [2024-05-10T22:42:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:42:00.915104972Z [2024-05-10T22:42:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:42:00.915363157Z [2024-05-10T22:42:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:42:01.747589816Z [2024-05-10T22:42:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:42:01.757813996Z [2024-05-10T22:42:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:41:00+00:00 exited with status queued for try_number 1 2024-05-10T22:42:01.758419299Z [2024-05-10T22:42:01.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:41:00+00:00 exited with status queued for try_number 1 2024-05-10T22:42:01.758443132Z [2024-05-10T22:42:01.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:41:00+00:00 exited with status queued for try_number 1 2024-05-10T22:42:01.789602728Z [2024-05-10T22:42:01.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d831a1d-b338-4992-962e-2e86d5fd8f1e 2024-05-10T22:42:01.789698213Z [2024-05-10T22:42:01.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb577bd2-10e0-478e-aedd-2972467bd091 2024-05-10T22:42:01.789769951Z [2024-05-10T22:42:01.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to f46f76b0-8f9e-4a0c-b815-604451fcf2ec 2024-05-10T22:42:01.789894937Z [2024-05-10T22:42:01.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 177ee768-8973-4655-8fd9-dd81a933510c 2024-05-10T22:42:04.425934901Z [2024-05-10T22:42:04.424+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:42:04.426542276Z [2024-05-10T22:42:04.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:40:00+00:00, run_id=scheduled__2024-05-10T22:40:00+00:00, run_start_date=2024-05-10 22:42:00.801289+00:00, run_end_date=2024-05-10 22:42:04.425823+00:00, run_duration=3.624534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:40:00+00:00, data_interval_end=2024-05-10 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:42:04.437339268Z [2024-05-10T22:42:04.437+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:42:00+00:00, run_after=2024-05-10T22:44:00+00:00 2024-05-10T22:42:04.446144864Z [2024-05-10T22:42:04.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:42:04.446344764Z [2024-05-10T22:42:04.446+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:41:00+00:00, run_id=scheduled__2024-05-10T22:41:00+00:00, run_start_date=2024-05-10 22:42:00.806687+00:00, run_end_date=2024-05-10 22:42:04.446066+00:00, run_duration=3.639379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:41:00+00:00, data_interval_end=2024-05-10 22:42:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:42:04.460822973Z [2024-05-10T22:42:04.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:42:00+00:00, run_after=2024-05-10T22:43:00+00:00 2024-05-10T22:42:04.596214449Z [2024-05-10T22:42:04.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:42:04.596233977Z [2024-05-10T22:42:04.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:41:00+00:00 exited with status success for try_number 1 2024-05-10T22:42:04.624909474Z [2024-05-10T22:42:04.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:42:02.819323+00:00, run_end_date=2024-05-10 22:42:03.372301+00:00, run_duration=0.552978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:42:00.909029+00:00, queued_by_job_id=2, pid=1101 2024-05-10T22:42:04.624943483Z [2024-05-10T22:42:04.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:41:00+00:00, map_index=-1, run_start_date=2024-05-10 22:42:02.876834+00:00, run_end_date=2024-05-10 22:42:03.591449+00:00, run_duration=0.714615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:42:00.909029+00:00, queued_by_job_id=2, pid=1102 2024-05-10T22:42:06.822367765Z [2024-05-10T22:42:06.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:42:06.822436132Z [2024-05-10T22:42:06.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:41:00+00:00, run_id=scheduled__2024-05-10T22:41:00+00:00, run_start_date=2024-05-10 22:42:00.808524+00:00, run_end_date=2024-05-10 22:42:06.812607+00:00, run_duration=6.004083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:41:00+00:00, data_interval_end=2024-05-10 22:42:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:42:06.822456377Z [2024-05-10T22:42:06.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:42:00+00:00, run_after=2024-05-10T22:43:00+00:00 2024-05-10T22:42:06.841807822Z [2024-05-10T22:42:06.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:42:06.843957245Z [2024-05-10T22:42:06.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:41:00+00:00, run_id=scheduled__2024-05-10T22:41:00+00:00, run_start_date=2024-05-10 22:42:00.804081+00:00, run_end_date=2024-05-10 22:42:06.841417+00:00, run_duration=6.037336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:41:00+00:00, data_interval_end=2024-05-10 22:42:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:42:06.864762755Z [2024-05-10T22:42:06.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:42:00+00:00, run_after=2024-05-10T22:43:00+00:00 2024-05-10T22:42:06.953870673Z [2024-05-10T22:42:06.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:41:00+00:00 exited with status success for try_number 1 2024-05-10T22:42:06.953910705Z [2024-05-10T22:42:06.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:41:00+00:00 exited with status success for try_number 1 2024-05-10T22:42:06.978492952Z [2024-05-10T22:42:06.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:41:00+00:00, map_index=-1, run_start_date=2024-05-10 22:42:04.342318+00:00, run_end_date=2024-05-10 22:42:06.327206+00:00, run_duration=1.984888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:42:00.909029+00:00, queued_by_job_id=2, pid=1125 2024-05-10T22:42:06.978889356Z [2024-05-10T22:42:06.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:41:00+00:00, map_index=-1, run_start_date=2024-05-10 22:42:04.344409+00:00, run_end_date=2024-05-10 22:42:05.914485+00:00, run_duration=1.570076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:42:00.909029+00:00, queued_by_job_id=2, pid=1126 2024-05-10T22:43:00.914486742Z [2024-05-10T22:43:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:43:00+00:00, run_after=2024-05-10T22:44:00+00:00 2024-05-10T22:43:00.925982061Z [2024-05-10T22:43:00.925+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:43:00.939664448Z [2024-05-10T22:43:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:43:00+00:00, run_after=2024-05-10T22:44:00+00:00 2024-05-10T22:43:01.046116738Z [2024-05-10T22:43:01.045+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:43:01.046160830Z 2024-05-10T22:43:01.046170575Z 2024-05-10T22:43:01.046179044Z 2024-05-10T22:43:01.046307507Z [2024-05-10T22:43:01.045+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:43:01.046319168Z [2024-05-10T22:43:01.046+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:43:01.046415737Z [2024-05-10T22:43:01.046+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:43:01.046834470Z [2024-05-10T22:43:01.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:43:01.046850905Z 2024-05-10T22:43:01.046859681Z 2024-05-10T22:43:01.046868062Z 2024-05-10T22:43:01.054382923Z [2024-05-10T22:43:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:43:01.054416922Z [2024-05-10T22:43:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:43:01.054426356Z [2024-05-10T22:43:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:43:01.054434874Z [2024-05-10T22:43:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:43:01.054443175Z [2024-05-10T22:43:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:43:01.054451482Z [2024-05-10T22:43:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:43:01.380806417Z [2024-05-10T22:43:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status queued for try_number 1 2024-05-10T22:43:01.380872135Z [2024-05-10T22:43:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status queued for try_number 1 2024-05-10T22:43:01.380900433Z [2024-05-10T22:43:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status queued for try_number 1 2024-05-10T22:43:01.395858557Z [2024-05-10T22:43:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3f72da8-44fb-486e-b42d-4f26a6134a4c 2024-05-10T22:43:01.396061467Z [2024-05-10T22:43:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f552fcb-4ca3-4f3c-ae89-da7a75db4c2e 2024-05-10T22:43:01.396213919Z [2024-05-10T22:43:01.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to edfad9b9-848f-47de-9bca-aa4125e60d0a 2024-05-10T22:43:02.794946148Z [2024-05-10T22:43:02.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:43:02.795560051Z [2024-05-10T22:43:02.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:42:00+00:00, run_id=scheduled__2024-05-10T22:42:00+00:00, run_start_date=2024-05-10 22:43:00.953234+00:00, run_end_date=2024-05-10 22:43:02.794713+00:00, run_duration=1.841479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:42:00+00:00, data_interval_end=2024-05-10 22:43:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:43:02.806178157Z [2024-05-10T22:43:02.805+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:43:00+00:00, run_after=2024-05-10T22:44:00+00:00 2024-05-10T22:43:02.868467267Z [2024-05-10T22:43:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status success for try_number 1 2024-05-10T22:43:02.876184143Z [2024-05-10T22:43:02.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:42:00+00:00, map_index=-1, run_start_date=2024-05-10 22:43:01.858973+00:00, run_end_date=2024-05-10 22:43:02.285353+00:00, run_duration=0.42638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:43:01.047623+00:00, queued_by_job_id=2, pid=1157 2024-05-10T22:43:05.059566898Z [2024-05-10T22:43:05.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:43:05.061375785Z [2024-05-10T22:43:05.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:42:00+00:00, run_id=scheduled__2024-05-10T22:42:00+00:00, run_start_date=2024-05-10 22:43:00.955770+00:00, run_end_date=2024-05-10 22:43:05.059514+00:00, run_duration=4.103744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:42:00+00:00, data_interval_end=2024-05-10 22:43:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:43:05.073106949Z [2024-05-10T22:43:05.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:43:00+00:00, run_after=2024-05-10T22:44:00+00:00 2024-05-10T22:43:06.402892530Z [2024-05-10T22:43:06.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:43:06.402952489Z [2024-05-10T22:43:06.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:42:00+00:00, run_id=scheduled__2024-05-10T22:42:00+00:00, run_start_date=2024-05-10 22:43:00.954598+00:00, run_end_date=2024-05-10 22:43:06.402703+00:00, run_duration=5.448105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:42:00+00:00, data_interval_end=2024-05-10 22:43:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:43:06.412560295Z [2024-05-10T22:43:06.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:43:00+00:00, run_after=2024-05-10T22:44:00+00:00 2024-05-10T22:43:06.436866630Z [2024-05-10T22:43:06.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status success for try_number 1 2024-05-10T22:43:06.436908575Z [2024-05-10T22:43:06.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status success for try_number 1 2024-05-10T22:43:06.442448431Z [2024-05-10T22:43:06.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:42:00+00:00, map_index=-1, run_start_date=2024-05-10 22:43:02.948079+00:00, run_end_date=2024-05-10 22:43:05.015931+00:00, run_duration=2.067852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:43:01.047623+00:00, queued_by_job_id=2, pid=1175 2024-05-10T22:43:06.442580214Z [2024-05-10T22:43:06.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:42:00+00:00, map_index=-1, run_start_date=2024-05-10 22:43:02.952532+00:00, run_end_date=2024-05-10 22:43:05.179509+00:00, run_duration=2.226977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:43:01.047623+00:00, queued_by_job_id=2, pid=1176 2024-05-10T22:44:00.795560193Z [2024-05-10T22:44:00.794+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:44:00.819520689Z [2024-05-10T22:44:00.819+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:44:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:44:00.847932551Z [2024-05-10T22:44:00.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:44:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:44:00.859816377Z [2024-05-10T22:44:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:44:00.933034905Z [2024-05-10T22:44:00.932+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:44:00.933083719Z 2024-05-10T22:44:00.933094750Z 2024-05-10T22:44:00.933103827Z 2024-05-10T22:44:00.933112384Z 2024-05-10T22:44:00.933135891Z [2024-05-10T22:44:00.932+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:44:00.933280865Z [2024-05-10T22:44:00.933+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:44:00.933563328Z [2024-05-10T22:44:00.933+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:44:00.933606492Z [2024-05-10T22:44:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:44:00.934748606Z [2024-05-10T22:44:00.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:44:00.934786652Z 2024-05-10T22:44:00.934796464Z 2024-05-10T22:44:00.934805027Z 2024-05-10T22:44:00.934813414Z 2024-05-10T22:44:00.938011952Z [2024-05-10T22:44:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:44:00.938277077Z [2024-05-10T22:44:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:44:00.938696271Z [2024-05-10T22:44:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:44:00.938750155Z [2024-05-10T22:44:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:44:00.939151469Z [2024-05-10T22:44:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:44:00.939325727Z [2024-05-10T22:44:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:44:00.939739380Z [2024-05-10T22:44:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:44:00.940090796Z [2024-05-10T22:44:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:44:01.321491820Z [2024-05-10T22:44:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status queued for try_number 1 2024-05-10T22:44:01.323691826Z [2024-05-10T22:44:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:43:00+00:00 exited with status queued for try_number 1 2024-05-10T22:44:01.323939936Z [2024-05-10T22:44:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:43:00+00:00 exited with status queued for try_number 1 2024-05-10T22:44:01.324145906Z [2024-05-10T22:44:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:43:00+00:00 exited with status queued for try_number 1 2024-05-10T22:44:01.336895111Z [2024-05-10T22:44:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d168851-970d-41b0-a18f-afd3d7e1e99a 2024-05-10T22:44:01.337217754Z [2024-05-10T22:44:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79a48e03-d7ff-461d-95ae-eade8f64217c 2024-05-10T22:44:01.337400995Z [2024-05-10T22:44:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0872351f-5c4f-4dad-9cba-eef7f8627003 2024-05-10T22:44:01.337635381Z [2024-05-10T22:44:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c1c7e2d-2ce3-4b7e-8b9b-943cd44f7808 2024-05-10T22:44:02.571324293Z [2024-05-10T22:44:02.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:44:02.571695042Z [2024-05-10T22:44:02.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:42:00+00:00, run_id=scheduled__2024-05-10T22:42:00+00:00, run_start_date=2024-05-10 22:44:00.871171+00:00, run_end_date=2024-05-10 22:44:02.571270+00:00, run_duration=1.700099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:42:00+00:00, data_interval_end=2024-05-10 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:44:02.583901655Z [2024-05-10T22:44:02.583+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:44:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:44:02.592946746Z [2024-05-10T22:44:02.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:44:02.593295832Z [2024-05-10T22:44:02.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:43:00+00:00, run_id=scheduled__2024-05-10T22:43:00+00:00, run_start_date=2024-05-10 22:44:00.873462+00:00, run_end_date=2024-05-10 22:44:02.592868+00:00, run_duration=1.719406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:43:00+00:00, data_interval_end=2024-05-10 22:44:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:44:02.603279877Z [2024-05-10T22:44:02.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:44:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:44:02.653654465Z [2024-05-10T22:44:02.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:42:00+00:00 exited with status success for try_number 1 2024-05-10T22:44:02.653730867Z [2024-05-10T22:44:02.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:43:00+00:00 exited with status success for try_number 1 2024-05-10T22:44:02.665936079Z [2024-05-10T22:44:02.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:42:00+00:00, map_index=-1, run_start_date=2024-05-10 22:44:01.902029+00:00, run_end_date=2024-05-10 22:44:02.274622+00:00, run_duration=0.372593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:44:00.935589+00:00, queued_by_job_id=2, pid=1210 2024-05-10T22:44:02.666054018Z [2024-05-10T22:44:02.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:43:00+00:00, map_index=-1, run_start_date=2024-05-10 22:44:01.844836+00:00, run_end_date=2024-05-10 22:44:02.290003+00:00, run_duration=0.445167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:44:00.935589+00:00, queued_by_job_id=2, pid=1209 2024-05-10T22:44:04.867336279Z [2024-05-10T22:44:04.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:44:04.867763739Z [2024-05-10T22:44:04.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:43:00+00:00, run_id=scheduled__2024-05-10T22:43:00+00:00, run_start_date=2024-05-10 22:44:00.874885+00:00, run_end_date=2024-05-10 22:44:04.867118+00:00, run_duration=3.992233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:43:00+00:00, data_interval_end=2024-05-10 22:44:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:44:04.881815670Z [2024-05-10T22:44:04.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:44:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:44:04.936832772Z [2024-05-10T22:44:04.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:43:00+00:00 exited with status success for try_number 1 2024-05-10T22:44:04.945225690Z [2024-05-10T22:44:04.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:43:00+00:00, map_index=-1, run_start_date=2024-05-10 22:44:03.019492+00:00, run_end_date=2024-05-10 22:44:04.487405+00:00, run_duration=1.467913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:44:00.935589+00:00, queued_by_job_id=2, pid=1233 2024-05-10T22:44:06.018125810Z [2024-05-10T22:44:06.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:44:06.018718895Z [2024-05-10T22:44:06.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:43:00+00:00, run_id=scheduled__2024-05-10T22:43:00+00:00, run_start_date=2024-05-10 22:44:00.875972+00:00, run_end_date=2024-05-10 22:44:06.017827+00:00, run_duration=5.141855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:43:00+00:00, data_interval_end=2024-05-10 22:44:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:44:06.035169486Z [2024-05-10T22:44:06.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:44:00+00:00, run_after=2024-05-10T22:45:00+00:00 2024-05-10T22:44:06.075323303Z [2024-05-10T22:44:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:43:00+00:00 exited with status success for try_number 1 2024-05-10T22:44:06.090138540Z [2024-05-10T22:44:06.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:43:00+00:00, map_index=-1, run_start_date=2024-05-10 22:44:03.066297+00:00, run_end_date=2024-05-10 22:44:05.061470+00:00, run_duration=1.995173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:44:00.935589+00:00, queued_by_job_id=2, pid=1234 2024-05-10T22:45:00.611153436Z [2024-05-10T22:45:00.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:45:00.623582664Z [2024-05-10T22:45:00.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:00.638937544Z [2024-05-10T22:45:00.638+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:00.646221857Z [2024-05-10T22:45:00.645+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:45:00.760238090Z [2024-05-10T22:45:00.759+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:45:00.760261865Z 2024-05-10T22:45:00.760266859Z 2024-05-10T22:45:00.760270948Z 2024-05-10T22:45:00.760274557Z 2024-05-10T22:45:00.760345131Z [2024-05-10T22:45:00.760+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:45:00.760518324Z [2024-05-10T22:45:00.760+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:45:00.760663987Z [2024-05-10T22:45:00.760+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:45:00.760798008Z [2024-05-10T22:45:00.760+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:45:00.761459914Z [2024-05-10T22:45:00.761+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:00.761475736Z 2024-05-10T22:45:00.761481117Z 2024-05-10T22:45:00.761485699Z 2024-05-10T22:45:00.761490405Z 2024-05-10T22:45:00.765563423Z [2024-05-10T22:45:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:45:00.765701924Z [2024-05-10T22:45:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:00.766041319Z [2024-05-10T22:45:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:00.766174160Z [2024-05-10T22:45:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:45:00.766414281Z [2024-05-10T22:45:00.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:00.766546953Z [2024-05-10T22:45:00.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:45:00.766789921Z [2024-05-10T22:45:00.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:00.766928768Z [2024-05-10T22:45:00.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:45:01.207788081Z [2024-05-10T22:45:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:01.208091614Z [2024-05-10T22:45:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:01.208257159Z [2024-05-10T22:45:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:01.208389258Z [2024-05-10T22:45:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:01.219726195Z [2024-05-10T22:45:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcadf9e5-1d86-437c-9518-af161a58e577 2024-05-10T22:45:01.219832792Z [2024-05-10T22:45:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1755d39e-83ab-414c-b7bc-62cd5dec977b 2024-05-10T22:45:01.220342680Z [2024-05-10T22:45:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74578d07-369d-4b3c-bc43-f16c6cbb48ed 2024-05-10T22:45:01.220500790Z [2024-05-10T22:45:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to cae41eb9-5921-4001-afda-4f60330a73cd 2024-05-10T22:45:02.568048091Z [2024-05-10T22:45:02.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:02.568672005Z [2024-05-10T22:45:02.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:44:00+00:00, run_id=scheduled__2024-05-10T22:44:00+00:00, run_start_date=2024-05-10 22:45:00.661432+00:00, run_end_date=2024-05-10 22:45:02.568286+00:00, run_duration=1.906854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:44:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:45:02.580471266Z [2024-05-10T22:45:02.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:02.628741540Z [2024-05-10T22:45:02.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:02.635992240Z [2024-05-10T22:45:02.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:44:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:01.841288+00:00, run_end_date=2024-05-10 22:45:02.247341+00:00, run_duration=0.406053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:00.762315+00:00, queued_by_job_id=2, pid=1267 2024-05-10T22:45:04.261658104Z [2024-05-10T22:45:04.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:04.262045214Z [2024-05-10T22:45:04.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:44:00+00:00, run_id=scheduled__2024-05-10T22:44:00+00:00, run_start_date=2024-05-10 22:45:00.660362+00:00, run_end_date=2024-05-10 22:45:04.261548+00:00, run_duration=3.601186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:44:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:45:04.275192148Z [2024-05-10T22:45:04.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:04.320272408Z [2024-05-10T22:45:04.319+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:04.320300699Z 2024-05-10T22:45:04.321054603Z [2024-05-10T22:45:04.320+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:45:04.321944909Z [2024-05-10T22:45:04.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:04.321964750Z 2024-05-10T22:45:04.324741457Z [2024-05-10T22:45:04.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:45:04.325024351Z [2024-05-10T22:45:04.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:04.372379189Z [2024-05-10T22:45:04.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:04.372614935Z [2024-05-10T22:45:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:04.372825922Z [2024-05-10T22:45:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:04.385916270Z [2024-05-10T22:45:04.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e02ca4d-42ec-4c2a-ac5c-225f64c82d0d 2024-05-10T22:45:04.386104340Z [2024-05-10T22:45:04.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:02.987853+00:00, run_end_date=2024-05-10 22:45:03.392430+00:00, run_duration=0.404577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:00.762315+00:00, queued_by_job_id=2, pid=1293 2024-05-10T22:45:04.386505437Z [2024-05-10T22:45:04.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:44:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:02.747322+00:00, run_end_date=2024-05-10 22:45:04.082953+00:00, run_duration=1.335631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:00.762315+00:00, queued_by_job_id=2, pid=1286 2024-05-10T22:45:04.432632924Z [2024-05-10T22:45:04.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:04.432783806Z [2024-05-10T22:45:04.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:44:00+00:00, run_id=scheduled__2024-05-10T22:44:00+00:00, run_start_date=2024-05-10 22:45:00.662407+00:00, run_end_date=2024-05-10 22:45:04.432531+00:00, run_duration=3.770124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:44:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:45:04.442099577Z [2024-05-10T22:45:04.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:04.670336322Z [2024-05-10T22:45:04.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:04.680372167Z [2024-05-10T22:45:04.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:44:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:02.791480+00:00, run_end_date=2024-05-10 22:45:04.405852+00:00, run_duration=1.614372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:00.762315+00:00, queued_by_job_id=2, pid=1292 2024-05-10T22:45:06.900194433Z [2024-05-10T22:45:06.898+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:06.900223794Z 2024-05-10T22:45:06.900227393Z [2024-05-10T22:45:06.898+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:45:06.900243465Z [2024-05-10T22:45:06.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:06.900246750Z 2024-05-10T22:45:06.903333782Z [2024-05-10T22:45:06.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:45:06.903350279Z [2024-05-10T22:45:06.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:45:06.962397029Z [2024-05-10T22:45:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:06.962589322Z [2024-05-10T22:45:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:06.969830075Z [2024-05-10T22:45:06.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:06.075025+00:00, run_end_date=2024-05-10 22:45:06.439160+00:00, run_duration=0.364135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:04.322365+00:00, queued_by_job_id=2, pid=1326 2024-05-10T22:45:06.970124046Z [2024-05-10T22:45:06.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92a1cbe2-09a6-461c-875f-a95094ff3300 2024-05-10T22:45:09.576778521Z [2024-05-10T22:45:09.576+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:09.576827794Z 2024-05-10T22:45:09.576837969Z [2024-05-10T22:45:09.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:45:09.577340527Z [2024-05-10T22:45:09.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:09.577366258Z 2024-05-10T22:45:09.579707977Z [2024-05-10T22:45:09.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:09.579777788Z [2024-05-10T22:45:09.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:09.645437612Z [2024-05-10T22:45:09.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:09.645467454Z [2024-05-10T22:45:09.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:09.657342597Z [2024-05-10T22:45:09.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=0, run_start_date=2024-05-10 22:45:08.678235+00:00, run_end_date=2024-05-10 22:45:09.062358+00:00, run_duration=0.384123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:06.900477+00:00, queued_by_job_id=2, pid=1337 2024-05-10T22:45:09.658039187Z [2024-05-10T22:45:09.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87eb4536-0a46-4a65-9fc1-062102b87c20 2024-05-10T22:45:12.994380531Z [2024-05-10T22:45:12.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:12.994762217Z [2024-05-10T22:45:12.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:40:00+00:00, run_id=scheduled__2024-05-10T22:40:00+00:00, run_start_date=2024-05-10 22:45:00.658928+00:00, run_end_date=2024-05-10 22:45:12.994116+00:00, run_duration=12.335188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:40:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T22:45:13.002324794Z [2024-05-10T22:45:13.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:45:13.035685187Z [2024-05-10T22:45:13.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:13.041850848Z [2024-05-10T22:45:13.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:11.507222+00:00, run_end_date=2024-05-10 22:45:11.914999+00:00, run_duration=0.407777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:09.577593+00:00, queued_by_job_id=2, pid=1345 2024-05-10T22:45:20.964691405Z [2024-05-10T22:45:20.964+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:45:20.979278780Z [2024-05-10T22:45:20.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:21.026120802Z [2024-05-10T22:45:21.024+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-10T22:45:21.026154761Z 2024-05-10T22:45:21.026158497Z 2024-05-10T22:45:21.026161818Z [2024-05-10T22:45:21.024+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:45:21.026164686Z [2024-05-10T22:45:21.024+0000] {scheduler_job.py:425} INFO - DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:45:21.026168187Z [2024-05-10T22:45:21.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:21.026170998Z 2024-05-10T22:45:21.026173979Z 2024-05-10T22:45:21.069364518Z [2024-05-10T22:45:21.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:21.069385199Z [2024-05-10T22:45:21.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:45:21.069388938Z [2024-05-10T22:45:21.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:21.069392162Z [2024-05-10T22:45:21.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:45:21.340899343Z [2024-05-10T22:45:21.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:21.341005407Z [2024-05-10T22:45:21.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:21.354221866Z [2024-05-10T22:45:21.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a605b3d-7ef5-4af3-a7cb-9d6628345645 2024-05-10T22:45:21.354394673Z [2024-05-10T22:45:21.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6483913-83ba-46fe-8113-aadb389c90e5 2024-05-10T22:45:23.299151379Z [2024-05-10T22:45:23.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:45:23.389504464Z [2024-05-10T22:45:23.388+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:23.389539806Z 2024-05-10T22:45:23.389545953Z [2024-05-10T22:45:23.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:45:23.390762449Z [2024-05-10T22:45:23.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:23.390782017Z 2024-05-10T22:45:23.394494652Z [2024-05-10T22:45:23.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:45:23.394694695Z [2024-05-10T22:45:23.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:23.448304182Z [2024-05-10T22:45:23.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:23.455448485Z [2024-05-10T22:45:23.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 677c951c-5be7-41f8-b831-edb4011ff143 2024-05-10T22:45:24.599495165Z [2024-05-10T22:45:24.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:24.599838463Z [2024-05-10T22:45:24.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:44:00+00:00, run_id=scheduled__2024-05-10T22:44:00+00:00, run_start_date=2024-05-10 22:45:20.987434+00:00, run_end_date=2024-05-10 22:45:24.599375+00:00, run_duration=3.611941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:44:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=80cd430c2a147a1e8a940bc8984ab764 2024-05-10T22:45:24.611935220Z [2024-05-10T22:45:24.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:24.620947958Z [2024-05-10T22:45:24.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:24.621323554Z [2024-05-10T22:45:24.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:44:00+00:00, run_id=scheduled__2024-05-10T22:44:00+00:00, run_start_date=2024-05-10 22:45:20.987902+00:00, run_end_date=2024-05-10 22:45:24.620851+00:00, run_duration=3.632949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:44:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=84476b2de8160b008738a9646694c31e 2024-05-10T22:45:24.635202891Z [2024-05-10T22:45:24.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:46:00+00:00 2024-05-10T22:45:24.688931950Z [2024-05-10T22:45:24.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:24.689178764Z [2024-05-10T22:45:24.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:24.694852175Z [2024-05-10T22:45:24.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:44:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:22.849728+00:00, run_end_date=2024-05-10 22:45:24.369748+00:00, run_duration=1.52002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:21.026870+00:00, queued_by_job_id=2, pid=1361 2024-05-10T22:45:24.695161527Z [2024-05-10T22:45:24.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:44:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:22.776167+00:00, run_end_date=2024-05-10 22:45:24.023664+00:00, run_duration=1.247497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:21.026870+00:00, queued_by_job_id=2, pid=1360 2024-05-10T22:45:26.087868080Z [2024-05-10T22:45:26.087+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:26.088015249Z 2024-05-10T22:45:26.088049589Z [2024-05-10T22:45:26.087+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:45:26.088535054Z [2024-05-10T22:45:26.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:26.088557854Z 2024-05-10T22:45:26.090975853Z [2024-05-10T22:45:26.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='split_metrics', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:45:26.091260716Z [2024-05-10T22:45:26.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'split_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:26.153768630Z [2024-05-10T22:45:26.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.split_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:26.153941780Z [2024-05-10T22:45:26.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:26.160184810Z [2024-05-10T22:45:26.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:24.904462+00:00, run_end_date=2024-05-10 22:45:25.279857+00:00, run_duration=0.375395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:23.391798+00:00, queued_by_job_id=2, pid=1379 2024-05-10T22:45:26.160405831Z [2024-05-10T22:45:26.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4ae2f72-d6df-44b8-ac5f-df37acb202e8 2024-05-10T22:45:28.388319731Z [2024-05-10T22:45:28.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:28.388350157Z 2024-05-10T22:45:28.388534044Z [2024-05-10T22:45:28.388+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:45:28.389179881Z [2024-05-10T22:45:28.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:28.389200692Z 2024-05-10T22:45:28.391577229Z [2024-05-10T22:45:28.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:45:28.391771255Z [2024-05-10T22:45:28.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'collect_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:45:28.430366339Z [2024-05-10T22:45:28.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.collect_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:28.430698831Z [2024-05-10T22:45:28.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.split_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:28.442501945Z [2024-05-10T22:45:28.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=split_metrics, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:27.723629+00:00, run_end_date=2024-05-10 22:45:28.058271+00:00, run_duration=0.334642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:26.088904+00:00, queued_by_job_id=2, pid=1392 2024-05-10T22:45:28.442846044Z [2024-05-10T22:45:28.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae5aa38c-9501-480d-ade1-6c77f8d92e3d 2024-05-10T22:45:31.182827826Z [2024-05-10T22:45:31.182+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:45:31.182852572Z 2024-05-10T22:45:31.183259897Z [2024-05-10T22:45:31.182+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:45:31.183411648Z [2024-05-10T22:45:31.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:45:31.183439416Z 2024-05-10T22:45:31.185560563Z [2024-05-10T22:45:31.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:45:31.185783154Z [2024-05-10T22:45:31.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'send_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:31.244068160Z [2024-05-10T22:45:31.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.send_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status queued for try_number 1 2024-05-10T22:45:31.244281370Z [2024-05-10T22:45:31.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.collect_metrics run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:31.250741154Z [2024-05-10T22:45:31.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=0, run_start_date=2024-05-10 22:45:30.018217+00:00, run_end_date=2024-05-10 22:45:30.352925+00:00, run_duration=0.334708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:28.389517+00:00, queued_by_job_id=2, pid=1400 2024-05-10T22:45:31.251095393Z [2024-05-10T22:45:31.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd8c2af6-e3df-49e1-8ebb-92459d142039 2024-05-10T22:45:33.204344690Z [2024-05-10T22:45:33.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:45:33.204541270Z [2024-05-10T22:45:33.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:40:00+00:00, run_id=scheduled__2024-05-10T22:40:00+00:00, run_start_date=2024-05-10 22:45:23.314659+00:00, run_end_date=2024-05-10 22:45:33.204154+00:00, run_duration=9.889495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:40:00+00:00, data_interval_end=2024-05-10 22:45:00+00:00, dag_hash=b7b0112ac819b3890e9500ee6cb8f128 2024-05-10T22:45:33.210642360Z [2024-05-10T22:45:33.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:45:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:45:33.242482006Z [2024-05-10T22:45:33.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd.send_prometheus run_id=scheduled__2024-05-10T22:40:00+00:00 exited with status success for try_number 1 2024-05-10T22:45:33.248879062Z [2024-05-10T22:45:33.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:40:00+00:00, map_index=-1, run_start_date=2024-05-10 22:45:32.709134+00:00, run_end_date=2024-05-10 22:45:33.036419+00:00, run_duration=0.327285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:45:31.183641+00:00, queued_by_job_id=2, pid=1408 2024-05-10T22:45:33.260429849Z [2024-05-10T22:45:33.260+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:46:00.521741902Z [2024-05-10T22:46:00.521+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:46:00.536571559Z [2024-05-10T22:46:00.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:00.563073835Z [2024-05-10T22:46:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:00.576253301Z [2024-05-10T22:46:00.575+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:46:00.596558059Z [2024-05-10T22:46:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:00.608209247Z [2024-05-10T22:46:00.607+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:46:00.721547495Z [2024-05-10T22:46:00.720+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-10T22:46:00.721580317Z 2024-05-10T22:46:00.721588010Z 2024-05-10T22:46:00.721594827Z 2024-05-10T22:46:00.721600537Z 2024-05-10T22:46:00.721606851Z 2024-05-10T22:46:00.721612711Z 2024-05-10T22:46:00.721619256Z [2024-05-10T22:46:00.721+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:46:00.721746698Z [2024-05-10T22:46:00.721+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:46:00.722154381Z [2024-05-10T22:46:00.721+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:46:00.722359150Z [2024-05-10T22:46:00.722+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:46:00.722579821Z [2024-05-10T22:46:00.722+0000] {scheduler_job.py:425} INFO - DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:46:00.722775873Z [2024-05-10T22:46:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:46:00.723827415Z [2024-05-10T22:46:00.723+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:46:00.723839117Z 2024-05-10T22:46:00.723845441Z 2024-05-10T22:46:00.723851022Z 2024-05-10T22:46:00.723856615Z 2024-05-10T22:46:00.723862030Z 2024-05-10T22:46:00.723867536Z 2024-05-10T22:46:00.733997370Z [2024-05-10T22:46:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:46:00.734043284Z [2024-05-10T22:46:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:46:00.734340860Z [2024-05-10T22:46:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:46:00.734484528Z [2024-05-10T22:46:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:46:00.734720550Z [2024-05-10T22:46:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:46:00.734844325Z [2024-05-10T22:46:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:46:00.735139270Z [2024-05-10T22:46:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:46:00.735177814Z [2024-05-10T22:46:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:46:00.735439031Z [2024-05-10T22:46:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:46:00.735574080Z [2024-05-10T22:46:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:46:00.736045858Z [2024-05-10T22:46:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:46:00.736062210Z [2024-05-10T22:46:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:46:01.398913491Z [2024-05-10T22:46:01.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status queued for try_number 1 2024-05-10T22:46:01.399130751Z [2024-05-10T22:46:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:46:01.399212028Z [2024-05-10T22:46:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:46:01.399271694Z [2024-05-10T22:46:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:46:01.399343528Z [2024-05-10T22:46:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:46:01.399409990Z [2024-05-10T22:46:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:46:01.423225058Z [2024-05-10T22:46:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0fa39b0-d8b1-48be-b21d-67af5c394ce4 2024-05-10T22:46:01.423252808Z [2024-05-10T22:46:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2b60a4b-7623-4969-806f-f8cadc23b6af 2024-05-10T22:46:01.426095860Z [2024-05-10T22:46:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 152fd0b0-2237-4a92-94c6-3eaa51eba7f9 2024-05-10T22:46:01.426252164Z [2024-05-10T22:46:01.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b595133-45b8-4f64-ad79-cbfd663face7 2024-05-10T22:46:01.426354917Z [2024-05-10T22:46:01.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to c689e6e6-2592-49a4-8061-7be3eb7ac2ed 2024-05-10T22:46:01.426454106Z [2024-05-10T22:46:01.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0458ef89-284f-469b-9681-b272b832008f 2024-05-10T22:46:02.829108081Z [2024-05-10T22:46:02.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:46:02.829401582Z [2024-05-10T22:46:02.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:44:00+00:00, run_id=scheduled__2024-05-10T22:44:00+00:00, run_start_date=2024-05-10 22:46:00.629557+00:00, run_end_date=2024-05-10 22:46:02.829045+00:00, run_duration=2.199488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:44:00+00:00, data_interval_end=2024-05-10 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:46:02.842411053Z [2024-05-10T22:46:02.841+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:46:02.946870019Z [2024-05-10T22:46:02.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:44:00+00:00 exited with status success for try_number 1 2024-05-10T22:46:02.959467713Z [2024-05-10T22:46:02.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:44:00+00:00, map_index=-1, run_start_date=2024-05-10 22:46:02.218527+00:00, run_end_date=2024-05-10 22:46:02.668274+00:00, run_duration=0.449747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:46:00.726983+00:00, queued_by_job_id=2, pid=1421 2024-05-10T22:46:03.691262449Z [2024-05-10T22:46:03.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:46:03.691504615Z [2024-05-10T22:46:03.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:45:00+00:00, run_id=scheduled__2024-05-10T22:45:00+00:00, run_start_date=2024-05-10 22:46:00.634534+00:00, run_end_date=2024-05-10 22:46:03.691135+00:00, run_duration=3.056601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:45:00+00:00, data_interval_end=2024-05-10 22:46:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:46:03.703801182Z [2024-05-10T22:46:03.703+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:03.767662623Z [2024-05-10T22:46:03.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:46:03.774949646Z [2024-05-10T22:46:03.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:46:02.435601+00:00, run_end_date=2024-05-10 22:46:02.902217+00:00, run_duration=0.466616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:46:00.726983+00:00, queued_by_job_id=2, pid=1423 2024-05-10T22:46:04.813039623Z [2024-05-10T22:46:04.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:46:04.813340488Z [2024-05-10T22:46:04.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:45:00+00:00, run_id=scheduled__2024-05-10T22:45:00+00:00, run_start_date=2024-05-10 22:46:00.635978+00:00, run_end_date=2024-05-10 22:46:04.812884+00:00, run_duration=4.176906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:45:00+00:00, data_interval_end=2024-05-10 22:46:00+00:00, dag_hash=84476b2de8160b008738a9646694c31e 2024-05-10T22:46:04.821561770Z [2024-05-10T22:46:04.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:05.899612695Z [2024-05-10T22:46:05.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:46:05.899794846Z [2024-05-10T22:46:05.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:45:00+00:00, run_id=scheduled__2024-05-10T22:45:00+00:00, run_start_date=2024-05-10 22:46:00.633052+00:00, run_end_date=2024-05-10 22:46:05.899476+00:00, run_duration=5.266424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:45:00+00:00, data_interval_end=2024-05-10 22:46:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:46:05.908405098Z [2024-05-10T22:46:05.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:05.914302697Z [2024-05-10T22:46:05.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:46:05.914534485Z [2024-05-10T22:46:05.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:45:00+00:00, run_id=scheduled__2024-05-10T22:45:00+00:00, run_start_date=2024-05-10 22:46:00.637333+00:00, run_end_date=2024-05-10 22:46:05.914175+00:00, run_duration=5.276842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:45:00+00:00, data_interval_end=2024-05-10 22:46:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:46:05.922714449Z [2024-05-10T22:46:05.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:05.928591803Z [2024-05-10T22:46:05.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:46:05.928852508Z [2024-05-10T22:46:05.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:45:00+00:00, run_id=scheduled__2024-05-10T22:45:00+00:00, run_start_date=2024-05-10 22:46:00.631451+00:00, run_end_date=2024-05-10 22:46:05.928491+00:00, run_duration=5.29704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:45:00+00:00, data_interval_end=2024-05-10 22:46:00+00:00, dag_hash=80cd430c2a147a1e8a940bc8984ab764 2024-05-10T22:46:05.939520635Z [2024-05-10T22:46:05.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:46:00+00:00, run_after=2024-05-10T22:47:00+00:00 2024-05-10T22:46:05.969540804Z [2024-05-10T22:46:05.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:46:05.969581494Z [2024-05-10T22:46:05.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:46:05.969678675Z [2024-05-10T22:46:05.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:46:05.969932727Z [2024-05-10T22:46:05.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:46:05.976832830Z [2024-05-10T22:46:05.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:46:03.520255+00:00, run_end_date=2024-05-10 22:46:04.748419+00:00, run_duration=1.228164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:46:00.726983+00:00, queued_by_job_id=2, pid=1458 2024-05-10T22:46:05.977007285Z [2024-05-10T22:46:05.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:46:03.451035+00:00, run_end_date=2024-05-10 22:46:04.980526+00:00, run_duration=1.529491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:46:00.726983+00:00, queued_by_job_id=2, pid=1457 2024-05-10T22:46:05.977220334Z [2024-05-10T22:46:05.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:46:03.115973+00:00, run_end_date=2024-05-10 22:46:05.030657+00:00, run_duration=1.914684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:46:00.726983+00:00, queued_by_job_id=2, pid=1440 2024-05-10T22:46:05.977463881Z [2024-05-10T22:46:05.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:46:03.955791+00:00, run_end_date=2024-05-10 22:46:05.648630+00:00, run_duration=1.692839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:46:00.726983+00:00, queued_by_job_id=2, pid=1474 2024-05-10T22:47:00.398524824Z [2024-05-10T22:47:00.397+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:47:00.424128131Z [2024-05-10T22:47:00.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:00.440222497Z [2024-05-10T22:47:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:00.452628609Z [2024-05-10T22:47:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:00.459507212Z [2024-05-10T22:47:00.459+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:47:00.557654652Z [2024-05-10T22:47:00.557+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T22:47:00.557686796Z 2024-05-10T22:47:00.557690395Z 2024-05-10T22:47:00.557693496Z 2024-05-10T22:47:00.557696611Z 2024-05-10T22:47:00.557699568Z 2024-05-10T22:47:00.557946220Z [2024-05-10T22:47:00.557+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:47:00.558142897Z [2024-05-10T22:47:00.557+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:47:00.558290046Z [2024-05-10T22:47:00.558+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:47:00.558426059Z [2024-05-10T22:47:00.558+0000] {scheduler_job.py:425} INFO - DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:47:00.558577213Z [2024-05-10T22:47:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:47:00.559226062Z [2024-05-10T22:47:00.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:47:00.559243803Z 2024-05-10T22:47:00.559249731Z 2024-05-10T22:47:00.559255587Z 2024-05-10T22:47:00.559261393Z 2024-05-10T22:47:00.559266870Z 2024-05-10T22:47:00.564392682Z [2024-05-10T22:47:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:47:00.564574236Z [2024-05-10T22:47:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:47:00.564976978Z [2024-05-10T22:47:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:47:00.565187794Z [2024-05-10T22:47:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:47:00.565486676Z [2024-05-10T22:47:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:47:00.565674378Z [2024-05-10T22:47:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:47:00.566032822Z [2024-05-10T22:47:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:47:00.566283464Z [2024-05-10T22:47:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:47:00.566557351Z [2024-05-10T22:47:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:47:00.566728426Z [2024-05-10T22:47:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:47:01.029973869Z [2024-05-10T22:47:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status queued for try_number 1 2024-05-10T22:47:01.029998085Z [2024-05-10T22:47:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status queued for try_number 1 2024-05-10T22:47:01.030001546Z [2024-05-10T22:47:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status queued for try_number 1 2024-05-10T22:47:01.030004961Z [2024-05-10T22:47:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status queued for try_number 1 2024-05-10T22:47:01.030008449Z [2024-05-10T22:47:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status queued for try_number 1 2024-05-10T22:47:01.058167378Z [2024-05-10T22:47:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to c259c297-7596-4019-a9c8-66a797b4afca 2024-05-10T22:47:01.058197711Z [2024-05-10T22:47:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to acfbadb5-034f-4111-a4ba-5a7517f55697 2024-05-10T22:47:01.058200993Z [2024-05-10T22:47:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a469fe8-70ad-4abd-9cd1-5143a3bfc28d 2024-05-10T22:47:01.065960422Z [2024-05-10T22:47:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to c855af0a-3d5d-4178-b3ff-0d461bcc9bc4 2024-05-10T22:47:01.065985991Z [2024-05-10T22:47:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fd61151-4a68-40f4-a3c4-89dc6a94dea7 2024-05-10T22:47:02.355355816Z [2024-05-10T22:47:02.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:47:02.355815819Z [2024-05-10T22:47:02.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:46:00+00:00, run_id=scheduled__2024-05-10T22:46:00+00:00, run_start_date=2024-05-10 22:47:00.471430+00:00, run_end_date=2024-05-10 22:47:02.355236+00:00, run_duration=1.883806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:46:00+00:00, data_interval_end=2024-05-10 22:47:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:47:02.376633221Z [2024-05-10T22:47:02.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:02.475489615Z [2024-05-10T22:47:02.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status success for try_number 1 2024-05-10T22:47:02.493086990Z [2024-05-10T22:47:02.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:46:00+00:00, map_index=-1, run_start_date=2024-05-10 22:47:01.543673+00:00, run_end_date=2024-05-10 22:47:02.108197+00:00, run_duration=0.564524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:47:00.560282+00:00, queued_by_job_id=2, pid=1503 2024-05-10T22:47:05.282638184Z [2024-05-10T22:47:05.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:47:05.283055059Z [2024-05-10T22:47:05.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:46:00+00:00, run_id=scheduled__2024-05-10T22:46:00+00:00, run_start_date=2024-05-10 22:47:00.472375+00:00, run_end_date=2024-05-10 22:47:05.282503+00:00, run_duration=4.810128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:46:00+00:00, data_interval_end=2024-05-10 22:47:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:47:05.292206390Z [2024-05-10T22:47:05.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:05.299595184Z [2024-05-10T22:47:05.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:47:05.299845575Z [2024-05-10T22:47:05.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:46:00+00:00, run_id=scheduled__2024-05-10T22:46:00+00:00, run_start_date=2024-05-10 22:47:00.470493+00:00, run_end_date=2024-05-10 22:47:05.299393+00:00, run_duration=4.8289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:46:00+00:00, data_interval_end=2024-05-10 22:47:00+00:00, dag_hash=84476b2de8160b008738a9646694c31e 2024-05-10T22:47:05.312646137Z [2024-05-10T22:47:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:05.320426042Z [2024-05-10T22:47:05.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:47:05.320564660Z [2024-05-10T22:47:05.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:46:00+00:00, run_id=scheduled__2024-05-10T22:46:00+00:00, run_start_date=2024-05-10 22:47:00.473285+00:00, run_end_date=2024-05-10 22:47:05.320271+00:00, run_duration=4.846986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:46:00+00:00, data_interval_end=2024-05-10 22:47:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:47:05.330297500Z [2024-05-10T22:47:05.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:05.375223299Z [2024-05-10T22:47:05.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status success for try_number 1 2024-05-10T22:47:05.375494417Z [2024-05-10T22:47:05.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status success for try_number 1 2024-05-10T22:47:05.375720914Z [2024-05-10T22:47:05.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status success for try_number 1 2024-05-10T22:47:05.392176347Z [2024-05-10T22:47:05.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:46:00+00:00, map_index=-1, run_start_date=2024-05-10 22:47:03.160715+00:00, run_end_date=2024-05-10 22:47:04.838477+00:00, run_duration=1.677762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:47:00.560282+00:00, queued_by_job_id=2, pid=1535 2024-05-10T22:47:05.392464276Z [2024-05-10T22:47:05.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:46:00+00:00, map_index=-1, run_start_date=2024-05-10 22:47:02.862055+00:00, run_end_date=2024-05-10 22:47:04.791543+00:00, run_duration=1.929488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:47:00.560282+00:00, queued_by_job_id=2, pid=1523 2024-05-10T22:47:05.392740613Z [2024-05-10T22:47:05.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:46:00+00:00, map_index=-1, run_start_date=2024-05-10 22:47:02.900826+00:00, run_end_date=2024-05-10 22:47:05.070756+00:00, run_duration=2.16993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:47:00.560282+00:00, queued_by_job_id=2, pid=1529 2024-05-10T22:47:06.431747656Z [2024-05-10T22:47:06.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:47:06.432009541Z [2024-05-10T22:47:06.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:46:00+00:00, run_id=scheduled__2024-05-10T22:46:00+00:00, run_start_date=2024-05-10 22:47:00.469260+00:00, run_end_date=2024-05-10 22:47:06.431505+00:00, run_duration=5.962245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:46:00+00:00, data_interval_end=2024-05-10 22:47:00+00:00, dag_hash=80cd430c2a147a1e8a940bc8984ab764 2024-05-10T22:47:06.441067486Z [2024-05-10T22:47:06.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:47:00+00:00, run_after=2024-05-10T22:48:00+00:00 2024-05-10T22:47:06.470144133Z [2024-05-10T22:47:06.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status success for try_number 1 2024-05-10T22:47:06.476038374Z [2024-05-10T22:47:06.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:46:00+00:00, map_index=-1, run_start_date=2024-05-10 22:47:03.362757+00:00, run_end_date=2024-05-10 22:47:05.355496+00:00, run_duration=1.992739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:47:00.560282+00:00, queued_by_job_id=2, pid=1546 2024-05-10T22:48:00.405554196Z [2024-05-10T22:48:00.405+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:48:00.423979587Z [2024-05-10T22:48:00.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:00.436279210Z [2024-05-10T22:48:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:00.445186141Z [2024-05-10T22:48:00.444+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:48:00.452645352Z [2024-05-10T22:48:00.452+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:48:00.464889901Z [2024-05-10T22:48:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:00.570947541Z [2024-05-10T22:48:00.570+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-10T22:48:00.570971777Z 2024-05-10T22:48:00.570976189Z 2024-05-10T22:48:00.570995991Z 2024-05-10T22:48:00.570999168Z 2024-05-10T22:48:00.571002123Z 2024-05-10T22:48:00.571005289Z 2024-05-10T22:48:00.571015884Z [2024-05-10T22:48:00.570+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:48:00.571022316Z [2024-05-10T22:48:00.570+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:48:00.571121966Z [2024-05-10T22:48:00.571+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:48:00.571198393Z [2024-05-10T22:48:00.571+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:48:00.571275834Z [2024-05-10T22:48:00.571+0000] {scheduler_job.py:425} INFO - DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:48:00.571340055Z [2024-05-10T22:48:00.571+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:48:00.571904137Z [2024-05-10T22:48:00.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:48:00.571915213Z 2024-05-10T22:48:00.571918619Z 2024-05-10T22:48:00.571921628Z 2024-05-10T22:48:00.571924693Z 2024-05-10T22:48:00.571927835Z 2024-05-10T22:48:00.571931304Z 2024-05-10T22:48:00.575759850Z [2024-05-10T22:48:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:00.575846690Z [2024-05-10T22:48:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:48:00.576155978Z [2024-05-10T22:48:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:00.576225078Z [2024-05-10T22:48:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:48:00.576401748Z [2024-05-10T22:48:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:00.576475347Z [2024-05-10T22:48:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:48:00.576639633Z [2024-05-10T22:48:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:00.576710998Z [2024-05-10T22:48:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:48:00.576865787Z [2024-05-10T22:48:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:00.576938541Z [2024-05-10T22:48:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:48:00.577119465Z [2024-05-10T22:48:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:00.577155712Z [2024-05-10T22:48:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:48:01.279139151Z [2024-05-10T22:48:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status queued for try_number 1 2024-05-10T22:48:01.281424277Z [2024-05-10T22:48:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 1 2024-05-10T22:48:01.281584366Z [2024-05-10T22:48:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 1 2024-05-10T22:48:01.281726807Z [2024-05-10T22:48:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 1 2024-05-10T22:48:01.281889200Z [2024-05-10T22:48:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 1 2024-05-10T22:48:01.282080993Z [2024-05-10T22:48:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 1 2024-05-10T22:48:01.305808178Z [2024-05-10T22:48:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to f895bd48-ab2d-46a1-b9c4-eaecb27dd618 2024-05-10T22:48:01.306102431Z [2024-05-10T22:48:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40698c99-1cc8-4265-bc6e-4169f4210455 2024-05-10T22:48:01.306319994Z [2024-05-10T22:48:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4460f34e-857b-41b4-b7c7-5fd6e4a8819d 2024-05-10T22:48:01.306787325Z [2024-05-10T22:48:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84b3207d-cc09-472e-938b-0964ecb252c4 2024-05-10T22:48:01.307014866Z [2024-05-10T22:48:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12 2024-05-10T22:48:01.307239691Z [2024-05-10T22:48:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to c41f6d48-e916-4af8-94e9-98ff5db7a4dd 2024-05-10T22:48:02.717429543Z [2024-05-10T22:48:02.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:48:02.717817896Z [2024-05-10T22:48:02.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:47:00+00:00, run_id=scheduled__2024-05-10T22:47:00+00:00, run_start_date=2024-05-10 22:48:00.483360+00:00, run_end_date=2024-05-10 22:48:02.717448+00:00, run_duration=2.234088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:47:00+00:00, data_interval_end=2024-05-10 22:48:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:48:02.739485452Z [2024-05-10T22:48:02.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:02.886624947Z [2024-05-10T22:48:02.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status success for try_number 1 2024-05-10T22:48:02.904355038Z [2024-05-10T22:48:02.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=2024-05-10 22:48:01.796511+00:00, run_end_date=2024-05-10 22:48:02.461984+00:00, run_duration=0.665473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:00.572994+00:00, queued_by_job_id=2, pid=1581 2024-05-10T22:48:03.361248233Z [2024-05-10T22:48:03.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:48:03.362330499Z [2024-05-10T22:48:03.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:46:00+00:00, run_id=scheduled__2024-05-10T22:46:00+00:00, run_start_date=2024-05-10 22:48:00.476749+00:00, run_end_date=2024-05-10 22:48:03.361851+00:00, run_duration=2.885102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:46:00+00:00, data_interval_end=2024-05-10 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:48:03.372330181Z [2024-05-10T22:48:03.372+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:48:03.454732692Z [2024-05-10T22:48:03.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:46:00+00:00 exited with status success for try_number 1 2024-05-10T22:48:03.477074545Z [2024-05-10T22:48:03.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:46:00+00:00, map_index=-1, run_start_date=2024-05-10 22:48:02.623202+00:00, run_end_date=2024-05-10 22:48:03.061064+00:00, run_duration=0.437862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:00.572994+00:00, queued_by_job_id=2, pid=1589 2024-05-10T22:48:04.607446391Z [2024-05-10T22:48:04.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status failed for try_number 1 2024-05-10T22:48:04.607846539Z [2024-05-10T22:48:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status failed for try_number 1 2024-05-10T22:48:04.613804479Z [2024-05-10T22:48:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:00.572994+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:48:04.614313200Z [2024-05-10T22:48:04.614+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:04.616395106Z [2024-05-10T22:48:04.616+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:04.629753783Z [2024-05-10T22:48:04.629+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T224700, start_date=, end_date=20240510T224804 2024-05-10T22:48:04.639652379Z [2024-05-10T22:48:04.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:00.572994+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:48:04.640050338Z [2024-05-10T22:48:04.639+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:04.642439855Z [2024-05-10T22:48:04.642+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:04.655873294Z [2024-05-10T22:48:04.655+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T224700, start_date=, end_date=20240510T224804 2024-05-10T22:48:05.721981557Z [2024-05-10T22:48:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:48:05.722552480Z [2024-05-10T22:48:05.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:47:00+00:00, run_id=scheduled__2024-05-10T22:47:00+00:00, run_start_date=2024-05-10 22:48:00.478151+00:00, run_end_date=2024-05-10 22:48:05.722014+00:00, run_duration=5.243863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:47:00+00:00, data_interval_end=2024-05-10 22:48:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:48:05.732028678Z [2024-05-10T22:48:05.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:05.738816837Z [2024-05-10T22:48:05.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:48:05.739111088Z [2024-05-10T22:48:05.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:47:00+00:00, run_id=scheduled__2024-05-10T22:47:00+00:00, run_start_date=2024-05-10 22:48:00.480566+00:00, run_end_date=2024-05-10 22:48:05.738798+00:00, run_duration=5.258232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:47:00+00:00, data_interval_end=2024-05-10 22:48:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:48:05.747593968Z [2024-05-10T22:48:05.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:05.823491333Z [2024-05-10T22:48:05.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status success for try_number 1 2024-05-10T22:48:05.823857934Z [2024-05-10T22:48:05.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status success for try_number 1 2024-05-10T22:48:05.831737113Z [2024-05-10T22:48:05.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=2024-05-10 22:48:03.901851+00:00, run_end_date=2024-05-10 22:48:05.174102+00:00, run_duration=1.272251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:00.572994+00:00, queued_by_job_id=2, pid=1628 2024-05-10T22:48:05.832164764Z [2024-05-10T22:48:05.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=2024-05-10 22:48:03.716642+00:00, run_end_date=2024-05-10 22:48:05.473682+00:00, run_duration=1.75704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:00.572994+00:00, queued_by_job_id=2, pid=1627 2024-05-10T22:48:14.746229525Z [2024-05-10T22:48:14.745+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-10T22:48:14.746286714Z 2024-05-10T22:48:14.746294348Z 2024-05-10T22:48:14.746335372Z [2024-05-10T22:48:14.746+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:48:14.746399203Z [2024-05-10T22:48:14.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd has 0/16 running and queued tasks 2024-05-10T22:48:14.747002034Z [2024-05-10T22:48:14.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:48:14.747014491Z 2024-05-10T22:48:14.747017939Z 2024-05-10T22:48:14.749947471Z [2024-05-10T22:48:14.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:14.750266321Z [2024-05-10T22:48:14.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:48:14.750602160Z [2024-05-10T22:48:14.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24871773-28b9-44b2-af75-63072e54f9fd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:47:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:48:14.750839271Z [2024-05-10T22:48:14.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:48:14.913085334Z [2024-05-10T22:48:14.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 2 2024-05-10T22:48:14.913468091Z [2024-05-10T22:48:14.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status queued for try_number 2 2024-05-10T22:48:14.919709599Z [2024-05-10T22:48:14.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec617107-c3c0-41f4-88c0-8c4d91d814aa 2024-05-10T22:48:14.919923670Z [2024-05-10T22:48:14.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5711b88e-5e22-412a-8815-9a2b763acd26 2024-05-10T22:48:17.187636842Z [2024-05-10T22:48:17.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status failed for try_number 2 2024-05-10T22:48:17.187822936Z [2024-05-10T22:48:17.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24871773-28b9-44b2-af75-63072e54f9fd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:47:00+00:00 exited with status failed for try_number 2 2024-05-10T22:48:17.196335316Z [2024-05-10T22:48:17.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:48:04.618610+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:14.747513+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:48:17.197098194Z [2024-05-10T22:48:17.196+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:17.199688216Z [2024-05-10T22:48:17.199+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:17.213392494Z [2024-05-10T22:48:17.213+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240510T224700, start_date=, end_date=20240510T224817 2024-05-10T22:48:17.221053702Z [2024-05-10T22:48:17.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-10 22:48:04.644886+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:48:14.747513+00:00, queued_by_job_id=2, pid=None 2024-05-10T22:48:17.221577326Z [2024-05-10T22:48:17.221+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:17.223554981Z [2024-05-10T22:48:17.223+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-10T22:48:17.234878134Z [2024-05-10T22:48:17.234+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240510T224700, start_date=, end_date=20240510T224817 2024-05-10T22:48:18.295608344Z [2024-05-10T22:48:18.295+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:48:18.296133249Z [2024-05-10T22:48:18.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:47:00+00:00, run_id=scheduled__2024-05-10T22:47:00+00:00, run_start_date=2024-05-10 22:48:00.481684+00:00, run_end_date=2024-05-10 22:48:18.295478+00:00, run_duration=17.813794, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:47:00+00:00, data_interval_end=2024-05-10 22:48:00+00:00, dag_hash=80cd430c2a147a1e8a940bc8984ab764 2024-05-10T22:48:18.313562907Z [2024-05-10T22:48:18.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:48:18.325973863Z [2024-05-10T22:48:18.325+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-10T22:48:18.326455642Z [2024-05-10T22:48:18.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24871773-28b9-44b2-af75-63072e54f9fd, execution_date=2024-05-10 22:47:00+00:00, run_id=scheduled__2024-05-10T22:47:00+00:00, run_start_date=2024-05-10 22:48:00.479533+00:00, run_end_date=2024-05-10 22:48:18.325778+00:00, run_duration=17.846245, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:47:00+00:00, data_interval_end=2024-05-10 22:48:00+00:00, dag_hash=84476b2de8160b008738a9646694c31e 2024-05-10T22:48:18.339480394Z [2024-05-10T22:48:18.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24871773-28b9-44b2-af75-63072e54f9fd to 2024-05-10T22:48:00+00:00, run_after=2024-05-10T22:49:00+00:00 2024-05-10T22:49:00.446031953Z [2024-05-10T22:49:00.445+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:49:00.472832706Z [2024-05-10T22:49:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:49:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:49:00.492165543Z [2024-05-10T22:49:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:49:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:49:00.590047546Z [2024-05-10T22:49:00.589+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:49:00.590071178Z 2024-05-10T22:49:00.590074529Z 2024-05-10T22:49:00.590077741Z 2024-05-10T22:49:00.590214414Z [2024-05-10T22:49:00.590+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:49:00.590340645Z [2024-05-10T22:49:00.590+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:49:00.590485952Z [2024-05-10T22:49:00.590+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:49:00.591015843Z [2024-05-10T22:49:00.590+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:49:00.591022391Z 2024-05-10T22:49:00.591025544Z 2024-05-10T22:49:00.591028688Z 2024-05-10T22:49:00.596833408Z [2024-05-10T22:49:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:49:00.596925430Z [2024-05-10T22:49:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:49:00.597107544Z [2024-05-10T22:49:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:49:00.597188932Z [2024-05-10T22:49:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:49:00.597478074Z [2024-05-10T22:49:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:49:00.597546319Z [2024-05-10T22:49:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:49:01.012453215Z [2024-05-10T22:49:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status queued for try_number 1 2024-05-10T22:49:01.012769356Z [2024-05-10T22:49:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status queued for try_number 1 2024-05-10T22:49:01.012778328Z [2024-05-10T22:49:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status queued for try_number 1 2024-05-10T22:49:01.031750306Z [2024-05-10T22:49:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30e45973-e496-4d57-aba8-43f78f8eab06 2024-05-10T22:49:01.031881358Z [2024-05-10T22:49:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec5e2a52-1c05-4c22-af3c-ea69ca287bee 2024-05-10T22:49:01.041033342Z [2024-05-10T22:49:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c98a169-3fda-4045-bb70-96c084ced40f 2024-05-10T22:49:02.261495264Z [2024-05-10T22:49:02.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:49:02.261710649Z [2024-05-10T22:49:02.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:48:00+00:00, run_id=scheduled__2024-05-10T22:48:00+00:00, run_start_date=2024-05-10 22:49:00.526626+00:00, run_end_date=2024-05-10 22:49:02.260975+00:00, run_duration=1.734349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:48:00+00:00, data_interval_end=2024-05-10 22:49:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:49:02.270784581Z [2024-05-10T22:49:02.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:49:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:49:02.322531081Z [2024-05-10T22:49:02.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status success for try_number 1 2024-05-10T22:49:02.329952379Z [2024-05-10T22:49:02.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:48:00+00:00, map_index=-1, run_start_date=2024-05-10 22:49:01.644632+00:00, run_end_date=2024-05-10 22:49:02.154852+00:00, run_duration=0.51022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:49:00.591756+00:00, queued_by_job_id=2, pid=1684 2024-05-10T22:49:06.372665313Z [2024-05-10T22:49:06.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:49:06.376030013Z [2024-05-10T22:49:06.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:48:00+00:00, run_id=scheduled__2024-05-10T22:48:00+00:00, run_start_date=2024-05-10 22:49:00.523443+00:00, run_end_date=2024-05-10 22:49:06.372523+00:00, run_duration=5.84908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:48:00+00:00, data_interval_end=2024-05-10 22:49:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:49:06.395601097Z [2024-05-10T22:49:06.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:49:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:49:06.403536039Z [2024-05-10T22:49:06.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:49:06.404036083Z [2024-05-10T22:49:06.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:48:00+00:00, run_id=scheduled__2024-05-10T22:48:00+00:00, run_start_date=2024-05-10 22:49:00.521600+00:00, run_end_date=2024-05-10 22:49:06.403443+00:00, run_duration=5.881843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:48:00+00:00, data_interval_end=2024-05-10 22:49:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:49:06.419166889Z [2024-05-10T22:49:06.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:49:00+00:00, run_after=2024-05-10T22:50:00+00:00 2024-05-10T22:49:07.500554025Z [2024-05-10T22:49:07.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status success for try_number 1 2024-05-10T22:49:07.501157385Z [2024-05-10T22:49:07.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status success for try_number 1 2024-05-10T22:49:07.513352956Z [2024-05-10T22:49:07.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:48:00+00:00, map_index=-1, run_start_date=2024-05-10 22:49:02.690488+00:00, run_end_date=2024-05-10 22:49:06.303285+00:00, run_duration=3.612797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:49:00.591756+00:00, queued_by_job_id=2, pid=1697 2024-05-10T22:49:07.513889225Z [2024-05-10T22:49:07.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:48:00+00:00, map_index=-1, run_start_date=2024-05-10 22:49:03.258545+00:00, run_end_date=2024-05-10 22:49:06.297302+00:00, run_duration=3.038757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:49:00.591756+00:00, queued_by_job_id=2, pid=1708 2024-05-10T22:50:00.337417126Z [2024-05-10T22:50:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:51:00+00:00 2024-05-10T22:50:00.349348489Z [2024-05-10T22:50:00.348+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:50:00.355626317Z [2024-05-10T22:50:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:50:00.369874623Z [2024-05-10T22:50:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:51:00+00:00 2024-05-10T22:50:00.397013370Z [2024-05-10T22:50:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:50:00.494246660Z [2024-05-10T22:50:00.493+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T22:50:00.494277422Z 2024-05-10T22:50:00.494283317Z 2024-05-10T22:50:00.494330069Z 2024-05-10T22:50:00.494337012Z 2024-05-10T22:50:00.494342390Z 2024-05-10T22:50:00.494347554Z [2024-05-10T22:50:00.494+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:50:00.494364524Z [2024-05-10T22:50:00.494+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:50:00.494405948Z [2024-05-10T22:50:00.494+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:50:00.494419182Z [2024-05-10T22:50:00.494+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:50:00.494517954Z [2024-05-10T22:50:00.494+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:50:00.495165869Z [2024-05-10T22:50:00.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:50:00.495194543Z 2024-05-10T22:50:00.495198636Z 2024-05-10T22:50:00.495218696Z 2024-05-10T22:50:00.495222946Z 2024-05-10T22:50:00.495226364Z 2024-05-10T22:50:00.498916858Z [2024-05-10T22:50:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:50:00.499002624Z [2024-05-10T22:50:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:50:00.499204185Z [2024-05-10T22:50:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:50:00.499293324Z [2024-05-10T22:50:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:50:00.499489838Z [2024-05-10T22:50:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:50:00.499577599Z [2024-05-10T22:50:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:50:00.499758661Z [2024-05-10T22:50:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:50:00.499854045Z [2024-05-10T22:50:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:50:00.500122367Z [2024-05-10T22:50:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:50:00.500221793Z [2024-05-10T22:50:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:50:01.267031708Z [2024-05-10T22:50:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:01.267111119Z [2024-05-10T22:50:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:01.267119786Z [2024-05-10T22:50:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:49:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:01.267169162Z [2024-05-10T22:50:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:49:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:01.267223283Z [2024-05-10T22:50:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:49:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:01.291235110Z [2024-05-10T22:50:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07e3de28-089b-40e9-ad96-c0aa3267e244 2024-05-10T22:50:01.291327604Z [2024-05-10T22:50:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94703843-3fec-4b12-90da-948424d7b761 2024-05-10T22:50:01.291424748Z [2024-05-10T22:50:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d17a49d-6c82-423b-9dda-723aa41c0831 2024-05-10T22:50:01.291544092Z [2024-05-10T22:50:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0a0b880-5636-431f-aefc-a3b896912173 2024-05-10T22:50:01.291644859Z [2024-05-10T22:50:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1c8c711-fa93-454a-b487-0c95e1459cbe 2024-05-10T22:50:02.495289459Z [2024-05-10T22:50:02.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:50:02.495317678Z [2024-05-10T22:50:02.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:48:00+00:00, run_id=scheduled__2024-05-10T22:48:00+00:00, run_start_date=2024-05-10 22:50:00.407487+00:00, run_end_date=2024-05-10 22:50:02.494910+00:00, run_duration=2.087423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:48:00+00:00, data_interval_end=2024-05-10 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:50:02.503442749Z [2024-05-10T22:50:02.503+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:52:00+00:00 2024-05-10T22:50:02.548386814Z [2024-05-10T22:50:02.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:50:02.548867910Z [2024-05-10T22:50:02.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:49:00+00:00, run_id=scheduled__2024-05-10T22:49:00+00:00, run_start_date=2024-05-10 22:50:00.410302+00:00, run_end_date=2024-05-10 22:50:02.548533+00:00, run_duration=2.138231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:49:00+00:00, data_interval_end=2024-05-10 22:50:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:50:02.562943126Z [2024-05-10T22:50:02.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:51:00+00:00 2024-05-10T22:50:02.614466771Z [2024-05-10T22:50:02.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:48:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:02.615245980Z [2024-05-10T22:50:02.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:49:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:02.627757863Z [2024-05-10T22:50:02.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:48:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:01.515099+00:00, run_end_date=2024-05-10 22:50:02.139062+00:00, run_duration=0.623963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:00.496213+00:00, queued_by_job_id=2, pid=1738 2024-05-10T22:50:02.629228185Z [2024-05-10T22:50:02.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:49:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:01.846870+00:00, run_end_date=2024-05-10 22:50:02.373272+00:00, run_duration=0.526402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:00.496213+00:00, queued_by_job_id=2, pid=1740 2024-05-10T22:50:03.745675845Z [2024-05-10T22:50:03.745+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:50:03.745710316Z 2024-05-10T22:50:03.745717493Z [2024-05-10T22:50:03.745+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:50:03.746744630Z [2024-05-10T22:50:03.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:50:03.746773530Z 2024-05-10T22:50:03.751788944Z [2024-05-10T22:50:03.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:50:03.752675718Z [2024-05-10T22:50:03.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:50:03.825834620Z [2024-05-10T22:50:03.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:03.826387410Z [2024-05-10T22:50:03.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:03.834285547Z [2024-05-10T22:50:03.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78064107-b1f4-4ad5-af3f-686249963021 2024-05-10T22:50:03.834650763Z [2024-05-10T22:50:03.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:02.851096+00:00, run_end_date=2024-05-10 22:50:03.321412+00:00, run_duration=0.470316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:00.496213+00:00, queued_by_job_id=2, pid=1763 2024-05-10T22:50:04.980985849Z [2024-05-10T22:50:04.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:50:04.981199071Z [2024-05-10T22:50:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:49:00+00:00, run_id=scheduled__2024-05-10T22:49:00+00:00, run_start_date=2024-05-10 22:50:00.409369+00:00, run_end_date=2024-05-10 22:50:04.980872+00:00, run_duration=4.571503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:49:00+00:00, data_interval_end=2024-05-10 22:50:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:50:04.989519196Z [2024-05-10T22:50:04.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:51:00+00:00 2024-05-10T22:50:05.038718471Z [2024-05-10T22:50:05.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:49:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:05.043476803Z [2024-05-10T22:50:05.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:49:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:03.038321+00:00, run_end_date=2024-05-10 22:50:04.761233+00:00, run_duration=1.722912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:00.496213+00:00, queued_by_job_id=2, pid=1768 2024-05-10T22:50:05.641834129Z [2024-05-10T22:50:05.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:50:05.642091855Z [2024-05-10T22:50:05.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:49:00+00:00, run_id=scheduled__2024-05-10T22:49:00+00:00, run_start_date=2024-05-10 22:50:00.408469+00:00, run_end_date=2024-05-10 22:50:05.641784+00:00, run_duration=5.233315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:49:00+00:00, data_interval_end=2024-05-10 22:50:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:50:05.654161093Z [2024-05-10T22:50:05.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:51:00+00:00 2024-05-10T22:50:05.748987662Z [2024-05-10T22:50:05.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:49:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:05.758157909Z [2024-05-10T22:50:05.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:49:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:03.255380+00:00, run_end_date=2024-05-10 22:50:05.481378+00:00, run_duration=2.225998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:00.496213+00:00, queued_by_job_id=2, pid=1775 2024-05-10T22:50:06.403919643Z [2024-05-10T22:50:06.403+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:50:06.403986583Z 2024-05-10T22:50:06.404012067Z [2024-05-10T22:50:06.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:50:06.407728347Z [2024-05-10T22:50:06.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:50:06.407763479Z 2024-05-10T22:50:06.409984410Z [2024-05-10T22:50:06.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:50:06.410026883Z [2024-05-10T22:50:06.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:50:06.495785161Z [2024-05-10T22:50:06.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:06.496582395Z [2024-05-10T22:50:06.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:06.504140592Z [2024-05-10T22:50:06.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd811592-e255-42fb-965e-8d29f70329c4 2024-05-10T22:50:06.506101472Z [2024-05-10T22:50:06.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:05.377624+00:00, run_end_date=2024-05-10 22:50:05.782173+00:00, run_duration=0.404549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:03.747293+00:00, queued_by_job_id=2, pid=1804 2024-05-10T22:50:08.765952809Z [2024-05-10T22:50:08.765+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:50:08.765993028Z 2024-05-10T22:50:08.766000364Z [2024-05-10T22:50:08.765+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:50:08.766609913Z [2024-05-10T22:50:08.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:50:08.766621513Z 2024-05-10T22:50:08.768819049Z [2024-05-10T22:50:08.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:50:08.769059104Z [2024-05-10T22:50:08.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:50:08.807067332Z [2024-05-10T22:50:08.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status queued for try_number 1 2024-05-10T22:50:08.807221558Z [2024-05-10T22:50:08.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:08.817690986Z [2024-05-10T22:50:08.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 792fca33-77b2-4cf8-877e-70fe74b43068 2024-05-10T22:50:08.817940008Z [2024-05-10T22:50:08.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=0, run_start_date=2024-05-10 22:50:08.119446+00:00, run_end_date=2024-05-10 22:50:08.433708+00:00, run_duration=0.314262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:06.407858+00:00, queued_by_job_id=2, pid=1815 2024-05-10T22:50:10.718909783Z [2024-05-10T22:50:10.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:50:10.719124441Z [2024-05-10T22:50:10.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:45:00+00:00, run_id=scheduled__2024-05-10T22:45:00+00:00, run_start_date=2024-05-10 22:50:00.406401+00:00, run_end_date=2024-05-10 22:50:10.718823+00:00, run_duration=10.312422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:45:00+00:00, data_interval_end=2024-05-10 22:50:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T22:50:10.724628931Z [2024-05-10T22:50:10.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:50:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:50:11.599402870Z [2024-05-10T22:50:11.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:45:00+00:00 exited with status success for try_number 1 2024-05-10T22:50:11.606666234Z [2024-05-10T22:50:11.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:45:00+00:00, map_index=-1, run_start_date=2024-05-10 22:50:10.328247+00:00, run_end_date=2024-05-10 22:50:10.670815+00:00, run_duration=0.342568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:50:08.766936+00:00, queued_by_job_id=2, pid=1823 2024-05-10T22:50:33.324764220Z [2024-05-10T22:50:33.324+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:51:00.271749524Z [2024-05-10T22:51:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:51:00.288795392Z [2024-05-10T22:51:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:51:00+00:00, run_after=2024-05-10T22:52:00+00:00 2024-05-10T22:51:00.305065282Z [2024-05-10T22:51:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:51:00+00:00, run_after=2024-05-10T22:52:00+00:00 2024-05-10T22:51:00.384420479Z [2024-05-10T22:51:00.384+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:51:00.384461320Z 2024-05-10T22:51:00.384465311Z 2024-05-10T22:51:00.384468544Z 2024-05-10T22:51:00.384523287Z [2024-05-10T22:51:00.384+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:51:00.384718530Z [2024-05-10T22:51:00.384+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:51:00.384863408Z [2024-05-10T22:51:00.384+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:51:00.385559535Z [2024-05-10T22:51:00.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:51:00.385594115Z 2024-05-10T22:51:00.385609794Z 2024-05-10T22:51:00.385614307Z 2024-05-10T22:51:00.388704077Z [2024-05-10T22:51:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:51:00.388853372Z [2024-05-10T22:51:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:51:00.389176232Z [2024-05-10T22:51:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:51:00.389337338Z [2024-05-10T22:51:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:51:00.389581297Z [2024-05-10T22:51:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:51:00.389739319Z [2024-05-10T22:51:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:51:00.608848504Z [2024-05-10T22:51:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:51:00.608914626Z [2024-05-10T22:51:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:51:00.608974765Z [2024-05-10T22:51:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:51:00.618152246Z [2024-05-10T22:51:00.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60710351-c52f-425f-8767-5d62dc8424c8 2024-05-10T22:51:00.618247401Z [2024-05-10T22:51:00.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to 677df1d0-ed65-437c-8da9-bf6b01c094a8 2024-05-10T22:51:00.618454350Z [2024-05-10T22:51:00.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61d81d8e-f6ea-40da-98fe-00f7830e7de7 2024-05-10T22:51:01.791592637Z [2024-05-10T22:51:01.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:51:01.792067221Z [2024-05-10T22:51:01.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:50:00+00:00, run_id=scheduled__2024-05-10T22:50:00+00:00, run_start_date=2024-05-10 22:51:00.336258+00:00, run_end_date=2024-05-10 22:51:01.791487+00:00, run_duration=1.455229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:50:00+00:00, data_interval_end=2024-05-10 22:51:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:51:01.802576305Z [2024-05-10T22:51:01.802+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:51:00+00:00, run_after=2024-05-10T22:52:00+00:00 2024-05-10T22:51:01.856347528Z [2024-05-10T22:51:01.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:51:01.864579822Z [2024-05-10T22:51:01.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:51:01.278333+00:00, run_end_date=2024-05-10 22:51:01.647621+00:00, run_duration=0.369288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:51:00.386368+00:00, queued_by_job_id=2, pid=1832 2024-05-10T22:51:04.394589979Z [2024-05-10T22:51:04.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:51:04.394923798Z [2024-05-10T22:51:04.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:50:00+00:00, run_id=scheduled__2024-05-10T22:50:00+00:00, run_start_date=2024-05-10 22:51:00.338063+00:00, run_end_date=2024-05-10 22:51:04.394624+00:00, run_duration=4.056561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:50:00+00:00, data_interval_end=2024-05-10 22:51:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:51:04.404208202Z [2024-05-10T22:51:04.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:51:00+00:00, run_after=2024-05-10T22:52:00+00:00 2024-05-10T22:51:04.459789546Z [2024-05-10T22:51:04.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:51:04.471321014Z [2024-05-10T22:51:04.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:51:02.246739+00:00, run_end_date=2024-05-10 22:51:03.751604+00:00, run_duration=1.504865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:51:00.386368+00:00, queued_by_job_id=2, pid=1850 2024-05-10T22:51:05.520904511Z [2024-05-10T22:51:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:51:05.521285947Z [2024-05-10T22:51:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:50:00+00:00, run_id=scheduled__2024-05-10T22:50:00+00:00, run_start_date=2024-05-10 22:51:00.332634+00:00, run_end_date=2024-05-10 22:51:05.520993+00:00, run_duration=5.188359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:50:00+00:00, data_interval_end=2024-05-10 22:51:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:51:05.530397997Z [2024-05-10T22:51:05.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:51:00+00:00, run_after=2024-05-10T22:52:00+00:00 2024-05-10T22:51:05.556745269Z [2024-05-10T22:51:05.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:51:05.561098582Z [2024-05-10T22:51:05.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:51:02.265419+00:00, run_end_date=2024-05-10 22:51:04.521230+00:00, run_duration=2.255811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:51:00.386368+00:00, queued_by_job_id=2, pid=1851 2024-05-10T22:52:00.118875306Z [2024-05-10T22:52:00.118+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:52:00.136947888Z [2024-05-10T22:52:00.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:52:00+00:00, run_after=2024-05-10T22:53:00+00:00 2024-05-10T22:52:00.147001760Z [2024-05-10T22:52:00.146+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:52:00.159371852Z [2024-05-10T22:52:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:52:00+00:00, run_after=2024-05-10T22:53:00+00:00 2024-05-10T22:52:00.232442287Z [2024-05-10T22:52:00.231+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:52:00.232469024Z 2024-05-10T22:52:00.232474972Z 2024-05-10T22:52:00.232479467Z 2024-05-10T22:52:00.232517450Z 2024-05-10T22:52:00.232523000Z [2024-05-10T22:52:00.232+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:52:00.232536123Z [2024-05-10T22:52:00.232+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:52:00.232592608Z [2024-05-10T22:52:00.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:52:00.232689327Z [2024-05-10T22:52:00.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:52:00.233357168Z [2024-05-10T22:52:00.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:52:00.233370171Z 2024-05-10T22:52:00.233374659Z 2024-05-10T22:52:00.233378657Z 2024-05-10T22:52:00.233382723Z 2024-05-10T22:52:00.237569388Z [2024-05-10T22:52:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:52:00.237684537Z [2024-05-10T22:52:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:52:00.237990875Z [2024-05-10T22:52:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:52:00.238163671Z [2024-05-10T22:52:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:52:00.238424317Z [2024-05-10T22:52:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:52:00.238536027Z [2024-05-10T22:52:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:52:00.238732660Z [2024-05-10T22:52:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:52:00.238841442Z [2024-05-10T22:52:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:52:00.669240514Z [2024-05-10T22:52:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:52:00.669353236Z [2024-05-10T22:52:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:51:00+00:00 exited with status queued for try_number 1 2024-05-10T22:52:00.669464245Z [2024-05-10T22:52:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:51:00+00:00 exited with status queued for try_number 1 2024-05-10T22:52:00.669568265Z [2024-05-10T22:52:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:51:00+00:00 exited with status queued for try_number 1 2024-05-10T22:52:00.679455652Z [2024-05-10T22:52:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to d57ba471-ed90-4df1-9424-f8f977ad2850 2024-05-10T22:52:00.679646401Z [2024-05-10T22:52:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60cf9628-ed3f-4fef-b56f-af5a50e3972a 2024-05-10T22:52:00.679905129Z [2024-05-10T22:52:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cfab732-a1be-4e3e-b1f7-b2516bdce15b 2024-05-10T22:52:00.680082831Z [2024-05-10T22:52:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d293513-3a5c-480c-bc3f-c7d86f47e907 2024-05-10T22:52:01.840376418Z [2024-05-10T22:52:01.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:52:01.840746046Z [2024-05-10T22:52:01.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:50:00+00:00, run_id=scheduled__2024-05-10T22:50:00+00:00, run_start_date=2024-05-10 22:52:00.170811+00:00, run_end_date=2024-05-10 22:52:01.840298+00:00, run_duration=1.669487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:50:00+00:00, data_interval_end=2024-05-10 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:52:01.850306505Z [2024-05-10T22:52:01.849+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:52:00+00:00, run_after=2024-05-10T22:54:00+00:00 2024-05-10T22:52:01.867031620Z [2024-05-10T22:52:01.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:52:01.867532820Z [2024-05-10T22:52:01.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:51:00+00:00, run_id=scheduled__2024-05-10T22:51:00+00:00, run_start_date=2024-05-10 22:52:00.173036+00:00, run_end_date=2024-05-10 22:52:01.867064+00:00, run_duration=1.694028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:51:00+00:00, data_interval_end=2024-05-10 22:52:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:52:01.879328558Z [2024-05-10T22:52:01.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:52:00+00:00, run_after=2024-05-10T22:53:00+00:00 2024-05-10T22:52:01.923188845Z [2024-05-10T22:52:01.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:52:01.923464812Z [2024-05-10T22:52:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:51:00+00:00 exited with status success for try_number 1 2024-05-10T22:52:01.931094193Z [2024-05-10T22:52:01.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:52:01.296715+00:00, run_end_date=2024-05-10 22:52:01.693368+00:00, run_duration=0.396653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:52:00.234338+00:00, queued_by_job_id=2, pid=1885 2024-05-10T22:52:01.931118734Z [2024-05-10T22:52:01.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:51:00+00:00, map_index=-1, run_start_date=2024-05-10 22:52:01.236977+00:00, run_end_date=2024-05-10 22:52:01.696392+00:00, run_duration=0.459415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:52:00.234338+00:00, queued_by_job_id=2, pid=1884 2024-05-10T22:52:04.086784851Z [2024-05-10T22:52:04.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:52:04.087019410Z [2024-05-10T22:52:04.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:51:00+00:00, run_id=scheduled__2024-05-10T22:51:00+00:00, run_start_date=2024-05-10 22:52:00.172019+00:00, run_end_date=2024-05-10 22:52:04.086676+00:00, run_duration=3.914657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:51:00+00:00, data_interval_end=2024-05-10 22:52:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:52:04.098851233Z [2024-05-10T22:52:04.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:52:00+00:00, run_after=2024-05-10T22:53:00+00:00 2024-05-10T22:52:04.105747269Z [2024-05-10T22:52:04.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:52:04.105886893Z [2024-05-10T22:52:04.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:51:00+00:00, run_id=scheduled__2024-05-10T22:51:00+00:00, run_start_date=2024-05-10 22:52:00.174093+00:00, run_end_date=2024-05-10 22:52:04.105593+00:00, run_duration=3.9315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:51:00+00:00, data_interval_end=2024-05-10 22:52:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:52:04.117762038Z [2024-05-10T22:52:04.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:52:00+00:00, run_after=2024-05-10T22:53:00+00:00 2024-05-10T22:52:04.150018119Z [2024-05-10T22:52:04.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:51:00+00:00 exited with status success for try_number 1 2024-05-10T22:52:04.150405951Z [2024-05-10T22:52:04.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:51:00+00:00 exited with status success for try_number 1 2024-05-10T22:52:04.157228166Z [2024-05-10T22:52:04.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:51:00+00:00, map_index=-1, run_start_date=2024-05-10 22:52:02.277297+00:00, run_end_date=2024-05-10 22:52:03.852437+00:00, run_duration=1.57514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:52:00.234338+00:00, queued_by_job_id=2, pid=1908 2024-05-10T22:52:04.157719546Z [2024-05-10T22:52:04.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:51:00+00:00, map_index=-1, run_start_date=2024-05-10 22:52:02.446285+00:00, run_end_date=2024-05-10 22:52:03.737504+00:00, run_duration=1.291219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:52:00.234338+00:00, queued_by_job_id=2, pid=1909 2024-05-10T22:53:00.912552153Z [2024-05-10T22:53:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:53:00+00:00, run_after=2024-05-10T22:54:00+00:00 2024-05-10T22:53:00.920165417Z [2024-05-10T22:53:00.919+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:53:00.933353554Z [2024-05-10T22:53:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:53:00+00:00, run_after=2024-05-10T22:54:00+00:00 2024-05-10T22:53:01.001421250Z [2024-05-10T22:53:01.000+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:53:01.001452167Z 2024-05-10T22:53:01.001457825Z 2024-05-10T22:53:01.001462228Z 2024-05-10T22:53:01.001640221Z [2024-05-10T22:53:01.001+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:53:01.001892888Z [2024-05-10T22:53:01.001+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:53:01.002222126Z [2024-05-10T22:53:01.001+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:53:01.003381118Z [2024-05-10T22:53:01.003+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:53:01.003392737Z 2024-05-10T22:53:01.003397262Z 2024-05-10T22:53:01.003401673Z 2024-05-10T22:53:01.007650719Z [2024-05-10T22:53:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:53:01.007743990Z [2024-05-10T22:53:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:53:01.008149952Z [2024-05-10T22:53:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:53:01.008365811Z [2024-05-10T22:53:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:53:01.008770607Z [2024-05-10T22:53:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:53:01.008935593Z [2024-05-10T22:53:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:53:01.342707741Z [2024-05-10T22:53:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status queued for try_number 1 2024-05-10T22:53:01.342996801Z [2024-05-10T22:53:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status queued for try_number 1 2024-05-10T22:53:01.343262375Z [2024-05-10T22:53:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status queued for try_number 1 2024-05-10T22:53:01.352312359Z [2024-05-10T22:53:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to 925cdcbb-f475-4b84-9c20-a07e453ea729 2024-05-10T22:53:01.352512772Z [2024-05-10T22:53:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cb520da-e2e4-4dda-9f57-a59dacd655ee 2024-05-10T22:53:01.352686022Z [2024-05-10T22:53:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4f9da99-fc4e-4011-a34c-7ae1b80a003d 2024-05-10T22:53:02.488910952Z [2024-05-10T22:53:02.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:53:02.489375495Z [2024-05-10T22:53:02.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:52:00+00:00, run_id=scheduled__2024-05-10T22:52:00+00:00, run_start_date=2024-05-10 22:53:00.944622+00:00, run_end_date=2024-05-10 22:53:02.488886+00:00, run_duration=1.544264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:52:00+00:00, data_interval_end=2024-05-10 22:53:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:53:02.499904862Z [2024-05-10T22:53:02.499+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:53:00+00:00, run_after=2024-05-10T22:54:00+00:00 2024-05-10T22:53:02.562979787Z [2024-05-10T22:53:02.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status success for try_number 1 2024-05-10T22:53:02.568718901Z [2024-05-10T22:53:02.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:52:00+00:00, map_index=-1, run_start_date=2024-05-10 22:53:01.897471+00:00, run_end_date=2024-05-10 22:53:02.294680+00:00, run_duration=0.397209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:53:01.004301+00:00, queued_by_job_id=2, pid=1942 2024-05-10T22:53:04.968883663Z [2024-05-10T22:53:04.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:53:04.969552598Z [2024-05-10T22:53:04.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:52:00+00:00, run_id=scheduled__2024-05-10T22:52:00+00:00, run_start_date=2024-05-10 22:53:00.946885+00:00, run_end_date=2024-05-10 22:53:04.969111+00:00, run_duration=4.022226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:52:00+00:00, data_interval_end=2024-05-10 22:53:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:53:04.982699594Z [2024-05-10T22:53:04.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:53:00+00:00, run_after=2024-05-10T22:54:00+00:00 2024-05-10T22:53:05.028935826Z [2024-05-10T22:53:05.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status success for try_number 1 2024-05-10T22:53:05.035786636Z [2024-05-10T22:53:05.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:52:00+00:00, map_index=-1, run_start_date=2024-05-10 22:53:02.848124+00:00, run_end_date=2024-05-10 22:53:04.183820+00:00, run_duration=1.335696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:53:01.004301+00:00, queued_by_job_id=2, pid=1961 2024-05-10T22:53:06.095875329Z [2024-05-10T22:53:06.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:53:06.098393923Z [2024-05-10T22:53:06.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:52:00+00:00, run_id=scheduled__2024-05-10T22:52:00+00:00, run_start_date=2024-05-10 22:53:00.945891+00:00, run_end_date=2024-05-10 22:53:06.097987+00:00, run_duration=5.152096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:52:00+00:00, data_interval_end=2024-05-10 22:53:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:53:06.110557668Z [2024-05-10T22:53:06.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:53:00+00:00, run_after=2024-05-10T22:54:00+00:00 2024-05-10T22:53:06.136690901Z [2024-05-10T22:53:06.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status success for try_number 1 2024-05-10T22:53:06.141693181Z [2024-05-10T22:53:06.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:52:00+00:00, map_index=-1, run_start_date=2024-05-10 22:53:02.845053+00:00, run_end_date=2024-05-10 22:53:05.382009+00:00, run_duration=2.536956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:53:01.004301+00:00, queued_by_job_id=2, pid=1960 2024-05-10T22:54:00.838347263Z [2024-05-10T22:54:00.837+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:54:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:54:00.850498456Z [2024-05-10T22:54:00.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:54:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:54:00.856968296Z [2024-05-10T22:54:00.856+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:54:00.862922694Z [2024-05-10T22:54:00.862+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:54:00.955182303Z [2024-05-10T22:54:00.954+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:54:00.955231447Z 2024-05-10T22:54:00.955239676Z 2024-05-10T22:54:00.955246021Z 2024-05-10T22:54:00.955252954Z 2024-05-10T22:54:00.955271784Z [2024-05-10T22:54:00.954+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:54:00.955298497Z [2024-05-10T22:54:00.955+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:54:00.955487529Z [2024-05-10T22:54:00.955+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:54:00.955609828Z [2024-05-10T22:54:00.955+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:54:00.956332234Z [2024-05-10T22:54:00.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:54:00.956355716Z 2024-05-10T22:54:00.956366248Z 2024-05-10T22:54:00.956375081Z 2024-05-10T22:54:00.956384131Z 2024-05-10T22:54:00.962056569Z [2024-05-10T22:54:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:54:00.962555132Z [2024-05-10T22:54:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:54:00.962881770Z [2024-05-10T22:54:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:54:00.963070797Z [2024-05-10T22:54:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:54:00.963417833Z [2024-05-10T22:54:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:54:00.963544084Z [2024-05-10T22:54:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:54:00.963887536Z [2024-05-10T22:54:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:54:00.964060017Z [2024-05-10T22:54:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:54:01.411525352Z [2024-05-10T22:54:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status queued for try_number 1 2024-05-10T22:54:01.411619793Z [2024-05-10T22:54:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:53:00+00:00 exited with status queued for try_number 1 2024-05-10T22:54:01.411766922Z [2024-05-10T22:54:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:53:00+00:00 exited with status queued for try_number 1 2024-05-10T22:54:01.411876497Z [2024-05-10T22:54:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:53:00+00:00 exited with status queued for try_number 1 2024-05-10T22:54:01.424062803Z [2024-05-10T22:54:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 820beab6-9b23-4d62-8a97-25297ce5d529 2024-05-10T22:54:01.424162060Z [2024-05-10T22:54:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf9944d1-3afb-4abc-9a2b-77c42ba31f2f 2024-05-10T22:54:01.424421226Z [2024-05-10T22:54:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to fec76622-0940-4455-9b94-e8c279351a45 2024-05-10T22:54:01.424587445Z [2024-05-10T22:54:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dc47b6a-da0a-438f-854e-c0f72ae89ed5 2024-05-10T22:54:02.607241731Z [2024-05-10T22:54:02.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:54:02.608152838Z [2024-05-10T22:54:02.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:52:00+00:00, run_id=scheduled__2024-05-10T22:52:00+00:00, run_start_date=2024-05-10 22:54:00.872573+00:00, run_end_date=2024-05-10 22:54:02.607125+00:00, run_duration=1.734552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:52:00+00:00, data_interval_end=2024-05-10 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:54:02.623290533Z [2024-05-10T22:54:02.622+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:54:00+00:00, run_after=2024-05-10T22:56:00+00:00 2024-05-10T22:54:02.632637926Z [2024-05-10T22:54:02.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:54:02.632852836Z [2024-05-10T22:54:02.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:53:00+00:00, run_id=scheduled__2024-05-10T22:53:00+00:00, run_start_date=2024-05-10 22:54:00.874582+00:00, run_end_date=2024-05-10 22:54:02.632479+00:00, run_duration=1.757897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:53:00+00:00, data_interval_end=2024-05-10 22:54:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:54:02.645525875Z [2024-05-10T22:54:02.645+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:54:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:54:02.710998302Z [2024-05-10T22:54:02.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:52:00+00:00 exited with status success for try_number 1 2024-05-10T22:54:02.711090982Z [2024-05-10T22:54:02.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:53:00+00:00 exited with status success for try_number 1 2024-05-10T22:54:02.731584862Z [2024-05-10T22:54:02.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:52:00+00:00, map_index=-1, run_start_date=2024-05-10 22:54:01.874998+00:00, run_end_date=2024-05-10 22:54:02.331911+00:00, run_duration=0.456913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:54:00.957388+00:00, queued_by_job_id=2, pid=1994 2024-05-10T22:54:02.732006650Z [2024-05-10T22:54:02.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:53:00+00:00, map_index=-1, run_start_date=2024-05-10 22:54:02.027069+00:00, run_end_date=2024-05-10 22:54:02.434716+00:00, run_duration=0.407647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:54:00.957388+00:00, queued_by_job_id=2, pid=1995 2024-05-10T22:54:05.982151597Z [2024-05-10T22:54:05.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:54:05.982471628Z [2024-05-10T22:54:05.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:53:00+00:00, run_id=scheduled__2024-05-10T22:53:00+00:00, run_start_date=2024-05-10 22:54:00.875749+00:00, run_end_date=2024-05-10 22:54:05.981976+00:00, run_duration=5.106227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:53:00+00:00, data_interval_end=2024-05-10 22:54:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:54:05.992825282Z [2024-05-10T22:54:05.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:54:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:54:06.000195126Z [2024-05-10T22:54:05.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:54:06.000435194Z [2024-05-10T22:54:05.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:53:00+00:00, run_id=scheduled__2024-05-10T22:53:00+00:00, run_start_date=2024-05-10 22:54:00.877344+00:00, run_end_date=2024-05-10 22:54:05.999881+00:00, run_duration=5.122537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:53:00+00:00, data_interval_end=2024-05-10 22:54:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:54:06.025021814Z [2024-05-10T22:54:06.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:54:00+00:00, run_after=2024-05-10T22:55:00+00:00 2024-05-10T22:54:06.068537456Z [2024-05-10T22:54:06.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:53:00+00:00 exited with status success for try_number 1 2024-05-10T22:54:06.068659983Z [2024-05-10T22:54:06.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:53:00+00:00 exited with status success for try_number 1 2024-05-10T22:54:06.078931318Z [2024-05-10T22:54:06.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:53:00+00:00, map_index=-1, run_start_date=2024-05-10 22:54:03.478409+00:00, run_end_date=2024-05-10 22:54:04.957991+00:00, run_duration=1.479582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:54:00.957388+00:00, queued_by_job_id=2, pid=2019 2024-05-10T22:54:06.079127292Z [2024-05-10T22:54:06.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:53:00+00:00, map_index=-1, run_start_date=2024-05-10 22:54:03.424331+00:00, run_end_date=2024-05-10 22:54:05.209518+00:00, run_duration=1.785187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:54:00.957388+00:00, queued_by_job_id=2, pid=2018 2024-05-10T22:55:00.668169688Z [2024-05-10T22:55:00.667+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:55:00.682508889Z [2024-05-10T22:55:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T22:56:00+00:00 2024-05-10T22:55:00.694860266Z [2024-05-10T22:55:00.694+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T22:56:00+00:00 2024-05-10T22:55:00.708124465Z [2024-05-10T22:55:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:55:00.779969382Z [2024-05-10T22:55:00.779+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:55:00.780064386Z 2024-05-10T22:55:00.780074719Z 2024-05-10T22:55:00.780083577Z 2024-05-10T22:55:00.780091843Z 2024-05-10T22:55:00.780128346Z [2024-05-10T22:55:00.779+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:55:00.780372522Z [2024-05-10T22:55:00.780+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:55:00.780591211Z [2024-05-10T22:55:00.780+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:55:00.780793332Z [2024-05-10T22:55:00.780+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:55:00.781454886Z [2024-05-10T22:55:00.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:55:00.781473332Z 2024-05-10T22:55:00.781482725Z 2024-05-10T22:55:00.781491026Z 2024-05-10T22:55:00.781499384Z 2024-05-10T22:55:00.785751797Z [2024-05-10T22:55:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T22:55:00.785951544Z [2024-05-10T22:55:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:55:00.786582512Z [2024-05-10T22:55:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:55:00.786771012Z [2024-05-10T22:55:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:55:00.787050821Z [2024-05-10T22:55:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:55:00.787250825Z [2024-05-10T22:55:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:55:00.787591684Z [2024-05-10T22:55:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:55:00.787761157Z [2024-05-10T22:55:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:55:01.224261169Z [2024-05-10T22:55:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:01.224299106Z [2024-05-10T22:55:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:01.224312215Z [2024-05-10T22:55:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:01.224404492Z [2024-05-10T22:55:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:01.249805809Z [2024-05-10T22:55:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e71c2e7-4667-4d45-a97e-ab23507aed08 2024-05-10T22:55:01.250343485Z [2024-05-10T22:55:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00b053f3-93ee-4554-8560-147ff9a538e9 2024-05-10T22:55:01.250671346Z [2024-05-10T22:55:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e1417f9-1597-491f-b288-1c4606a5fcea 2024-05-10T22:55:01.250922459Z [2024-05-10T22:55:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf528a30-c950-4847-88f4-b7fad522987f 2024-05-10T22:55:02.482193528Z [2024-05-10T22:55:02.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:55:02.482884023Z [2024-05-10T22:55:02.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:54:00+00:00, run_id=scheduled__2024-05-10T22:54:00+00:00, run_start_date=2024-05-10 22:55:00.722061+00:00, run_end_date=2024-05-10 22:55:02.482495+00:00, run_duration=1.760434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:54:00+00:00, data_interval_end=2024-05-10 22:55:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:55:02.494782214Z [2024-05-10T22:55:02.494+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T22:56:00+00:00 2024-05-10T22:55:02.526613778Z [2024-05-10T22:55:02.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:02.532101030Z [2024-05-10T22:55:02.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:54:00+00:00, map_index=-1, run_start_date=2024-05-10 22:55:01.755229+00:00, run_end_date=2024-05-10 22:55:02.203498+00:00, run_duration=0.448269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:00.782401+00:00, queued_by_job_id=2, pid=2051 2024-05-10T22:55:03.622167123Z [2024-05-10T22:55:03.621+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:55:03.622196248Z 2024-05-10T22:55:03.622288324Z [2024-05-10T22:55:03.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:55:03.622908978Z [2024-05-10T22:55:03.622+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:55:03.622920522Z 2024-05-10T22:55:03.625504900Z [2024-05-10T22:55:03.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T22:55:03.625606344Z [2024-05-10T22:55:03.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:55:03.671838005Z [2024-05-10T22:55:03.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:03.671937147Z [2024-05-10T22:55:03.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:03.676640134Z [2024-05-10T22:55:03.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f448c12-edd4-49bf-b026-4523f6da90a0 2024-05-10T22:55:03.676831176Z [2024-05-10T22:55:03.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:55:02.851408+00:00, run_end_date=2024-05-10 22:55:03.249938+00:00, run_duration=0.39853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:00.782401+00:00, queued_by_job_id=2, pid=2076 2024-05-10T22:55:04.828123186Z [2024-05-10T22:55:04.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:55:04.828360494Z [2024-05-10T22:55:04.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:54:00+00:00, run_id=scheduled__2024-05-10T22:54:00+00:00, run_start_date=2024-05-10 22:55:00.720961+00:00, run_end_date=2024-05-10 22:55:04.828009+00:00, run_duration=4.107048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:54:00+00:00, data_interval_end=2024-05-10 22:55:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:55:04.837425466Z [2024-05-10T22:55:04.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T22:56:00+00:00 2024-05-10T22:55:04.917298736Z [2024-05-10T22:55:04.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:04.924601959Z [2024-05-10T22:55:04.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:54:00+00:00, map_index=-1, run_start_date=2024-05-10 22:55:02.800944+00:00, run_end_date=2024-05-10 22:55:04.101093+00:00, run_duration=1.300149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:00.782401+00:00, queued_by_job_id=2, pid=2075 2024-05-10T22:55:05.969771750Z [2024-05-10T22:55:05.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:55:05.970201672Z [2024-05-10T22:55:05.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:54:00+00:00, run_id=scheduled__2024-05-10T22:54:00+00:00, run_start_date=2024-05-10 22:55:00.719878+00:00, run_end_date=2024-05-10 22:55:05.969670+00:00, run_duration=5.249792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:54:00+00:00, data_interval_end=2024-05-10 22:55:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:55:05.979296716Z [2024-05-10T22:55:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T22:56:00+00:00 2024-05-10T22:55:06.024500608Z [2024-05-10T22:55:06.024+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:55:06.024533571Z 2024-05-10T22:55:06.024854815Z [2024-05-10T22:55:06.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:55:06.025820237Z [2024-05-10T22:55:06.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:55:06.025835148Z 2024-05-10T22:55:06.029100141Z [2024-05-10T22:55:06.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T22:55:06.029274041Z [2024-05-10T22:55:06.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:55:06.101954829Z [2024-05-10T22:55:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:06.102274473Z [2024-05-10T22:55:06.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:06.102365282Z [2024-05-10T22:55:06.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:06.110668186Z [2024-05-10T22:55:06.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:54:00+00:00, map_index=-1, run_start_date=2024-05-10 22:55:02.864553+00:00, run_end_date=2024-05-10 22:55:05.719426+00:00, run_duration=2.854873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:00.782401+00:00, queued_by_job_id=2, pid=2077 2024-05-10T22:55:06.110918225Z [2024-05-10T22:55:06.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1899fb8-e044-4bdd-858f-b475391ddc66 2024-05-10T22:55:06.111064580Z [2024-05-10T22:55:06.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:55:05.308622+00:00, run_end_date=2024-05-10 22:55:05.699882+00:00, run_duration=0.39126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:03.623176+00:00, queued_by_job_id=2, pid=2109 2024-05-10T22:55:08.698915564Z [2024-05-10T22:55:08.698+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T22:55:08.698959038Z 2024-05-10T22:55:08.699018574Z [2024-05-10T22:55:08.698+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:55:08.699709858Z [2024-05-10T22:55:08.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:55:08.699728207Z 2024-05-10T22:55:08.701650104Z [2024-05-10T22:55:08.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:55:08.701847185Z [2024-05-10T22:55:08.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:55:08.755078411Z [2024-05-10T22:55:08.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status queued for try_number 1 2024-05-10T22:55:08.755119836Z [2024-05-10T22:55:08.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:08.766235195Z [2024-05-10T22:55:08.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77681907-66ac-4063-905a-adbb16d1d758 2024-05-10T22:55:08.766684875Z [2024-05-10T22:55:08.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=0, run_start_date=2024-05-10 22:55:07.734005+00:00, run_end_date=2024-05-10 22:55:08.021565+00:00, run_duration=0.28756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:06.026394+00:00, queued_by_job_id=2, pid=2120 2024-05-10T22:55:10.879986659Z [2024-05-10T22:55:10.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:55:10.880381628Z [2024-05-10T22:55:10.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:50:00+00:00, run_id=scheduled__2024-05-10T22:50:00+00:00, run_start_date=2024-05-10 22:55:00.718689+00:00, run_end_date=2024-05-10 22:55:10.879885+00:00, run_duration=10.161196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:50:00+00:00, data_interval_end=2024-05-10 22:55:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T22:55:10.888099630Z [2024-05-10T22:55:10.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:55:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:55:10.916149372Z [2024-05-10T22:55:10.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:50:00+00:00 exited with status success for try_number 1 2024-05-10T22:55:10.921134881Z [2024-05-10T22:55:10.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:50:00+00:00, map_index=-1, run_start_date=2024-05-10 22:55:10.240929+00:00, run_end_date=2024-05-10 22:55:10.595444+00:00, run_duration=0.354515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:55:08.700038+00:00, queued_by_job_id=2, pid=2128 2024-05-10T22:55:33.389711543Z [2024-05-10T22:55:33.388+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T22:56:00.118715787Z [2024-05-10T22:56:00.118+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:56:00.130208443Z [2024-05-10T22:56:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:56:00+00:00, run_after=2024-05-10T22:57:00+00:00 2024-05-10T22:56:00.137032886Z [2024-05-10T22:56:00.136+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:56:00.149583542Z [2024-05-10T22:56:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:56:00+00:00, run_after=2024-05-10T22:57:00+00:00 2024-05-10T22:56:00.223439543Z [2024-05-10T22:56:00.223+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:56:00.223464967Z 2024-05-10T22:56:00.223473708Z 2024-05-10T22:56:00.223477007Z 2024-05-10T22:56:00.223480096Z 2024-05-10T22:56:00.223621524Z [2024-05-10T22:56:00.223+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:56:00.223846471Z [2024-05-10T22:56:00.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:56:00.224048638Z [2024-05-10T22:56:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:56:00.224292352Z [2024-05-10T22:56:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:56:00.224940153Z [2024-05-10T22:56:00.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:56:00.224952741Z 2024-05-10T22:56:00.224956528Z 2024-05-10T22:56:00.224959792Z 2024-05-10T22:56:00.224963225Z 2024-05-10T22:56:00.228627347Z [2024-05-10T22:56:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:56:00.228838132Z [2024-05-10T22:56:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:56:00.229287965Z [2024-05-10T22:56:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:56:00.229482278Z [2024-05-10T22:56:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:56:00.229757498Z [2024-05-10T22:56:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:56:00.229981189Z [2024-05-10T22:56:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:56:00.230254175Z [2024-05-10T22:56:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:56:00.230412642Z [2024-05-10T22:56:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:56:00.517186603Z [2024-05-10T22:56:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status queued for try_number 1 2024-05-10T22:56:00.518015664Z [2024-05-10T22:56:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T22:56:00.518153342Z [2024-05-10T22:56:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T22:56:00.518281385Z [2024-05-10T22:56:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T22:56:00.535282292Z [2024-05-10T22:56:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to f33e3141-b4f3-4afb-9348-191e8adedd82 2024-05-10T22:56:00.535921203Z [2024-05-10T22:56:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14c047ab-8820-4145-b47a-bb8a6023dd81 2024-05-10T22:56:00.536268459Z [2024-05-10T22:56:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee29bd52-72c8-4710-b4d2-44b071c70760 2024-05-10T22:56:00.536558485Z [2024-05-10T22:56:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5947ce3-07f3-4012-ab7b-411e54a4259a 2024-05-10T22:56:01.810015223Z [2024-05-10T22:56:01.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:56:01.810387876Z [2024-05-10T22:56:01.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:54:00+00:00, run_id=scheduled__2024-05-10T22:54:00+00:00, run_start_date=2024-05-10 22:56:00.158904+00:00, run_end_date=2024-05-10 22:56:01.810020+00:00, run_duration=1.651116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:54:00+00:00, data_interval_end=2024-05-10 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:56:01.819430984Z [2024-05-10T22:56:01.819+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:56:00+00:00, run_after=2024-05-10T22:58:00+00:00 2024-05-10T22:56:01.831865164Z [2024-05-10T22:56:01.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:56:01.832329384Z [2024-05-10T22:56:01.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:55:00+00:00, run_id=scheduled__2024-05-10T22:55:00+00:00, run_start_date=2024-05-10 22:56:00.161699+00:00, run_end_date=2024-05-10 22:56:01.831958+00:00, run_duration=1.670259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:55:00+00:00, data_interval_end=2024-05-10 22:56:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:56:01.845005871Z [2024-05-10T22:56:01.844+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:56:00+00:00, run_after=2024-05-10T22:57:00+00:00 2024-05-10T22:56:01.912547695Z [2024-05-10T22:56:01.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:54:00+00:00 exited with status success for try_number 1 2024-05-10T22:56:01.923485921Z [2024-05-10T22:56:01.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:54:00+00:00, map_index=-1, run_start_date=2024-05-10 22:56:01.013998+00:00, run_end_date=2024-05-10 22:56:01.421832+00:00, run_duration=0.407834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:56:00.225996+00:00, queued_by_job_id=2, pid=2133 2024-05-10T22:56:02.242782962Z [2024-05-10T22:56:02.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T22:56:02.247502836Z [2024-05-10T22:56:02.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=-1, run_start_date=2024-05-10 22:56:01.423357+00:00, run_end_date=2024-05-10 22:56:01.781374+00:00, run_duration=0.358017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:56:00.225996+00:00, queued_by_job_id=2, pid=2145 2024-05-10T22:56:04.397209384Z [2024-05-10T22:56:04.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:56:04.397497753Z [2024-05-10T22:56:04.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:55:00+00:00, run_id=scheduled__2024-05-10T22:55:00+00:00, run_start_date=2024-05-10 22:56:00.160542+00:00, run_end_date=2024-05-10 22:56:04.397077+00:00, run_duration=4.236535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:55:00+00:00, data_interval_end=2024-05-10 22:56:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:56:04.409348739Z [2024-05-10T22:56:04.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:56:00+00:00, run_after=2024-05-10T22:57:00+00:00 2024-05-10T22:56:04.417203866Z [2024-05-10T22:56:04.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:56:04.417546632Z [2024-05-10T22:56:04.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:55:00+00:00, run_id=scheduled__2024-05-10T22:55:00+00:00, run_start_date=2024-05-10 22:56:00.162712+00:00, run_end_date=2024-05-10 22:56:04.417056+00:00, run_duration=4.254344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:55:00+00:00, data_interval_end=2024-05-10 22:56:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:56:04.429693964Z [2024-05-10T22:56:04.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:56:00+00:00, run_after=2024-05-10T22:57:00+00:00 2024-05-10T22:56:04.461502132Z [2024-05-10T22:56:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T22:56:04.461546672Z [2024-05-10T22:56:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T22:56:04.469519892Z [2024-05-10T22:56:04.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=-1, run_start_date=2024-05-10 22:56:02.484587+00:00, run_end_date=2024-05-10 22:56:03.632599+00:00, run_duration=1.148012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:56:00.225996+00:00, queued_by_job_id=2, pid=2168 2024-05-10T22:56:04.469798974Z [2024-05-10T22:56:04.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=-1, run_start_date=2024-05-10 22:56:02.166356+00:00, run_end_date=2024-05-10 22:56:03.690099+00:00, run_duration=1.523743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:56:00.225996+00:00, queued_by_job_id=2, pid=2157 2024-05-10T22:57:00.442158321Z [2024-05-10T22:57:00.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:57:00+00:00, run_after=2024-05-10T22:58:00+00:00 2024-05-10T22:57:00.464792192Z [2024-05-10T22:57:00.464+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:57:00.481558088Z [2024-05-10T22:57:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:57:00+00:00, run_after=2024-05-10T22:58:00+00:00 2024-05-10T22:57:00.543141772Z [2024-05-10T22:57:00.542+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:57:00.543171598Z 2024-05-10T22:57:00.543176606Z 2024-05-10T22:57:00.543180959Z 2024-05-10T22:57:00.546290768Z [2024-05-10T22:57:00.546+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:57:00.546373249Z [2024-05-10T22:57:00.546+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:57:00.546499103Z [2024-05-10T22:57:00.546+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:57:00.547087805Z [2024-05-10T22:57:00.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:57:00.547093988Z 2024-05-10T22:57:00.547098087Z 2024-05-10T22:57:00.547102688Z 2024-05-10T22:57:00.555130084Z [2024-05-10T22:57:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:57:00.555550631Z [2024-05-10T22:57:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:57:00.556266724Z [2024-05-10T22:57:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:57:00.556587429Z [2024-05-10T22:57:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:57:00.557246356Z [2024-05-10T22:57:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:57:00.557544377Z [2024-05-10T22:57:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:57:00.959493830Z [2024-05-10T22:57:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status queued for try_number 1 2024-05-10T22:57:00.959692624Z [2024-05-10T22:57:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status queued for try_number 1 2024-05-10T22:57:00.959909805Z [2024-05-10T22:57:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status queued for try_number 1 2024-05-10T22:57:00.980050537Z [2024-05-10T22:57:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08fcdb44-a320-4666-a421-e485070a2882 2024-05-10T22:57:00.980253852Z [2024-05-10T22:57:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2020f451-647d-4b47-8db4-8b370e4cd949 2024-05-10T22:57:00.980465750Z [2024-05-10T22:57:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58ebf7e8-42f3-458c-b55f-4ee6768ed7eb 2024-05-10T22:57:02.143079228Z [2024-05-10T22:57:02.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:57:02.143238894Z [2024-05-10T22:57:02.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:56:00+00:00, run_id=scheduled__2024-05-10T22:56:00+00:00, run_start_date=2024-05-10 22:57:00.492665+00:00, run_end_date=2024-05-10 22:57:02.142938+00:00, run_duration=1.650273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:56:00+00:00, data_interval_end=2024-05-10 22:57:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:57:02.153019705Z [2024-05-10T22:57:02.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:57:00+00:00, run_after=2024-05-10T22:58:00+00:00 2024-05-10T22:57:02.179751298Z [2024-05-10T22:57:02.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status success for try_number 1 2024-05-10T22:57:02.192612021Z [2024-05-10T22:57:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:56:00+00:00, map_index=-1, run_start_date=2024-05-10 22:57:01.570932+00:00, run_end_date=2024-05-10 22:57:01.924238+00:00, run_duration=0.353306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:57:00.550692+00:00, queued_by_job_id=2, pid=2196 2024-05-10T22:57:04.282349804Z [2024-05-10T22:57:04.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:57:04.282573311Z [2024-05-10T22:57:04.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:56:00+00:00, run_id=scheduled__2024-05-10T22:56:00+00:00, run_start_date=2024-05-10 22:57:00.493839+00:00, run_end_date=2024-05-10 22:57:04.282189+00:00, run_duration=3.78835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:56:00+00:00, data_interval_end=2024-05-10 22:57:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:57:04.291880765Z [2024-05-10T22:57:04.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:57:00+00:00, run_after=2024-05-10T22:58:00+00:00 2024-05-10T22:57:04.337039970Z [2024-05-10T22:57:04.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status success for try_number 1 2024-05-10T22:57:04.346519015Z [2024-05-10T22:57:04.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:56:00+00:00, map_index=-1, run_start_date=2024-05-10 22:57:02.786545+00:00, run_end_date=2024-05-10 22:57:03.968269+00:00, run_duration=1.181724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:57:00.550692+00:00, queued_by_job_id=2, pid=2215 2024-05-10T22:57:05.390975626Z [2024-05-10T22:57:05.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:57:05.391137037Z [2024-05-10T22:57:05.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:56:00+00:00, run_id=scheduled__2024-05-10T22:56:00+00:00, run_start_date=2024-05-10 22:57:00.494835+00:00, run_end_date=2024-05-10 22:57:05.390888+00:00, run_duration=4.896053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:56:00+00:00, data_interval_end=2024-05-10 22:57:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:57:05.399952360Z [2024-05-10T22:57:05.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:57:00+00:00, run_after=2024-05-10T22:58:00+00:00 2024-05-10T22:57:05.429123601Z [2024-05-10T22:57:05.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status success for try_number 1 2024-05-10T22:57:05.434309519Z [2024-05-10T22:57:05.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:56:00+00:00, map_index=-1, run_start_date=2024-05-10 22:57:02.562001+00:00, run_end_date=2024-05-10 22:57:05.238347+00:00, run_duration=2.676346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:57:00.550692+00:00, queued_by_job_id=2, pid=2214 2024-05-10T22:58:00.116321356Z [2024-05-10T22:58:00.113+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:58:00.140820552Z [2024-05-10T22:58:00.127+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:58:00.140845041Z [2024-05-10T22:58:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:58:00+00:00, run_after=2024-05-10T22:59:00+00:00 2024-05-10T22:58:00.156358623Z [2024-05-10T22:58:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:58:00+00:00, run_after=2024-05-10T22:59:00+00:00 2024-05-10T22:58:00.259339110Z [2024-05-10T22:58:00.258+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T22:58:00.259363505Z 2024-05-10T22:58:00.259367779Z 2024-05-10T22:58:00.259371350Z 2024-05-10T22:58:00.259374539Z 2024-05-10T22:58:00.259446395Z [2024-05-10T22:58:00.259+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T22:58:00.259631995Z [2024-05-10T22:58:00.259+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:58:00.259781675Z [2024-05-10T22:58:00.259+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:58:00.259913167Z [2024-05-10T22:58:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:58:00.260572042Z [2024-05-10T22:58:00.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:58:00.260590539Z 2024-05-10T22:58:00.260616523Z 2024-05-10T22:58:00.260622600Z 2024-05-10T22:58:00.260627661Z 2024-05-10T22:58:00.264046721Z [2024-05-10T22:58:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:58:00.264183897Z [2024-05-10T22:58:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:58:00.264438405Z [2024-05-10T22:58:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:58:00.264582304Z [2024-05-10T22:58:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:58:00.264816233Z [2024-05-10T22:58:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:58:00.264944711Z [2024-05-10T22:58:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:58:00.265189330Z [2024-05-10T22:58:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:58:00.265317285Z [2024-05-10T22:58:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:58:01.407494880Z [2024-05-10T22:58:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status queued for try_number 1 2024-05-10T22:58:01.410461716Z [2024-05-10T22:58:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:57:00+00:00 exited with status queued for try_number 1 2024-05-10T22:58:01.410900086Z [2024-05-10T22:58:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:57:00+00:00 exited with status queued for try_number 1 2024-05-10T22:58:01.411979035Z [2024-05-10T22:58:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:57:00+00:00 exited with status queued for try_number 1 2024-05-10T22:58:01.447979159Z [2024-05-10T22:58:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cb7bef2-5e17-4292-9f30-bb966c4a7293 2024-05-10T22:58:01.448281002Z [2024-05-10T22:58:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0354293-2cbd-4db7-b2dd-b8dfe1074833 2024-05-10T22:58:01.448540410Z [2024-05-10T22:58:01.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a5f253c-5734-466e-9abf-20066512c0b1 2024-05-10T22:58:01.448769656Z [2024-05-10T22:58:01.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b06e19f-acbd-4d7a-aab6-f939a044da11 2024-05-10T22:58:04.136534540Z [2024-05-10T22:58:04.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:58:04.136924329Z [2024-05-10T22:58:04.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:57:00+00:00, run_id=scheduled__2024-05-10T22:57:00+00:00, run_start_date=2024-05-10 22:58:00.175078+00:00, run_end_date=2024-05-10 22:58:04.136574+00:00, run_duration=3.961496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:57:00+00:00, data_interval_end=2024-05-10 22:58:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:58:04.161675029Z [2024-05-10T22:58:04.160+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:58:00+00:00, run_after=2024-05-10T22:59:00+00:00 2024-05-10T22:58:04.186130208Z [2024-05-10T22:58:04.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:58:04.186514388Z [2024-05-10T22:58:04.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:56:00+00:00, run_id=scheduled__2024-05-10T22:56:00+00:00, run_start_date=2024-05-10 22:58:00.173839+00:00, run_end_date=2024-05-10 22:58:04.186204+00:00, run_duration=4.012365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:56:00+00:00, data_interval_end=2024-05-10 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T22:58:04.274635051Z [2024-05-10T22:58:04.274+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T22:58:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:58:05.026058284Z [2024-05-10T22:58:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:56:00+00:00 exited with status success for try_number 1 2024-05-10T22:58:05.026133187Z [2024-05-10T22:58:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:57:00+00:00 exited with status success for try_number 1 2024-05-10T22:58:05.055435125Z [2024-05-10T22:58:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:57:00+00:00, map_index=-1, run_start_date=2024-05-10 22:58:02.060658+00:00, run_end_date=2024-05-10 22:58:02.916458+00:00, run_duration=0.8558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:58:00.261446+00:00, queued_by_job_id=2, pid=2248 2024-05-10T22:58:05.060124001Z [2024-05-10T22:58:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:56:00+00:00, map_index=-1, run_start_date=2024-05-10 22:58:02.572804+00:00, run_end_date=2024-05-10 22:58:03.711134+00:00, run_duration=1.13833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:58:00.261446+00:00, queued_by_job_id=2, pid=2254 2024-05-10T22:58:11.560781443Z [2024-05-10T22:58:11.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:58:11.561048063Z [2024-05-10T22:58:11.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:57:00+00:00, run_id=scheduled__2024-05-10T22:57:00+00:00, run_start_date=2024-05-10 22:58:00.177561+00:00, run_end_date=2024-05-10 22:58:11.560677+00:00, run_duration=11.383116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:57:00+00:00, data_interval_end=2024-05-10 22:58:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:58:11.569345975Z [2024-05-10T22:58:11.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:58:00+00:00, run_after=2024-05-10T22:59:00+00:00 2024-05-10T22:58:11.575331487Z [2024-05-10T22:58:11.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:58:11.576149823Z [2024-05-10T22:58:11.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:57:00+00:00, run_id=scheduled__2024-05-10T22:57:00+00:00, run_start_date=2024-05-10 22:58:00.176133+00:00, run_end_date=2024-05-10 22:58:11.575248+00:00, run_duration=11.399115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:57:00+00:00, data_interval_end=2024-05-10 22:58:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:58:11.594606360Z [2024-05-10T22:58:11.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:58:00+00:00, run_after=2024-05-10T22:59:00+00:00 2024-05-10T22:58:11.631821045Z [2024-05-10T22:58:11.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:57:00+00:00 exited with status success for try_number 1 2024-05-10T22:58:11.632076263Z [2024-05-10T22:58:11.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:57:00+00:00 exited with status success for try_number 1 2024-05-10T22:58:11.646598584Z [2024-05-10T22:58:11.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:57:00+00:00, map_index=-1, run_start_date=2024-05-10 22:58:06.944377+00:00, run_end_date=2024-05-10 22:58:10.327675+00:00, run_duration=3.383298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:58:00.261446+00:00, queued_by_job_id=2, pid=2281 2024-05-10T22:58:11.647466470Z [2024-05-10T22:58:11.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:57:00+00:00, map_index=-1, run_start_date=2024-05-10 22:58:08.154705+00:00, run_end_date=2024-05-10 22:58:10.733428+00:00, run_duration=2.578723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:58:00.261446+00:00, queued_by_job_id=2, pid=2287 2024-05-10T22:59:00.166136276Z [2024-05-10T22:59:00.165+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T22:59:00.201225271Z [2024-05-10T22:59:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:59:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:59:00.225118135Z [2024-05-10T22:59:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:59:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:59:00.292697471Z [2024-05-10T22:59:00.292+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T22:59:00.292770912Z 2024-05-10T22:59:00.292797576Z 2024-05-10T22:59:00.292817473Z 2024-05-10T22:59:00.293095165Z [2024-05-10T22:59:00.292+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:59:00.293110034Z [2024-05-10T22:59:00.292+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T22:59:00.293120988Z [2024-05-10T22:59:00.292+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T22:59:00.293743299Z [2024-05-10T22:59:00.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T22:59:00.293761801Z 2024-05-10T22:59:00.293768949Z 2024-05-10T22:59:00.293775848Z 2024-05-10T22:59:00.299653396Z [2024-05-10T22:59:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:59:00.299678240Z [2024-05-10T22:59:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:59:00.299685672Z [2024-05-10T22:59:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:59:00.299692627Z [2024-05-10T22:59:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:59:00.299699420Z [2024-05-10T22:59:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T22:59:00.299706628Z [2024-05-10T22:59:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:59:00.627450539Z [2024-05-10T22:59:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status queued for try_number 1 2024-05-10T22:59:00.631516713Z [2024-05-10T22:59:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status queued for try_number 1 2024-05-10T22:59:00.631647722Z [2024-05-10T22:59:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status queued for try_number 1 2024-05-10T22:59:00.652601166Z [2024-05-10T22:59:00.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef605aea-a2e2-4a36-8490-7df0e920233a 2024-05-10T22:59:00.652693988Z [2024-05-10T22:59:00.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20c3a359-3f4b-428b-a32f-82ee15aac9f4 2024-05-10T22:59:00.652745823Z [2024-05-10T22:59:00.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29feccc0-a8c9-43b9-93d8-7c08771ea548 2024-05-10T22:59:02.497839971Z [2024-05-10T22:59:02.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:59:02.498146721Z [2024-05-10T22:59:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:58:00+00:00, run_id=scheduled__2024-05-10T22:58:00+00:00, run_start_date=2024-05-10 22:59:00.237841+00:00, run_end_date=2024-05-10 22:59:02.497672+00:00, run_duration=2.259831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:58:00+00:00, data_interval_end=2024-05-10 22:59:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T22:59:02.511592073Z [2024-05-10T22:59:02.511+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T22:59:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:59:02.552264576Z [2024-05-10T22:59:02.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status success for try_number 1 2024-05-10T22:59:02.564477642Z [2024-05-10T22:59:02.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:58:00+00:00, map_index=-1, run_start_date=2024-05-10 22:59:01.743410+00:00, run_end_date=2024-05-10 22:59:02.243276+00:00, run_duration=0.499866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:59:00.294393+00:00, queued_by_job_id=2, pid=2304 2024-05-10T22:59:05.877386608Z [2024-05-10T22:59:05.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:59:05.878285450Z [2024-05-10T22:59:05.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:58:00+00:00, run_id=scheduled__2024-05-10T22:58:00+00:00, run_start_date=2024-05-10 22:59:00.240216+00:00, run_end_date=2024-05-10 22:59:05.877353+00:00, run_duration=5.637137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:58:00+00:00, data_interval_end=2024-05-10 22:59:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T22:59:05.896478066Z [2024-05-10T22:59:05.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:59:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:59:05.906906615Z [2024-05-10T22:59:05.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T22:59:05.907129854Z [2024-05-10T22:59:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:58:00+00:00, run_id=scheduled__2024-05-10T22:58:00+00:00, run_start_date=2024-05-10 22:59:00.239195+00:00, run_end_date=2024-05-10 22:59:05.906834+00:00, run_duration=5.667639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:58:00+00:00, data_interval_end=2024-05-10 22:59:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T22:59:05.919862471Z [2024-05-10T22:59:05.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T22:59:00+00:00, run_after=2024-05-10T23:00:00+00:00 2024-05-10T22:59:05.953023562Z [2024-05-10T22:59:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status success for try_number 1 2024-05-10T22:59:05.953146621Z [2024-05-10T22:59:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status success for try_number 1 2024-05-10T22:59:05.959813051Z [2024-05-10T22:59:05.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:58:00+00:00, map_index=-1, run_start_date=2024-05-10 22:59:02.838387+00:00, run_end_date=2024-05-10 22:59:04.988840+00:00, run_duration=2.150453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:59:00.294393+00:00, queued_by_job_id=2, pid=2322 2024-05-10T22:59:05.959959685Z [2024-05-10T22:59:05.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:58:00+00:00, map_index=-1, run_start_date=2024-05-10 22:59:03.034360+00:00, run_end_date=2024-05-10 22:59:05.388733+00:00, run_duration=2.354373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 22:59:00.294393+00:00, queued_by_job_id=2, pid=2323 2024-05-10T23:00:00.564407184Z [2024-05-10T23:00:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:01:00+00:00 2024-05-10T23:00:00.577940508Z [2024-05-10T23:00:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:01:00+00:00 2024-05-10T23:00:00.586274963Z [2024-05-10T23:00:00.585+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:00:00.593034045Z [2024-05-10T23:00:00.592+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:00:00.605093089Z [2024-05-10T23:00:00.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:00:00.696744431Z [2024-05-10T23:00:00.696+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T23:00:00.696770135Z 2024-05-10T23:00:00.696773794Z 2024-05-10T23:00:00.696777747Z 2024-05-10T23:00:00.696780986Z 2024-05-10T23:00:00.696799932Z 2024-05-10T23:00:00.696810710Z [2024-05-10T23:00:00.696+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:00:00.697074245Z [2024-05-10T23:00:00.696+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:00:00.697190249Z [2024-05-10T23:00:00.697+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:00:00.697280311Z [2024-05-10T23:00:00.697+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:00:00.697416817Z [2024-05-10T23:00:00.697+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:00:00.698084152Z [2024-05-10T23:00:00.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:00:00.698096933Z 2024-05-10T23:00:00.698100990Z 2024-05-10T23:00:00.698104569Z 2024-05-10T23:00:00.698107785Z 2024-05-10T23:00:00.698111104Z 2024-05-10T23:00:00.702513916Z [2024-05-10T23:00:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:00:00.702543497Z [2024-05-10T23:00:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:00:00.702741597Z [2024-05-10T23:00:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:00:00.702837241Z [2024-05-10T23:00:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:00:00.702988040Z [2024-05-10T23:00:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:00:00.703043070Z [2024-05-10T23:00:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:00:00.703340529Z [2024-05-10T23:00:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:00:00.703354409Z [2024-05-10T23:00:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:00:00.703414278Z [2024-05-10T23:00:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:00:00.703513589Z [2024-05-10T23:00:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:00:01.357582805Z [2024-05-10T23:00:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:01.359079322Z [2024-05-10T23:00:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:01.361806070Z [2024-05-10T23:00:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:59:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:01.362745233Z [2024-05-10T23:00:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:59:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:01.362756714Z [2024-05-10T23:00:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:59:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:01.380432011Z [2024-05-10T23:00:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9596ac66-fce1-4439-9ac4-736eecd67267 2024-05-10T23:00:01.380752976Z [2024-05-10T23:00:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20d4cefb-b724-4af0-b9fe-2323659a715b 2024-05-10T23:00:01.380928704Z [2024-05-10T23:00:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 276e2243-eeb4-486a-ad55-a009a627aea2 2024-05-10T23:00:01.381148894Z [2024-05-10T23:00:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to a412c1d8-2b10-44cb-9505-6490f2f03466 2024-05-10T23:00:01.381337382Z [2024-05-10T23:00:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6079ede-14b6-4d63-9d1f-d9cfbb6c2b93 2024-05-10T23:00:03.621265960Z [2024-05-10T23:00:03.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:00:03.621735998Z [2024-05-10T23:00:03.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 22:58:00+00:00, run_id=scheduled__2024-05-10T22:58:00+00:00, run_start_date=2024-05-10 23:00:00.619389+00:00, run_end_date=2024-05-10 23:00:03.621178+00:00, run_duration=3.001789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:58:00+00:00, data_interval_end=2024-05-10 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:00:03.630301098Z [2024-05-10T23:00:03.629+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:02:00+00:00 2024-05-10T23:00:03.638551928Z [2024-05-10T23:00:03.638+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:00:03.638698945Z [2024-05-10T23:00:03.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 22:59:00+00:00, run_id=scheduled__2024-05-10T22:59:00+00:00, run_start_date=2024-05-10 23:00:00.620568+00:00, run_end_date=2024-05-10 23:00:03.638461+00:00, run_duration=3.017893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:59:00+00:00, data_interval_end=2024-05-10 23:00:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:00:03.649109084Z [2024-05-10T23:00:03.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:01:00+00:00 2024-05-10T23:00:03.707237415Z [2024-05-10T23:00:03.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T22:58:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:03.707282813Z [2024-05-10T23:00:03.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:59:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:03.715711886Z [2024-05-10T23:00:03.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:59:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:01.853740+00:00, run_end_date=2024-05-10 23:00:02.570075+00:00, run_duration=0.716335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:00.698955+00:00, queued_by_job_id=2, pid=2358 2024-05-10T23:00:03.716001939Z [2024-05-10T23:00:03.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T22:58:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:02.219486+00:00, run_end_date=2024-05-10 23:00:02.752183+00:00, run_duration=0.532697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:00.698955+00:00, queued_by_job_id=2, pid=2359 2024-05-10T23:00:04.766258677Z [2024-05-10T23:00:04.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:00:04.766477805Z [2024-05-10T23:00:04.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:59:00+00:00, run_id=scheduled__2024-05-10T22:59:00+00:00, run_start_date=2024-05-10 23:00:00.621615+00:00, run_end_date=2024-05-10 23:00:04.766189+00:00, run_duration=4.144574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:59:00+00:00, data_interval_end=2024-05-10 23:00:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:00:04.776144818Z [2024-05-10T23:00:04.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:01:00+00:00 2024-05-10T23:00:04.821605129Z [2024-05-10T23:00:04.821+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:00:04.821658289Z 2024-05-10T23:00:04.821684310Z [2024-05-10T23:00:04.821+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:00:04.823045949Z [2024-05-10T23:00:04.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:00:04.823089082Z 2024-05-10T23:00:04.826606942Z [2024-05-10T23:00:04.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:00:04.826731845Z [2024-05-10T23:00:04.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:00:04.902128876Z [2024-05-10T23:00:04.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:04.902333587Z [2024-05-10T23:00:04.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:04.902537615Z [2024-05-10T23:00:04.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:59:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:04.914522059Z [2024-05-10T23:00:04.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:59:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:02.988755+00:00, run_end_date=2024-05-10 23:00:04.362371+00:00, run_duration=1.373616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:00.698955+00:00, queued_by_job_id=2, pid=2377 2024-05-10T23:00:04.914840453Z [2024-05-10T23:00:04.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to f53e87ce-4510-4a1e-9280-ef6cbb318530 2024-05-10T23:00:04.915149961Z [2024-05-10T23:00:04.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:03.652594+00:00, run_end_date=2024-05-10 23:00:04.027597+00:00, run_duration=0.375003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:00.698955+00:00, queued_by_job_id=2, pid=2394 2024-05-10T23:00:06.039981508Z [2024-05-10T23:00:06.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:00:06.040356193Z [2024-05-10T23:00:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:59:00+00:00, run_id=scheduled__2024-05-10T22:59:00+00:00, run_start_date=2024-05-10 23:00:00.622664+00:00, run_end_date=2024-05-10 23:00:06.039934+00:00, run_duration=5.41727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:59:00+00:00, data_interval_end=2024-05-10 23:00:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:00:06.050350568Z [2024-05-10T23:00:06.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:01:00+00:00 2024-05-10T23:00:06.103808810Z [2024-05-10T23:00:06.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T22:59:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:06.113109585Z [2024-05-10T23:00:06.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T22:59:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:03.541182+00:00, run_end_date=2024-05-10 23:00:05.217129+00:00, run_duration=1.675947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:00.698955+00:00, queued_by_job_id=2, pid=2393 2024-05-10T23:00:07.209378458Z [2024-05-10T23:00:07.208+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:00:07.209413434Z 2024-05-10T23:00:07.209618829Z [2024-05-10T23:00:07.209+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:00:07.210929254Z [2024-05-10T23:00:07.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:00:07.210943062Z 2024-05-10T23:00:07.213339917Z [2024-05-10T23:00:07.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:00:07.213621126Z [2024-05-10T23:00:07.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:00:07.253516937Z [2024-05-10T23:00:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:07.255823250Z [2024-05-10T23:00:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:07.261342212Z [2024-05-10T23:00:07.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9adba6b-3bbe-4d74-8d2f-27df1ca1799d 2024-05-10T23:00:07.261805606Z [2024-05-10T23:00:07.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:06.483040+00:00, run_end_date=2024-05-10 23:00:06.895525+00:00, run_duration=0.412485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:04.823515+00:00, queued_by_job_id=2, pid=2421 2024-05-10T23:00:09.606196332Z [2024-05-10T23:00:09.605+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:00:09.606234911Z 2024-05-10T23:00:09.606371378Z [2024-05-10T23:00:09.606+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:00:09.607228483Z [2024-05-10T23:00:09.606+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:00:09.607242874Z 2024-05-10T23:00:09.611012652Z [2024-05-10T23:00:09.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:00:09.611336644Z [2024-05-10T23:00:09.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:00:09.682901465Z [2024-05-10T23:00:09.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:00:09.682992298Z [2024-05-10T23:00:09.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:09.691449406Z [2024-05-10T23:00:09.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to c353ba09-fea9-4ff1-8ae2-a3db047c5b40 2024-05-10T23:00:09.691729967Z [2024-05-10T23:00:09.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=0, run_start_date=2024-05-10 23:00:08.907663+00:00, run_end_date=2024-05-10 23:00:09.284004+00:00, run_duration=0.376341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:07.211335+00:00, queued_by_job_id=2, pid=2432 2024-05-10T23:00:11.919437068Z [2024-05-10T23:00:11.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:00:11.920502480Z [2024-05-10T23:00:11.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 22:55:00+00:00, run_id=scheduled__2024-05-10T22:55:00+00:00, run_start_date=2024-05-10 23:00:00.618028+00:00, run_end_date=2024-05-10 23:00:11.919374+00:00, run_duration=11.301346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 22:55:00+00:00, data_interval_end=2024-05-10 23:00:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:00:11.927963863Z [2024-05-10T23:00:11.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:00:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:00:11.958769014Z [2024-05-10T23:00:11.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T22:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:00:11.966444980Z [2024-05-10T23:00:11.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T22:55:00+00:00, map_index=-1, run_start_date=2024-05-10 23:00:11.355903+00:00, run_end_date=2024-05-10 23:00:11.786338+00:00, run_duration=0.430435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:00:09.607787+00:00, queued_by_job_id=2, pid=2440 2024-05-10T23:00:33.450679556Z [2024-05-10T23:00:33.450+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:01:01.078316785Z [2024-05-10T23:01:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:01:00+00:00, run_after=2024-05-10T23:02:00+00:00 2024-05-10T23:01:01.095427855Z [2024-05-10T23:01:01.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:01:00+00:00, run_after=2024-05-10T23:02:00+00:00 2024-05-10T23:01:01.112527492Z [2024-05-10T23:01:01.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:01:01.176612300Z [2024-05-10T23:01:01.176+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:01:01.176680418Z 2024-05-10T23:01:01.176701257Z 2024-05-10T23:01:01.176704862Z 2024-05-10T23:01:01.176707864Z [2024-05-10T23:01:01.176+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:01:01.176710824Z [2024-05-10T23:01:01.176+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:01:01.176740592Z [2024-05-10T23:01:01.176+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:01:01.177199754Z [2024-05-10T23:01:01.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:01:01.177218540Z 2024-05-10T23:01:01.177222531Z 2024-05-10T23:01:01.177225922Z 2024-05-10T23:01:01.180774020Z [2024-05-10T23:01:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:01:01.180977820Z [2024-05-10T23:01:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:01:01.181293857Z [2024-05-10T23:01:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:01:01.181423892Z [2024-05-10T23:01:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:01:01.181674210Z [2024-05-10T23:01:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:01:01.181797991Z [2024-05-10T23:01:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:01:01.377868852Z [2024-05-10T23:01:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:01:01.377967969Z [2024-05-10T23:01:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:01:01.377973629Z [2024-05-10T23:01:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:01:01.387861698Z [2024-05-10T23:01:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33829e27-63e4-4092-841d-731aba04fcf7 2024-05-10T23:01:01.387937029Z [2024-05-10T23:01:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72e076aa-3b1a-4844-91a0-e4076ed4238b 2024-05-10T23:01:01.388090393Z [2024-05-10T23:01:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d2e38f7-3381-49f7-a5e4-fba1c96eb324 2024-05-10T23:01:03.473939169Z [2024-05-10T23:01:03.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:01:03.473975644Z [2024-05-10T23:01:03.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:00:00+00:00, run_id=scheduled__2024-05-10T23:00:00+00:00, run_start_date=2024-05-10 23:01:01.126006+00:00, run_end_date=2024-05-10 23:01:03.473354+00:00, run_duration=2.347348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:00:00+00:00, data_interval_end=2024-05-10 23:01:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:01:03.493047360Z [2024-05-10T23:01:03.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:01:00+00:00, run_after=2024-05-10T23:02:00+00:00 2024-05-10T23:01:03.558203777Z [2024-05-10T23:01:03.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:01:03.566432727Z [2024-05-10T23:01:03.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:01:02.020573+00:00, run_end_date=2024-05-10 23:01:02.583876+00:00, run_duration=0.563303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:01:01.177825+00:00, queued_by_job_id=2, pid=2449 2024-05-10T23:01:04.627216533Z [2024-05-10T23:01:04.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:01:04.627287751Z [2024-05-10T23:01:04.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:00:00+00:00, run_id=scheduled__2024-05-10T23:00:00+00:00, run_start_date=2024-05-10 23:01:01.127361+00:00, run_end_date=2024-05-10 23:01:04.627025+00:00, run_duration=3.499664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:00:00+00:00, data_interval_end=2024-05-10 23:01:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:01:04.636724228Z [2024-05-10T23:01:04.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:01:00+00:00, run_after=2024-05-10T23:02:00+00:00 2024-05-10T23:01:04.696462747Z [2024-05-10T23:01:04.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:01:04.707038900Z [2024-05-10T23:01:04.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:01:03.210571+00:00, run_end_date=2024-05-10 23:01:04.489394+00:00, run_duration=1.278823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:01:01.177825+00:00, queued_by_job_id=2, pid=2467 2024-05-10T23:01:05.755586614Z [2024-05-10T23:01:05.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:01:05.755879302Z [2024-05-10T23:01:05.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:00:00+00:00, run_id=scheduled__2024-05-10T23:00:00+00:00, run_start_date=2024-05-10 23:01:01.128443+00:00, run_end_date=2024-05-10 23:01:05.755400+00:00, run_duration=4.626957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:00:00+00:00, data_interval_end=2024-05-10 23:01:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:01:05.765045423Z [2024-05-10T23:01:05.764+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:01:00+00:00, run_after=2024-05-10T23:02:00+00:00 2024-05-10T23:01:05.797567301Z [2024-05-10T23:01:05.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:01:05.804398666Z [2024-05-10T23:01:05.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:01:03.221446+00:00, run_end_date=2024-05-10 23:01:04.983444+00:00, run_duration=1.761998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:01:01.177825+00:00, queued_by_job_id=2, pid=2468 2024-05-10T23:02:00.395307389Z [2024-05-10T23:02:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:02:00+00:00, run_after=2024-05-10T23:03:00+00:00 2024-05-10T23:02:00.404374087Z [2024-05-10T23:02:00.403+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:02:00.422444428Z [2024-05-10T23:02:00.421+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:02:00+00:00, run_after=2024-05-10T23:03:00+00:00 2024-05-10T23:02:00.428782836Z [2024-05-10T23:02:00.428+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:02:00.494414378Z [2024-05-10T23:02:00.493+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:02:00.494856697Z 2024-05-10T23:02:00.494870711Z 2024-05-10T23:02:00.494879412Z 2024-05-10T23:02:00.494887671Z 2024-05-10T23:02:00.494927714Z [2024-05-10T23:02:00.494+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:02:00.494959838Z [2024-05-10T23:02:00.494+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:02:00.495129090Z [2024-05-10T23:02:00.494+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:02:00.495339759Z [2024-05-10T23:02:00.495+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:02:00.497554258Z [2024-05-10T23:02:00.496+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:02:00.497581469Z 2024-05-10T23:02:00.497591228Z 2024-05-10T23:02:00.497600202Z 2024-05-10T23:02:00.497608824Z 2024-05-10T23:02:00.504063162Z [2024-05-10T23:02:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:02:00.504331243Z [2024-05-10T23:02:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:02:00.504809206Z [2024-05-10T23:02:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:02:00.504949860Z [2024-05-10T23:02:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:02:00.505269880Z [2024-05-10T23:02:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:02:00.505406194Z [2024-05-10T23:02:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:02:00.505764472Z [2024-05-10T23:02:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:02:00.505905997Z [2024-05-10T23:02:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:02:01.069362860Z [2024-05-10T23:02:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:02:01.069390073Z [2024-05-10T23:02:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:01:00+00:00 exited with status queued for try_number 1 2024-05-10T23:02:01.069393851Z [2024-05-10T23:02:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:01:00+00:00 exited with status queued for try_number 1 2024-05-10T23:02:01.069397125Z [2024-05-10T23:02:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:01:00+00:00 exited with status queued for try_number 1 2024-05-10T23:02:01.096514726Z [2024-05-10T23:02:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab8b5411-e20e-468d-aed6-09f32b82afa4 2024-05-10T23:02:01.097603636Z [2024-05-10T23:02:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb9f6b29-748f-4fd1-ade8-0db94ca80c8e 2024-05-10T23:02:01.097801468Z [2024-05-10T23:02:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to f79a1c05-4efd-4af9-8492-399fe0986c18 2024-05-10T23:02:01.098093275Z [2024-05-10T23:02:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to efd979c0-cc1e-474f-b775-ac912ac1bf58 2024-05-10T23:02:02.371901941Z [2024-05-10T23:02:02.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:02:02.372342397Z [2024-05-10T23:02:02.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:00:00+00:00, run_id=scheduled__2024-05-10T23:00:00+00:00, run_start_date=2024-05-10 23:02:00.437403+00:00, run_end_date=2024-05-10 23:02:02.371837+00:00, run_duration=1.934434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:00:00+00:00, data_interval_end=2024-05-10 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:02:02.379951382Z [2024-05-10T23:02:02.379+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:02:00+00:00, run_after=2024-05-10T23:04:00+00:00 2024-05-10T23:02:02.386586107Z [2024-05-10T23:02:02.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:02:02.386818030Z [2024-05-10T23:02:02.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:01:00+00:00, run_id=scheduled__2024-05-10T23:01:00+00:00, run_start_date=2024-05-10 23:02:00.438633+00:00, run_end_date=2024-05-10 23:02:02.386486+00:00, run_duration=1.947853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:01:00+00:00, data_interval_end=2024-05-10 23:02:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:02:02.399638436Z [2024-05-10T23:02:02.399+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:02:00+00:00, run_after=2024-05-10T23:03:00+00:00 2024-05-10T23:02:02.448945638Z [2024-05-10T23:02:02.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:02:02.449054085Z [2024-05-10T23:02:02.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:01:00+00:00 exited with status success for try_number 1 2024-05-10T23:02:02.456101768Z [2024-05-10T23:02:02.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:02:01.476925+00:00, run_end_date=2024-05-10 23:02:01.902347+00:00, run_duration=0.425422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:02:00.499024+00:00, queued_by_job_id=2, pid=2501 2024-05-10T23:02:02.456360248Z [2024-05-10T23:02:02.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:01:00+00:00, map_index=-1, run_start_date=2024-05-10 23:02:01.564608+00:00, run_end_date=2024-05-10 23:02:02.021756+00:00, run_duration=0.457148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:02:00.499024+00:00, queued_by_job_id=2, pid=2502 2024-05-10T23:02:04.466626934Z [2024-05-10T23:02:04.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:02:04.466877443Z [2024-05-10T23:02:04.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:01:00+00:00, run_id=scheduled__2024-05-10T23:01:00+00:00, run_start_date=2024-05-10 23:02:00.439661+00:00, run_end_date=2024-05-10 23:02:04.466481+00:00, run_duration=4.02682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:01:00+00:00, data_interval_end=2024-05-10 23:02:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:02:04.475721585Z [2024-05-10T23:02:04.475+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:02:00+00:00, run_after=2024-05-10T23:03:00+00:00 2024-05-10T23:02:04.483630346Z [2024-05-10T23:02:04.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:02:04.483934130Z [2024-05-10T23:02:04.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:01:00+00:00, run_id=scheduled__2024-05-10T23:01:00+00:00, run_start_date=2024-05-10 23:02:00.440688+00:00, run_end_date=2024-05-10 23:02:04.483609+00:00, run_duration=4.042921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:01:00+00:00, data_interval_end=2024-05-10 23:02:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:02:04.492866708Z [2024-05-10T23:02:04.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:02:00+00:00, run_after=2024-05-10T23:03:00+00:00 2024-05-10T23:02:04.524869339Z [2024-05-10T23:02:04.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:01:00+00:00 exited with status success for try_number 1 2024-05-10T23:02:04.530720070Z [2024-05-10T23:02:04.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:01:00+00:00, map_index=-1, run_start_date=2024-05-10 23:02:02.659479+00:00, run_end_date=2024-05-10 23:02:03.966430+00:00, run_duration=1.306951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:02:00.499024+00:00, queued_by_job_id=2, pid=2525 2024-05-10T23:02:05.622100774Z [2024-05-10T23:02:05.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:01:00+00:00 exited with status success for try_number 1 2024-05-10T23:02:05.627966725Z [2024-05-10T23:02:05.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:01:00+00:00, map_index=-1, run_start_date=2024-05-10 23:02:02.762852+00:00, run_end_date=2024-05-10 23:02:04.443886+00:00, run_duration=1.681034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:02:00.499024+00:00, queued_by_job_id=2, pid=2526 2024-05-10T23:03:00.048862224Z [2024-05-10T23:03:00.048+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:03:00.063347042Z [2024-05-10T23:03:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:03:00+00:00, run_after=2024-05-10T23:04:00+00:00 2024-05-10T23:03:00.076581886Z [2024-05-10T23:03:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:03:00+00:00, run_after=2024-05-10T23:04:00+00:00 2024-05-10T23:03:00.154379795Z [2024-05-10T23:03:00.153+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:03:00.154416430Z 2024-05-10T23:03:00.154421553Z 2024-05-10T23:03:00.154425671Z 2024-05-10T23:03:00.154429744Z [2024-05-10T23:03:00.153+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:03:00.154433663Z [2024-05-10T23:03:00.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:03:00.154437807Z [2024-05-10T23:03:00.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:03:00.154443201Z [2024-05-10T23:03:00.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:03:00.154447319Z 2024-05-10T23:03:00.154458181Z 2024-05-10T23:03:00.154462395Z 2024-05-10T23:03:00.158182786Z [2024-05-10T23:03:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:03:00.158216993Z [2024-05-10T23:03:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:03:00.158220403Z [2024-05-10T23:03:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:03:00.158223632Z [2024-05-10T23:03:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:03:00.158226924Z [2024-05-10T23:03:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:03:00.158240171Z [2024-05-10T23:03:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:03:00.613077774Z [2024-05-10T23:03:00.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status queued for try_number 1 2024-05-10T23:03:00.613387013Z [2024-05-10T23:03:00.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status queued for try_number 1 2024-05-10T23:03:00.613645103Z [2024-05-10T23:03:00.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status queued for try_number 1 2024-05-10T23:03:00.622408257Z [2024-05-10T23:03:00.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to 731e030a-a5d6-4350-a08d-5cddf0c73022 2024-05-10T23:03:00.622670832Z [2024-05-10T23:03:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3c1ea61-dff4-41d6-9a8c-93ebbc7f1503 2024-05-10T23:03:00.622874182Z [2024-05-10T23:03:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07545613-6dce-4869-8e01-b55d0c77c645 2024-05-10T23:03:01.471851562Z [2024-05-10T23:03:01.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:03:01.472396883Z [2024-05-10T23:03:01.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:02:00+00:00, run_id=scheduled__2024-05-10T23:02:00+00:00, run_start_date=2024-05-10 23:03:00.089177+00:00, run_end_date=2024-05-10 23:03:01.471991+00:00, run_duration=1.382814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:02:00+00:00, data_interval_end=2024-05-10 23:03:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:03:01.482280503Z [2024-05-10T23:03:01.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:03:00+00:00, run_after=2024-05-10T23:04:00+00:00 2024-05-10T23:03:02.663894810Z [2024-05-10T23:03:02.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status success for try_number 1 2024-05-10T23:03:02.672021114Z [2024-05-10T23:03:02.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:02:00+00:00, map_index=-1, run_start_date=2024-05-10 23:03:00.958197+00:00, run_end_date=2024-05-10 23:03:01.418636+00:00, run_duration=0.460439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:03:00.154824+00:00, queued_by_job_id=2, pid=2558 2024-05-10T23:03:03.744603202Z [2024-05-10T23:03:03.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:03:03.745014362Z [2024-05-10T23:03:03.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:02:00+00:00, run_id=scheduled__2024-05-10T23:02:00+00:00, run_start_date=2024-05-10 23:03:00.091763+00:00, run_end_date=2024-05-10 23:03:03.744520+00:00, run_duration=3.652757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:02:00+00:00, data_interval_end=2024-05-10 23:03:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:03:03.756527375Z [2024-05-10T23:03:03.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:03:00+00:00, run_after=2024-05-10T23:04:00+00:00 2024-05-10T23:03:03.800841338Z [2024-05-10T23:03:03.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status success for try_number 1 2024-05-10T23:03:03.811884490Z [2024-05-10T23:03:03.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:02:00+00:00, map_index=-1, run_start_date=2024-05-10 23:03:02.092915+00:00, run_end_date=2024-05-10 23:03:03.578496+00:00, run_duration=1.485581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:03:00.154824+00:00, queued_by_job_id=2, pid=2576 2024-05-10T23:03:05.697014128Z [2024-05-10T23:03:05.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:03:05.697829405Z [2024-05-10T23:03:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:02:00+00:00, run_id=scheduled__2024-05-10T23:02:00+00:00, run_start_date=2024-05-10 23:03:00.094738+00:00, run_end_date=2024-05-10 23:03:05.697409+00:00, run_duration=5.602671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:02:00+00:00, data_interval_end=2024-05-10 23:03:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:03:05.708864892Z [2024-05-10T23:03:05.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:03:00+00:00, run_after=2024-05-10T23:04:00+00:00 2024-05-10T23:03:06.877958421Z [2024-05-10T23:03:06.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status success for try_number 1 2024-05-10T23:03:06.888607528Z [2024-05-10T23:03:06.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:02:00+00:00, map_index=-1, run_start_date=2024-05-10 23:03:02.141564+00:00, run_end_date=2024-05-10 23:03:05.653051+00:00, run_duration=3.511487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:03:00.154824+00:00, queued_by_job_id=2, pid=2577 2024-05-10T23:04:00.312615339Z [2024-05-10T23:04:00.311+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:04:00.330064860Z [2024-05-10T23:04:00.321+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:04:00.341187911Z [2024-05-10T23:04:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:04:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:04:00.370374657Z [2024-05-10T23:04:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:04:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:04:00.488260694Z [2024-05-10T23:04:00.487+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:04:00.488294129Z 2024-05-10T23:04:00.488308176Z 2024-05-10T23:04:00.488315867Z 2024-05-10T23:04:00.488323642Z 2024-05-10T23:04:00.488444718Z [2024-05-10T23:04:00.488+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:04:00.488474812Z [2024-05-10T23:04:00.488+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:04:00.488629209Z [2024-05-10T23:04:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:04:00.488736319Z [2024-05-10T23:04:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:04:00.489579485Z [2024-05-10T23:04:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:04:00.489594008Z 2024-05-10T23:04:00.489598299Z 2024-05-10T23:04:00.489601685Z 2024-05-10T23:04:00.489608768Z 2024-05-10T23:04:00.494925287Z [2024-05-10T23:04:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:04:00.495073411Z [2024-05-10T23:04:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:04:00.495425102Z [2024-05-10T23:04:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:04:00.495551222Z [2024-05-10T23:04:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:04:00.495820833Z [2024-05-10T23:04:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:04:00.495972908Z [2024-05-10T23:04:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:04:00.496489255Z [2024-05-10T23:04:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:04:00.496676950Z [2024-05-10T23:04:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:04:00.969102968Z [2024-05-10T23:04:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status queued for try_number 1 2024-05-10T23:04:00.969138294Z [2024-05-10T23:04:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:03:00+00:00 exited with status queued for try_number 1 2024-05-10T23:04:00.969188645Z [2024-05-10T23:04:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:03:00+00:00 exited with status queued for try_number 1 2024-05-10T23:04:00.969255645Z [2024-05-10T23:04:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:03:00+00:00 exited with status queued for try_number 1 2024-05-10T23:04:00.991073884Z [2024-05-10T23:04:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b91396c-abd5-4e8d-8aba-a4ae0fc425b4 2024-05-10T23:04:00.991129637Z [2024-05-10T23:04:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31666330-0c23-430a-b6fe-27138b21bddb 2024-05-10T23:04:00.991217250Z [2024-05-10T23:04:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c191060-a534-425f-b627-dc210968f40f 2024-05-10T23:04:00.991309900Z [2024-05-10T23:04:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7fe0c5d-d78d-4c76-a5f3-ba29b8dba340 2024-05-10T23:04:01.965402797Z [2024-05-10T23:04:01.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:04:01.965576356Z [2024-05-10T23:04:01.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:02:00+00:00, run_id=scheduled__2024-05-10T23:02:00+00:00, run_start_date=2024-05-10 23:04:00.382588+00:00, run_end_date=2024-05-10 23:04:01.965267+00:00, run_duration=1.582679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:02:00+00:00, data_interval_end=2024-05-10 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:04:01.973976106Z [2024-05-10T23:04:01.973+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:04:00+00:00, run_after=2024-05-10T23:06:00+00:00 2024-05-10T23:04:01.981476309Z [2024-05-10T23:04:01.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:04:01.981645012Z [2024-05-10T23:04:01.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:03:00+00:00, run_id=scheduled__2024-05-10T23:03:00+00:00, run_start_date=2024-05-10 23:04:00.383911+00:00, run_end_date=2024-05-10 23:04:01.981386+00:00, run_duration=1.597475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:03:00+00:00, data_interval_end=2024-05-10 23:04:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:04:01.991324207Z [2024-05-10T23:04:01.991+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:04:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:04:02.042708839Z [2024-05-10T23:04:02.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:02:00+00:00 exited with status success for try_number 1 2024-05-10T23:04:02.042928853Z [2024-05-10T23:04:02.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:03:00+00:00 exited with status success for try_number 1 2024-05-10T23:04:02.051907970Z [2024-05-10T23:04:02.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:03:00+00:00, map_index=-1, run_start_date=2024-05-10 23:04:01.468970+00:00, run_end_date=2024-05-10 23:04:01.835660+00:00, run_duration=0.36669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:04:00.491336+00:00, queued_by_job_id=2, pid=2612 2024-05-10T23:04:02.052446349Z [2024-05-10T23:04:02.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:02:00+00:00, map_index=-1, run_start_date=2024-05-10 23:04:01.414631+00:00, run_end_date=2024-05-10 23:04:01.811466+00:00, run_duration=0.396835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:04:00.491336+00:00, queued_by_job_id=2, pid=2611 2024-05-10T23:04:05.313360269Z [2024-05-10T23:04:05.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:04:05.313742517Z [2024-05-10T23:04:05.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:03:00+00:00, run_id=scheduled__2024-05-10T23:03:00+00:00, run_start_date=2024-05-10 23:04:00.384966+00:00, run_end_date=2024-05-10 23:04:05.313453+00:00, run_duration=4.928487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:03:00+00:00, data_interval_end=2024-05-10 23:04:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:04:05.321790025Z [2024-05-10T23:04:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:04:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:04:05.327987994Z [2024-05-10T23:04:05.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:04:05.328382725Z [2024-05-10T23:04:05.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:03:00+00:00, run_id=scheduled__2024-05-10T23:03:00+00:00, run_start_date=2024-05-10 23:04:00.386032+00:00, run_end_date=2024-05-10 23:04:05.328111+00:00, run_duration=4.942079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:03:00+00:00, data_interval_end=2024-05-10 23:04:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:04:05.336948820Z [2024-05-10T23:04:05.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:04:00+00:00, run_after=2024-05-10T23:05:00+00:00 2024-05-10T23:04:05.376216702Z [2024-05-10T23:04:05.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:03:00+00:00 exited with status success for try_number 1 2024-05-10T23:04:05.376669293Z [2024-05-10T23:04:05.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:03:00+00:00 exited with status success for try_number 1 2024-05-10T23:04:05.387645780Z [2024-05-10T23:04:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:03:00+00:00, map_index=-1, run_start_date=2024-05-10 23:04:02.853330+00:00, run_end_date=2024-05-10 23:04:04.134087+00:00, run_duration=1.280757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:04:00.491336+00:00, queued_by_job_id=2, pid=2636 2024-05-10T23:04:05.388328989Z [2024-05-10T23:04:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:03:00+00:00, map_index=-1, run_start_date=2024-05-10 23:04:02.652863+00:00, run_end_date=2024-05-10 23:04:04.227283+00:00, run_duration=1.57442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:04:00.491336+00:00, queued_by_job_id=2, pid=2630 2024-05-10T23:05:00.557541717Z [2024-05-10T23:05:00.556+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:05:00.573288840Z [2024-05-10T23:05:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:06:00+00:00 2024-05-10T23:05:00.587828630Z [2024-05-10T23:05:00.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:05:00.603544565Z [2024-05-10T23:05:00.603+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:06:00+00:00 2024-05-10T23:05:00.696211362Z [2024-05-10T23:05:00.695+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:05:00.696257700Z 2024-05-10T23:05:00.696276417Z 2024-05-10T23:05:00.696285478Z 2024-05-10T23:05:00.696294294Z 2024-05-10T23:05:00.696341407Z [2024-05-10T23:05:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:05:00.696734722Z [2024-05-10T23:05:00.696+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:05:00.697072858Z [2024-05-10T23:05:00.696+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:05:00.697385052Z [2024-05-10T23:05:00.697+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:05:00.698245113Z [2024-05-10T23:05:00.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:05:00.698261431Z 2024-05-10T23:05:00.698278009Z 2024-05-10T23:05:00.698282868Z 2024-05-10T23:05:00.698287682Z 2024-05-10T23:05:00.703826917Z [2024-05-10T23:05:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:05:00.704323248Z [2024-05-10T23:05:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:05:00.704492366Z [2024-05-10T23:05:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:05:00.704722116Z [2024-05-10T23:05:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:05:00.705196835Z [2024-05-10T23:05:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:05:00.705513953Z [2024-05-10T23:05:00.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:05:00.706007336Z [2024-05-10T23:05:00.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:05:00.706319491Z [2024-05-10T23:05:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:05:01.248982404Z [2024-05-10T23:05:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:01.249017724Z [2024-05-10T23:05:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:01.249062959Z [2024-05-10T23:05:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:01.249154496Z [2024-05-10T23:05:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:01.261753536Z [2024-05-10T23:05:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d48eefb-4323-4230-85bb-52ebac08a021 2024-05-10T23:05:01.261848163Z [2024-05-10T23:05:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72f9d956-2f70-43f3-bc97-4d5311f539b6 2024-05-10T23:05:01.261943496Z [2024-05-10T23:05:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a65f156-dc4d-44d6-82c9-a2bf64e34feb 2024-05-10T23:05:01.262059069Z [2024-05-10T23:05:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b975353-0175-4b10-b8ff-9b477f4e0d78 2024-05-10T23:05:02.471254928Z [2024-05-10T23:05:02.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:05:02.471581611Z [2024-05-10T23:05:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:04:00+00:00, run_id=scheduled__2024-05-10T23:04:00+00:00, run_start_date=2024-05-10 23:05:00.617989+00:00, run_end_date=2024-05-10 23:05:02.471190+00:00, run_duration=1.853201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:04:00+00:00, data_interval_end=2024-05-10 23:05:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:05:02.492071195Z [2024-05-10T23:05:02.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:06:00+00:00 2024-05-10T23:05:02.574374154Z [2024-05-10T23:05:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:02.587549178Z [2024-05-10T23:05:02.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:04:00+00:00, map_index=-1, run_start_date=2024-05-10 23:05:01.790665+00:00, run_end_date=2024-05-10 23:05:02.222699+00:00, run_duration=0.432034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:00.699347+00:00, queued_by_job_id=2, pid=2669 2024-05-10T23:05:03.740375405Z [2024-05-10T23:05:03.737+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:05:03.740397192Z 2024-05-10T23:05:03.741111077Z [2024-05-10T23:05:03.740+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:05:03.742016289Z [2024-05-10T23:05:03.741+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:05:03.742029672Z 2024-05-10T23:05:03.745070797Z [2024-05-10T23:05:03.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:05:03.745297807Z [2024-05-10T23:05:03.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:05:03.803695729Z [2024-05-10T23:05:03.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:03.820712646Z [2024-05-10T23:05:03.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23c37d84-aa65-449d-a825-562ecabcade6 2024-05-10T23:05:03.934827678Z [2024-05-10T23:05:03.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:03.942675152Z [2024-05-10T23:05:03.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:05:03.139339+00:00, run_end_date=2024-05-10 23:05:03.617063+00:00, run_duration=0.477724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:00.699347+00:00, queued_by_job_id=2, pid=2695 2024-05-10T23:05:04.995490717Z [2024-05-10T23:05:04.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:05:04.995876089Z [2024-05-10T23:05:04.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:04:00+00:00, run_id=scheduled__2024-05-10T23:04:00+00:00, run_start_date=2024-05-10 23:05:00.619335+00:00, run_end_date=2024-05-10 23:05:04.995406+00:00, run_duration=4.376071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:04:00+00:00, data_interval_end=2024-05-10 23:05:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:05:05.007678866Z [2024-05-10T23:05:05.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:06:00+00:00 2024-05-10T23:05:05.053610544Z [2024-05-10T23:05:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:05.058828200Z [2024-05-10T23:05:05.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:04:00+00:00, map_index=-1, run_start_date=2024-05-10 23:05:03.007750+00:00, run_end_date=2024-05-10 23:05:04.394169+00:00, run_duration=1.386419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:00.699347+00:00, queued_by_job_id=2, pid=2694 2024-05-10T23:05:06.143021448Z [2024-05-10T23:05:06.142+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:05:06.143061412Z 2024-05-10T23:05:06.143071970Z [2024-05-10T23:05:06.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:05:06.143582653Z [2024-05-10T23:05:06.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:05:06.143593259Z 2024-05-10T23:05:06.145620620Z [2024-05-10T23:05:06.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:05:06.145705311Z [2024-05-10T23:05:06.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:05:06.193671076Z [2024-05-10T23:05:06.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:06.194070985Z [2024-05-10T23:05:06.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:06.204425409Z [2024-05-10T23:05:06.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa691ecf-5b5a-4586-a864-79f286698a39 2024-05-10T23:05:06.204798803Z [2024-05-10T23:05:06.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:05:05.478818+00:00, run_end_date=2024-05-10 23:05:05.875135+00:00, run_duration=0.396317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:03.742546+00:00, queued_by_job_id=2, pid=2728 2024-05-10T23:05:06.268775293Z [2024-05-10T23:05:06.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:05:06.269310205Z [2024-05-10T23:05:06.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:04:00+00:00, run_id=scheduled__2024-05-10T23:04:00+00:00, run_start_date=2024-05-10 23:05:00.620458+00:00, run_end_date=2024-05-10 23:05:06.268674+00:00, run_duration=5.648216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:04:00+00:00, data_interval_end=2024-05-10 23:05:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:05:06.285338418Z [2024-05-10T23:05:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:06:00+00:00 2024-05-10T23:05:06.331155671Z [2024-05-10T23:05:06.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:06.336831645Z [2024-05-10T23:05:06.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:04:00+00:00, map_index=-1, run_start_date=2024-05-10 23:05:02.917823+00:00, run_end_date=2024-05-10 23:05:06.135511+00:00, run_duration=3.217688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:00.699347+00:00, queued_by_job_id=2, pid=2688 2024-05-10T23:05:08.808962268Z [2024-05-10T23:05:08.808+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:05:08.809003587Z 2024-05-10T23:05:08.809011428Z [2024-05-10T23:05:08.808+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:05:08.809504963Z [2024-05-10T23:05:08.809+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:05:08.809519522Z 2024-05-10T23:05:08.812009578Z [2024-05-10T23:05:08.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:05:08.812039324Z [2024-05-10T23:05:08.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:05:08.859225652Z [2024-05-10T23:05:08.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status queued for try_number 1 2024-05-10T23:05:08.859737700Z [2024-05-10T23:05:08.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:08.867346280Z [2024-05-10T23:05:08.867+0000] {scheduler_job.py:635} INFO - Setting external_id for to 571d2a28-51c3-4ad3-bc0b-43e7e369a037 2024-05-10T23:05:08.867637521Z [2024-05-10T23:05:08.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=0, run_start_date=2024-05-10 23:05:07.922677+00:00, run_end_date=2024-05-10 23:05:08.270074+00:00, run_duration=0.347397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:06.143861+00:00, queued_by_job_id=2, pid=2739 2024-05-10T23:05:11.074430656Z [2024-05-10T23:05:11.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:05:11.074484053Z [2024-05-10T23:05:11.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:00:00+00:00, run_id=scheduled__2024-05-10T23:00:00+00:00, run_start_date=2024-05-10 23:05:00.616779+00:00, run_end_date=2024-05-10 23:05:11.073284+00:00, run_duration=10.456505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:00:00+00:00, data_interval_end=2024-05-10 23:05:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:05:11.080126900Z [2024-05-10T23:05:11.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:05:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:05:11.126667593Z [2024-05-10T23:05:11.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:00:00+00:00 exited with status success for try_number 1 2024-05-10T23:05:11.134447661Z [2024-05-10T23:05:11.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:00:00+00:00, map_index=-1, run_start_date=2024-05-10 23:05:10.418864+00:00, run_end_date=2024-05-10 23:05:10.790566+00:00, run_duration=0.371702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:05:08.809902+00:00, queued_by_job_id=2, pid=2747 2024-05-10T23:05:33.526251479Z [2024-05-10T23:05:33.525+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:06:00.833992510Z [2024-05-10T23:06:00.833+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:06:00.856178536Z [2024-05-10T23:06:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:06:00+00:00, run_after=2024-05-10T23:07:00+00:00 2024-05-10T23:06:00.873388367Z [2024-05-10T23:06:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:06:00+00:00, run_after=2024-05-10T23:07:00+00:00 2024-05-10T23:06:00.882271622Z [2024-05-10T23:06:00.881+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:06:00.995987973Z [2024-05-10T23:06:00.995+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:06:00.996013759Z 2024-05-10T23:06:00.996018318Z 2024-05-10T23:06:00.996021724Z 2024-05-10T23:06:00.996024874Z 2024-05-10T23:06:00.996686633Z [2024-05-10T23:06:00.996+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:06:00.996953635Z [2024-05-10T23:06:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:06:00.997182334Z [2024-05-10T23:06:00.997+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:06:00.997468463Z [2024-05-10T23:06:00.997+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:06:00.998396431Z [2024-05-10T23:06:00.998+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:06:00.998408772Z 2024-05-10T23:06:00.998412280Z 2024-05-10T23:06:00.998415373Z 2024-05-10T23:06:00.998418426Z 2024-05-10T23:06:01.004316559Z [2024-05-10T23:06:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:06:01.004898618Z [2024-05-10T23:06:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:06:01.005595908Z [2024-05-10T23:06:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:06:01.006155634Z [2024-05-10T23:06:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:06:01.007277638Z [2024-05-10T23:06:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:06:01.007749382Z [2024-05-10T23:06:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:06:01.008936014Z [2024-05-10T23:06:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:06:01.009366292Z [2024-05-10T23:06:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:06:01.596127604Z [2024-05-10T23:06:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status queued for try_number 1 2024-05-10T23:06:01.596357203Z [2024-05-10T23:06:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:06:01.596551384Z [2024-05-10T23:06:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:06:01.596713423Z [2024-05-10T23:06:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:06:01.608863587Z [2024-05-10T23:06:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to e669d698-5634-4669-a502-8cc14d4ee02b 2024-05-10T23:06:01.608888645Z [2024-05-10T23:06:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4ec2f8a-cfed-4041-8540-1c5ee48c55cb 2024-05-10T23:06:01.608892545Z [2024-05-10T23:06:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddb4ff5d-6360-48ec-8648-200d151fa302 2024-05-10T23:06:01.609037218Z [2024-05-10T23:06:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4798f16c-0066-48ef-87dc-81c33bbc58ea 2024-05-10T23:06:02.792688618Z [2024-05-10T23:06:02.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:06:02.793048780Z [2024-05-10T23:06:02.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:04:00+00:00, run_id=scheduled__2024-05-10T23:04:00+00:00, run_start_date=2024-05-10 23:06:00.895399+00:00, run_end_date=2024-05-10 23:06:02.792602+00:00, run_duration=1.897203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:04:00+00:00, data_interval_end=2024-05-10 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:06:02.803538870Z [2024-05-10T23:06:02.803+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:06:00+00:00, run_after=2024-05-10T23:08:00+00:00 2024-05-10T23:06:02.812597333Z [2024-05-10T23:06:02.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:06:02.812629401Z [2024-05-10T23:06:02.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:05:00+00:00, run_id=scheduled__2024-05-10T23:05:00+00:00, run_start_date=2024-05-10 23:06:00.896729+00:00, run_end_date=2024-05-10 23:06:02.812338+00:00, run_duration=1.915609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:05:00+00:00, data_interval_end=2024-05-10 23:06:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:06:02.825329368Z [2024-05-10T23:06:02.824+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:06:00+00:00, run_after=2024-05-10T23:07:00+00:00 2024-05-10T23:06:03.054604063Z [2024-05-10T23:06:03.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:04:00+00:00 exited with status success for try_number 1 2024-05-10T23:06:03.054644481Z [2024-05-10T23:06:03.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:06:03.067387559Z [2024-05-10T23:06:03.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:04:00+00:00, map_index=-1, run_start_date=2024-05-10 23:06:02.151500+00:00, run_end_date=2024-05-10 23:06:02.698990+00:00, run_duration=0.54749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:06:00.999410+00:00, queued_by_job_id=2, pid=2757 2024-05-10T23:06:03.067579107Z [2024-05-10T23:06:03.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=-1, run_start_date=2024-05-10 23:06:02.302653+00:00, run_end_date=2024-05-10 23:06:02.794723+00:00, run_duration=0.49207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:06:00.999410+00:00, queued_by_job_id=2, pid=2758 2024-05-10T23:06:05.757662083Z [2024-05-10T23:06:05.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:06:05.757882787Z [2024-05-10T23:06:05.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:05:00+00:00, run_id=scheduled__2024-05-10T23:05:00+00:00, run_start_date=2024-05-10 23:06:00.899052+00:00, run_end_date=2024-05-10 23:06:05.757520+00:00, run_duration=4.858468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:05:00+00:00, data_interval_end=2024-05-10 23:06:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:06:05.768335741Z [2024-05-10T23:06:05.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:06:00+00:00, run_after=2024-05-10T23:07:00+00:00 2024-05-10T23:06:05.774940721Z [2024-05-10T23:06:05.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:06:05.775049408Z [2024-05-10T23:06:05.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:05:00+00:00, run_id=scheduled__2024-05-10T23:05:00+00:00, run_start_date=2024-05-10 23:06:00.897842+00:00, run_end_date=2024-05-10 23:06:05.774823+00:00, run_duration=4.876981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:05:00+00:00, data_interval_end=2024-05-10 23:06:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:06:05.784578201Z [2024-05-10T23:06:05.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:06:00+00:00, run_after=2024-05-10T23:07:00+00:00 2024-05-10T23:06:05.837514860Z [2024-05-10T23:06:05.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:06:05.837763337Z [2024-05-10T23:06:05.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:06:05.845396245Z [2024-05-10T23:06:05.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=-1, run_start_date=2024-05-10 23:06:03.660215+00:00, run_end_date=2024-05-10 23:06:05.282571+00:00, run_duration=1.622356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:06:00.999410+00:00, queued_by_job_id=2, pid=2784 2024-05-10T23:06:05.845775100Z [2024-05-10T23:06:05.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=-1, run_start_date=2024-05-10 23:06:03.346236+00:00, run_end_date=2024-05-10 23:06:04.644243+00:00, run_duration=1.298007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:06:00.999410+00:00, queued_by_job_id=2, pid=2776 2024-05-10T23:07:00.529797416Z [2024-05-10T23:07:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:07:00+00:00, run_after=2024-05-10T23:08:00+00:00 2024-05-10T23:07:00.540730877Z [2024-05-10T23:07:00.540+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:07:00.554744123Z [2024-05-10T23:07:00.554+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:07:00+00:00, run_after=2024-05-10T23:08:00+00:00 2024-05-10T23:07:00.627477110Z [2024-05-10T23:07:00.627+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:07:00.627506515Z 2024-05-10T23:07:00.627511857Z 2024-05-10T23:07:00.627516675Z 2024-05-10T23:07:00.627529403Z [2024-05-10T23:07:00.627+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:07:00.627592989Z [2024-05-10T23:07:00.627+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:07:00.627681398Z [2024-05-10T23:07:00.627+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:07:00.628517376Z [2024-05-10T23:07:00.628+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:07:00.628550014Z 2024-05-10T23:07:00.628556662Z 2024-05-10T23:07:00.628562204Z 2024-05-10T23:07:00.632146382Z [2024-05-10T23:07:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:07:00.632237844Z [2024-05-10T23:07:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:07:00.632544380Z [2024-05-10T23:07:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:07:00.632756621Z [2024-05-10T23:07:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:07:00.632930312Z [2024-05-10T23:07:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:07:00.632999352Z [2024-05-10T23:07:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:07:00.905821373Z [2024-05-10T23:07:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status queued for try_number 1 2024-05-10T23:07:00.906093452Z [2024-05-10T23:07:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status queued for try_number 1 2024-05-10T23:07:00.906696867Z [2024-05-10T23:07:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status queued for try_number 1 2024-05-10T23:07:00.914720242Z [2024-05-10T23:07:00.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c4e9e11-25d2-4af7-a950-54c0174eee0a 2024-05-10T23:07:00.914998811Z [2024-05-10T23:07:00.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 637ea296-53fb-4c86-a4be-1d3992089c10 2024-05-10T23:07:00.915208075Z [2024-05-10T23:07:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3974ea0c-137f-4f78-9aa6-5c1ee18db57b 2024-05-10T23:07:02.231414141Z [2024-05-10T23:07:02.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:07:02.231818616Z [2024-05-10T23:07:02.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:06:00+00:00, run_id=scheduled__2024-05-10T23:06:00+00:00, run_start_date=2024-05-10 23:07:00.568935+00:00, run_end_date=2024-05-10 23:07:02.231399+00:00, run_duration=1.662464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:06:00+00:00, data_interval_end=2024-05-10 23:07:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:07:02.242730445Z [2024-05-10T23:07:02.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:07:00+00:00, run_after=2024-05-10T23:08:00+00:00 2024-05-10T23:07:02.296989161Z [2024-05-10T23:07:02.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status success for try_number 1 2024-05-10T23:07:02.303556360Z [2024-05-10T23:07:02.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:06:00+00:00, map_index=-1, run_start_date=2024-05-10 23:07:01.590980+00:00, run_end_date=2024-05-10 23:07:02.061261+00:00, run_duration=0.470281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:07:00.629314+00:00, queued_by_job_id=2, pid=2814 2024-05-10T23:07:05.614174592Z [2024-05-10T23:07:05.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:07:05.615196114Z [2024-05-10T23:07:05.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:06:00+00:00, run_id=scheduled__2024-05-10T23:06:00+00:00, run_start_date=2024-05-10 23:07:00.571583+00:00, run_end_date=2024-05-10 23:07:05.614088+00:00, run_duration=5.042505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:06:00+00:00, data_interval_end=2024-05-10 23:07:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:07:05.624603625Z [2024-05-10T23:07:05.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:07:00+00:00, run_after=2024-05-10T23:08:00+00:00 2024-05-10T23:07:05.631683745Z [2024-05-10T23:07:05.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:07:05.632221148Z [2024-05-10T23:07:05.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:06:00+00:00, run_id=scheduled__2024-05-10T23:06:00+00:00, run_start_date=2024-05-10 23:07:00.570470+00:00, run_end_date=2024-05-10 23:07:05.631608+00:00, run_duration=5.061138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:06:00+00:00, data_interval_end=2024-05-10 23:07:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:07:05.643356057Z [2024-05-10T23:07:05.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:07:00+00:00, run_after=2024-05-10T23:08:00+00:00 2024-05-10T23:07:05.680014180Z [2024-05-10T23:07:05.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status success for try_number 1 2024-05-10T23:07:05.680322157Z [2024-05-10T23:07:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status success for try_number 1 2024-05-10T23:07:05.688573095Z [2024-05-10T23:07:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:06:00+00:00, map_index=-1, run_start_date=2024-05-10 23:07:02.680515+00:00, run_end_date=2024-05-10 23:07:04.488112+00:00, run_duration=1.807597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:07:00.629314+00:00, queued_by_job_id=2, pid=2833 2024-05-10T23:07:05.688963141Z [2024-05-10T23:07:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:06:00+00:00, map_index=-1, run_start_date=2024-05-10 23:07:02.656739+00:00, run_end_date=2024-05-10 23:07:04.994544+00:00, run_duration=2.337805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:07:00.629314+00:00, queued_by_job_id=2, pid=2832 2024-05-10T23:08:00.305306706Z [2024-05-10T23:08:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:08:00+00:00, run_after=2024-05-10T23:09:00+00:00 2024-05-10T23:08:00.327315068Z [2024-05-10T23:08:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:08:00+00:00, run_after=2024-05-10T23:09:00+00:00 2024-05-10T23:08:00.341709805Z [2024-05-10T23:08:00.337+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:08:00.354028920Z [2024-05-10T23:08:00.353+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:08:00.473431017Z [2024-05-10T23:08:00.472+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:08:00.473450137Z 2024-05-10T23:08:00.473455187Z 2024-05-10T23:08:00.473458537Z 2024-05-10T23:08:00.473474375Z 2024-05-10T23:08:00.473764080Z [2024-05-10T23:08:00.473+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:08:00.474221588Z [2024-05-10T23:08:00.473+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:08:00.474477598Z [2024-05-10T23:08:00.474+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:08:00.474893986Z [2024-05-10T23:08:00.474+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:08:00.475730171Z [2024-05-10T23:08:00.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:08:00.475743506Z 2024-05-10T23:08:00.475747808Z 2024-05-10T23:08:00.475751472Z 2024-05-10T23:08:00.475755292Z 2024-05-10T23:08:00.480445857Z [2024-05-10T23:08:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:08:00.480727529Z [2024-05-10T23:08:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:08:00.481017999Z [2024-05-10T23:08:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:08:00.481172882Z [2024-05-10T23:08:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:08:00.481404991Z [2024-05-10T23:08:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:08:00.481567232Z [2024-05-10T23:08:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:08:00.481851359Z [2024-05-10T23:08:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:08:00.481990908Z [2024-05-10T23:08:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:08:00.820559675Z [2024-05-10T23:08:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status queued for try_number 1 2024-05-10T23:08:00.822866684Z [2024-05-10T23:08:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:07:00+00:00 exited with status queued for try_number 1 2024-05-10T23:08:00.823049800Z [2024-05-10T23:08:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:07:00+00:00 exited with status queued for try_number 1 2024-05-10T23:08:00.823442722Z [2024-05-10T23:08:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:07:00+00:00 exited with status queued for try_number 1 2024-05-10T23:08:00.833051379Z [2024-05-10T23:08:00.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b570d62-952c-44f0-a909-1bd4e80d19d9 2024-05-10T23:08:00.833198813Z [2024-05-10T23:08:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 048ccae8-cbae-4509-8691-48e1361797f1 2024-05-10T23:08:00.833360720Z [2024-05-10T23:08:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95129280-272c-47c7-aa0e-27e5521cdd12 2024-05-10T23:08:00.833508836Z [2024-05-10T23:08:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74a3b575-574c-4a79-8fe0-0ea60cd62029 2024-05-10T23:08:03.255850602Z [2024-05-10T23:08:03.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:08:03.256188791Z [2024-05-10T23:08:03.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:07:00+00:00, run_id=scheduled__2024-05-10T23:07:00+00:00, run_start_date=2024-05-10 23:08:00.381203+00:00, run_end_date=2024-05-10 23:08:03.255767+00:00, run_duration=2.874564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:07:00+00:00, data_interval_end=2024-05-10 23:08:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:08:03.266559424Z [2024-05-10T23:08:03.266+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:08:00+00:00, run_after=2024-05-10T23:09:00+00:00 2024-05-10T23:08:03.274456165Z [2024-05-10T23:08:03.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:08:03.274747355Z [2024-05-10T23:08:03.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:06:00+00:00, run_id=scheduled__2024-05-10T23:06:00+00:00, run_start_date=2024-05-10 23:08:00.376870+00:00, run_end_date=2024-05-10 23:08:03.274379+00:00, run_duration=2.897509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:06:00+00:00, data_interval_end=2024-05-10 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:08:03.284012438Z [2024-05-10T23:08:03.283+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:08:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:08:03.345444259Z [2024-05-10T23:08:03.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:06:00+00:00 exited with status success for try_number 1 2024-05-10T23:08:03.347425665Z [2024-05-10T23:08:03.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:07:00+00:00 exited with status success for try_number 1 2024-05-10T23:08:03.358084639Z [2024-05-10T23:08:03.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:07:00+00:00, map_index=-1, run_start_date=2024-05-10 23:08:01.776868+00:00, run_end_date=2024-05-10 23:08:02.355407+00:00, run_duration=0.578539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:08:00.476927+00:00, queued_by_job_id=2, pid=2866 2024-05-10T23:08:03.358343975Z [2024-05-10T23:08:03.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:06:00+00:00, map_index=-1, run_start_date=2024-05-10 23:08:01.626807+00:00, run_end_date=2024-05-10 23:08:02.079978+00:00, run_duration=0.453171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:08:00.476927+00:00, queued_by_job_id=2, pid=2865 2024-05-10T23:08:04.995239552Z [2024-05-10T23:08:04.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:08:04.996091355Z [2024-05-10T23:08:04.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:07:00+00:00, run_id=scheduled__2024-05-10T23:07:00+00:00, run_start_date=2024-05-10 23:08:00.383430+00:00, run_end_date=2024-05-10 23:08:04.995178+00:00, run_duration=4.611748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:07:00+00:00, data_interval_end=2024-05-10 23:08:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:08:05.007480645Z [2024-05-10T23:08:05.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:08:00+00:00, run_after=2024-05-10T23:09:00+00:00 2024-05-10T23:08:05.014137865Z [2024-05-10T23:08:05.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:08:05.014401731Z [2024-05-10T23:08:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:07:00+00:00, run_id=scheduled__2024-05-10T23:07:00+00:00, run_start_date=2024-05-10 23:08:00.384954+00:00, run_end_date=2024-05-10 23:08:05.014019+00:00, run_duration=4.629065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:07:00+00:00, data_interval_end=2024-05-10 23:08:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:08:05.022683851Z [2024-05-10T23:08:05.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:08:00+00:00, run_after=2024-05-10T23:09:00+00:00 2024-05-10T23:08:05.050665948Z [2024-05-10T23:08:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:07:00+00:00 exited with status success for try_number 1 2024-05-10T23:08:05.055698325Z [2024-05-10T23:08:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:07:00+00:00, map_index=-1, run_start_date=2024-05-10 23:08:03.324430+00:00, run_end_date=2024-05-10 23:08:04.603232+00:00, run_duration=1.278802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:08:00.476927+00:00, queued_by_job_id=2, pid=2890 2024-05-10T23:08:05.931653149Z [2024-05-10T23:08:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:07:00+00:00 exited with status success for try_number 1 2024-05-10T23:08:05.940528870Z [2024-05-10T23:08:05.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:07:00+00:00, map_index=-1, run_start_date=2024-05-10 23:08:03.077453+00:00, run_end_date=2024-05-10 23:08:04.923857+00:00, run_duration=1.846404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:08:00.476927+00:00, queued_by_job_id=2, pid=2884 2024-05-10T23:09:00.562066260Z [2024-05-10T23:09:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:09:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:09:00.572852138Z [2024-05-10T23:09:00.572+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:09:00.583984339Z [2024-05-10T23:09:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:09:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:09:00.645162355Z [2024-05-10T23:09:00.644+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:09:00.645205035Z 2024-05-10T23:09:00.645213572Z 2024-05-10T23:09:00.645222107Z 2024-05-10T23:09:00.646113161Z [2024-05-10T23:09:00.645+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:09:00.646760241Z [2024-05-10T23:09:00.646+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:09:00.647202468Z [2024-05-10T23:09:00.646+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:09:00.648301025Z [2024-05-10T23:09:00.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:09:00.648336017Z 2024-05-10T23:09:00.648345073Z 2024-05-10T23:09:00.648353567Z 2024-05-10T23:09:00.654357236Z [2024-05-10T23:09:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:09:00.655092584Z [2024-05-10T23:09:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:09:00.656140136Z [2024-05-10T23:09:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:09:00.656609954Z [2024-05-10T23:09:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:09:00.657485915Z [2024-05-10T23:09:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:09:00.657971019Z [2024-05-10T23:09:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:09:00.856807739Z [2024-05-10T23:09:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status queued for try_number 1 2024-05-10T23:09:00.857193987Z [2024-05-10T23:09:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status queued for try_number 1 2024-05-10T23:09:00.857389616Z [2024-05-10T23:09:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status queued for try_number 1 2024-05-10T23:09:00.869220280Z [2024-05-10T23:09:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8bbc129-d184-48e5-928f-5122f40ca721 2024-05-10T23:09:00.869703915Z [2024-05-10T23:09:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be40cc9-75e7-4965-a2c8-2208d928e1c2 2024-05-10T23:09:00.870109182Z [2024-05-10T23:09:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d464569-6810-4291-9faa-997585cf6032 2024-05-10T23:09:02.906997098Z [2024-05-10T23:09:02.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:09:02.907524571Z [2024-05-10T23:09:02.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:08:00+00:00, run_id=scheduled__2024-05-10T23:08:00+00:00, run_start_date=2024-05-10 23:09:00.594513+00:00, run_end_date=2024-05-10 23:09:02.907103+00:00, run_duration=2.31259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:08:00+00:00, data_interval_end=2024-05-10 23:09:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:09:02.919227502Z [2024-05-10T23:09:02.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:09:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:09:02.989634879Z [2024-05-10T23:09:02.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status success for try_number 1 2024-05-10T23:09:02.998044049Z [2024-05-10T23:09:02.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:08:00+00:00, map_index=-1, run_start_date=2024-05-10 23:09:01.501762+00:00, run_end_date=2024-05-10 23:09:01.880577+00:00, run_duration=0.378815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:09:00.649580+00:00, queued_by_job_id=2, pid=2922 2024-05-10T23:09:04.078631143Z [2024-05-10T23:09:04.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:09:04.078818620Z [2024-05-10T23:09:04.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:08:00+00:00, run_id=scheduled__2024-05-10T23:08:00+00:00, run_start_date=2024-05-10 23:09:00.595660+00:00, run_end_date=2024-05-10 23:09:04.078580+00:00, run_duration=3.48292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:08:00+00:00, data_interval_end=2024-05-10 23:09:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:09:04.090840714Z [2024-05-10T23:09:04.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:09:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:09:04.135839763Z [2024-05-10T23:09:04.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status success for try_number 1 2024-05-10T23:09:04.146428093Z [2024-05-10T23:09:04.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:08:00+00:00, map_index=-1, run_start_date=2024-05-10 23:09:02.515960+00:00, run_end_date=2024-05-10 23:09:03.769388+00:00, run_duration=1.253428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:09:00.649580+00:00, queued_by_job_id=2, pid=2941 2024-05-10T23:09:04.370830372Z [2024-05-10T23:09:04.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:09:04.370964076Z [2024-05-10T23:09:04.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:08:00+00:00, run_id=scheduled__2024-05-10T23:08:00+00:00, run_start_date=2024-05-10 23:09:00.596692+00:00, run_end_date=2024-05-10 23:09:04.370549+00:00, run_duration=3.773857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:08:00+00:00, data_interval_end=2024-05-10 23:09:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:09:04.379142479Z [2024-05-10T23:09:04.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:09:00+00:00, run_after=2024-05-10T23:10:00+00:00 2024-05-10T23:09:04.419381806Z [2024-05-10T23:09:04.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status success for try_number 1 2024-05-10T23:09:04.427155336Z [2024-05-10T23:09:04.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:08:00+00:00, map_index=-1, run_start_date=2024-05-10 23:09:02.501783+00:00, run_end_date=2024-05-10 23:09:04.225947+00:00, run_duration=1.724164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:09:00.649580+00:00, queued_by_job_id=2, pid=2940 2024-05-10T23:10:00.786686169Z [2024-05-10T23:10:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:11:00+00:00 2024-05-10T23:10:00.804852978Z [2024-05-10T23:10:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:11:00+00:00 2024-05-10T23:10:00.811916204Z [2024-05-10T23:10:00.811+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:10:00.818156364Z [2024-05-10T23:10:00.817+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:10:00.828400705Z [2024-05-10T23:10:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:10:00.942344792Z [2024-05-10T23:10:00.941+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T23:10:00.942388397Z 2024-05-10T23:10:00.942398332Z 2024-05-10T23:10:00.942408306Z 2024-05-10T23:10:00.942416553Z 2024-05-10T23:10:00.942425394Z 2024-05-10T23:10:00.942663642Z [2024-05-10T23:10:00.942+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:10:00.942993453Z [2024-05-10T23:10:00.942+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:10:00.943310435Z [2024-05-10T23:10:00.942+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:10:00.943695495Z [2024-05-10T23:10:00.943+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:10:00.944016679Z [2024-05-10T23:10:00.943+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:10:00.946582587Z [2024-05-10T23:10:00.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:10:00.946634855Z 2024-05-10T23:10:00.946646255Z 2024-05-10T23:10:00.946656193Z 2024-05-10T23:10:00.946664923Z 2024-05-10T23:10:00.946673486Z 2024-05-10T23:10:00.960731087Z [2024-05-10T23:10:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:10:00.961040917Z [2024-05-10T23:10:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:10:00.961416620Z [2024-05-10T23:10:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:10:00.961696827Z [2024-05-10T23:10:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:10:00.962052680Z [2024-05-10T23:10:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:10:00.962280689Z [2024-05-10T23:10:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:10:00.962616117Z [2024-05-10T23:10:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:10:00.962833604Z [2024-05-10T23:10:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:10:00.963224835Z [2024-05-10T23:10:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:10:00.963478294Z [2024-05-10T23:10:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:10:01.671147286Z [2024-05-10T23:10:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:01.671221625Z [2024-05-10T23:10:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:01.671231668Z [2024-05-10T23:10:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:09:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:01.671312203Z [2024-05-10T23:10:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:09:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:01.671347161Z [2024-05-10T23:10:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:09:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:01.691684612Z [2024-05-10T23:10:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 024bd804-4240-4a5f-b00e-89416f01c61c 2024-05-10T23:10:01.691770332Z [2024-05-10T23:10:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd8717ac-6b17-4225-861d-ffc2ec05d237 2024-05-10T23:10:01.691841607Z [2024-05-10T23:10:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 339516c9-02e9-4eaf-a834-250f89627640 2024-05-10T23:10:01.691933190Z [2024-05-10T23:10:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to d69248c0-1562-442c-948d-7baef77f1028 2024-05-10T23:10:01.692021043Z [2024-05-10T23:10:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a24d685-d6e8-4639-882e-7aac97d9a0b7 2024-05-10T23:10:02.770576460Z [2024-05-10T23:10:02.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:10:02.770922508Z [2024-05-10T23:10:02.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:09:00+00:00, run_id=scheduled__2024-05-10T23:09:00+00:00, run_start_date=2024-05-10 23:10:00.840780+00:00, run_end_date=2024-05-10 23:10:02.770447+00:00, run_duration=1.929667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:09:00+00:00, data_interval_end=2024-05-10 23:10:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:10:02.780681300Z [2024-05-10T23:10:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:11:00+00:00 2024-05-10T23:10:02.837346990Z [2024-05-10T23:10:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:08:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:02.837379047Z [2024-05-10T23:10:02.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:09:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:02.843995401Z [2024-05-10T23:10:02.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:09:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:02.004330+00:00, run_end_date=2024-05-10 23:10:02.434028+00:00, run_duration=0.429698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:00.952774+00:00, queued_by_job_id=2, pid=2975 2024-05-10T23:10:02.844160525Z [2024-05-10T23:10:02.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:08:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:02.260743+00:00, run_end_date=2024-05-10 23:10:02.665989+00:00, run_duration=0.405246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:00.952774+00:00, queued_by_job_id=2, pid=2976 2024-05-10T23:10:03.892125502Z [2024-05-10T23:10:03.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:10:03.892275624Z [2024-05-10T23:10:03.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:08:00+00:00, run_id=scheduled__2024-05-10T23:08:00+00:00, run_start_date=2024-05-10 23:10:00.839790+00:00, run_end_date=2024-05-10 23:10:03.892014+00:00, run_duration=3.052224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:08:00+00:00, data_interval_end=2024-05-10 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:10:03.900191547Z [2024-05-10T23:10:03.899+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:12:00+00:00 2024-05-10T23:10:03.937179550Z [2024-05-10T23:10:03.935+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:10:03.937199275Z 2024-05-10T23:10:03.937203708Z [2024-05-10T23:10:03.936+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:10:03.937207851Z [2024-05-10T23:10:03.936+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:10:03.937210956Z 2024-05-10T23:10:03.940410231Z [2024-05-10T23:10:03.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:10:03.940427512Z [2024-05-10T23:10:03.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:10:03.985634105Z [2024-05-10T23:10:03.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:03.985662974Z [2024-05-10T23:10:03.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:03.990591534Z [2024-05-10T23:10:03.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67315727-8d51-4ea4-ad84-41d1d490caf6 2024-05-10T23:10:03.990734327Z [2024-05-10T23:10:03.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:03.295034+00:00, run_end_date=2024-05-10 23:10:03.806404+00:00, run_duration=0.51137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:00.952774+00:00, queued_by_job_id=2, pid=3005 2024-05-10T23:10:05.959797650Z [2024-05-10T23:10:05.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:10:05.960234036Z [2024-05-10T23:10:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:09:00+00:00, run_id=scheduled__2024-05-10T23:09:00+00:00, run_start_date=2024-05-10 23:10:00.841706+00:00, run_end_date=2024-05-10 23:10:05.959657+00:00, run_duration=5.117951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:09:00+00:00, data_interval_end=2024-05-10 23:10:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:10:05.969630167Z [2024-05-10T23:10:05.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:11:00+00:00 2024-05-10T23:10:05.976178427Z [2024-05-10T23:10:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:10:05.976747123Z [2024-05-10T23:10:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:09:00+00:00, run_id=scheduled__2024-05-10T23:09:00+00:00, run_start_date=2024-05-10 23:10:00.842665+00:00, run_end_date=2024-05-10 23:10:05.976094+00:00, run_duration=5.133429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:09:00+00:00, data_interval_end=2024-05-10 23:10:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:10:05.996270042Z [2024-05-10T23:10:05.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:11:00+00:00 2024-05-10T23:10:06.079224322Z [2024-05-10T23:10:06.078+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:10:06.079267547Z 2024-05-10T23:10:06.079414587Z [2024-05-10T23:10:06.079+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:10:06.080201417Z [2024-05-10T23:10:06.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:10:06.080209651Z 2024-05-10T23:10:06.086144209Z [2024-05-10T23:10:06.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:10:06.086201790Z [2024-05-10T23:10:06.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:10:06.151128633Z [2024-05-10T23:10:06.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:06.151174682Z [2024-05-10T23:10:06.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:09:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:06.151181476Z [2024-05-10T23:10:06.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:09:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:06.159272376Z [2024-05-10T23:10:06.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:09:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:03.294754+00:00, run_end_date=2024-05-10 23:10:05.023704+00:00, run_duration=1.72895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:00.952774+00:00, queued_by_job_id=2, pid=3006 2024-05-10T23:10:06.159382525Z [2024-05-10T23:10:06.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:09:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:03.387422+00:00, run_end_date=2024-05-10 23:10:05.706325+00:00, run_duration=2.318903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:00.952774+00:00, queued_by_job_id=2, pid=3007 2024-05-10T23:10:06.159544911Z [2024-05-10T23:10:06.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2341a413-8ced-4bbb-a579-340a86f20fa4 2024-05-10T23:10:06.228234355Z [2024-05-10T23:10:06.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:06.232509559Z [2024-05-10T23:10:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:05.576492+00:00, run_end_date=2024-05-10 23:10:05.962631+00:00, run_duration=0.386139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:03.936999+00:00, queued_by_job_id=2, pid=3039 2024-05-10T23:10:09.035311769Z [2024-05-10T23:10:09.034+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:10:09.035352089Z 2024-05-10T23:10:09.035359809Z [2024-05-10T23:10:09.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:10:09.035910351Z [2024-05-10T23:10:09.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:10:09.035935728Z 2024-05-10T23:10:09.038622933Z [2024-05-10T23:10:09.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:10:09.038870045Z [2024-05-10T23:10:09.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:10:09.097541307Z [2024-05-10T23:10:09.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status queued for try_number 1 2024-05-10T23:10:09.099230468Z [2024-05-10T23:10:09.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:09.111874569Z [2024-05-10T23:10:09.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac1f901b-ebf6-422e-b4a2-c683f2415789 2024-05-10T23:10:09.112498111Z [2024-05-10T23:10:09.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=0, run_start_date=2024-05-10 23:10:07.658459+00:00, run_end_date=2024-05-10 23:10:08.050448+00:00, run_duration=0.391989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:06.080731+00:00, queued_by_job_id=2, pid=3050 2024-05-10T23:10:11.406064211Z [2024-05-10T23:10:11.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:10:11.406655341Z [2024-05-10T23:10:11.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:05:00+00:00, run_id=scheduled__2024-05-10T23:05:00+00:00, run_start_date=2024-05-10 23:10:00.838591+00:00, run_end_date=2024-05-10 23:10:11.405842+00:00, run_duration=10.567251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:05:00+00:00, data_interval_end=2024-05-10 23:10:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:10:11.420299899Z [2024-05-10T23:10:11.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:10:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:10:11.461684233Z [2024-05-10T23:10:11.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:05:00+00:00 exited with status success for try_number 1 2024-05-10T23:10:11.470108155Z [2024-05-10T23:10:11.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:05:00+00:00, map_index=-1, run_start_date=2024-05-10 23:10:10.670259+00:00, run_end_date=2024-05-10 23:10:11.011548+00:00, run_duration=0.341289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:10:09.036430+00:00, queued_by_job_id=2, pid=3058 2024-05-10T23:10:33.604734365Z [2024-05-10T23:10:33.604+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:11:01.091561459Z [2024-05-10T23:11:01.091+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:11:01.121054203Z [2024-05-10T23:11:01.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:11:00+00:00, run_after=2024-05-10T23:12:00+00:00 2024-05-10T23:11:01.139542296Z [2024-05-10T23:11:01.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:11:00+00:00, run_after=2024-05-10T23:12:00+00:00 2024-05-10T23:11:01.230336005Z [2024-05-10T23:11:01.229+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:11:01.230372734Z 2024-05-10T23:11:01.230378575Z 2024-05-10T23:11:01.230383574Z 2024-05-10T23:11:01.230460415Z [2024-05-10T23:11:01.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:11:01.230688528Z [2024-05-10T23:11:01.230+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:11:01.230856465Z [2024-05-10T23:11:01.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:11:01.231841088Z [2024-05-10T23:11:01.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:11:01.231869993Z 2024-05-10T23:11:01.231881158Z 2024-05-10T23:11:01.231890961Z 2024-05-10T23:11:01.237542342Z [2024-05-10T23:11:01.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:11:01.237583271Z [2024-05-10T23:11:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:11:01.237953346Z [2024-05-10T23:11:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:11:01.238139790Z [2024-05-10T23:11:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:11:01.238603035Z [2024-05-10T23:11:01.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:11:01.238760813Z [2024-05-10T23:11:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:11:01.485048795Z [2024-05-10T23:11:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:11:01.485239407Z [2024-05-10T23:11:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:11:01.485417390Z [2024-05-10T23:11:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:11:01.494191638Z [2024-05-10T23:11:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e640b64-d007-4f79-85a2-4e66f63a4383 2024-05-10T23:11:01.494456533Z [2024-05-10T23:11:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc428d62-f9c3-4dea-b9da-e31e7d582d22 2024-05-10T23:11:01.494684802Z [2024-05-10T23:11:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e1c127f-9591-4ef3-bbff-07b7affb2555 2024-05-10T23:11:02.671663399Z [2024-05-10T23:11:02.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:11:02.672046230Z [2024-05-10T23:11:02.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:10:00+00:00, run_id=scheduled__2024-05-10T23:10:00+00:00, run_start_date=2024-05-10 23:11:01.154163+00:00, run_end_date=2024-05-10 23:11:02.671564+00:00, run_duration=1.517401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:10:00+00:00, data_interval_end=2024-05-10 23:11:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:11:02.691379804Z [2024-05-10T23:11:02.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:11:00+00:00, run_after=2024-05-10T23:12:00+00:00 2024-05-10T23:11:02.730201965Z [2024-05-10T23:11:02.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:11:02.736340302Z [2024-05-10T23:11:02.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:11:02.076807+00:00, run_end_date=2024-05-10 23:11:02.466862+00:00, run_duration=0.390055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:11:01.232882+00:00, queued_by_job_id=2, pid=3067 2024-05-10T23:11:04.915436826Z [2024-05-10T23:11:04.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:11:04.915744307Z [2024-05-10T23:11:04.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:10:00+00:00, run_id=scheduled__2024-05-10T23:10:00+00:00, run_start_date=2024-05-10 23:11:01.156918+00:00, run_end_date=2024-05-10 23:11:04.915442+00:00, run_duration=3.758524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:10:00+00:00, data_interval_end=2024-05-10 23:11:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:11:04.924255502Z [2024-05-10T23:11:04.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:11:00+00:00, run_after=2024-05-10T23:12:00+00:00 2024-05-10T23:11:04.930591057Z [2024-05-10T23:11:04.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:11:04.930845410Z [2024-05-10T23:11:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:10:00+00:00, run_id=scheduled__2024-05-10T23:10:00+00:00, run_start_date=2024-05-10 23:11:01.155832+00:00, run_end_date=2024-05-10 23:11:04.930543+00:00, run_duration=3.774711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:10:00+00:00, data_interval_end=2024-05-10 23:11:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:11:04.939790564Z [2024-05-10T23:11:04.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:11:00+00:00, run_after=2024-05-10T23:12:00+00:00 2024-05-10T23:11:04.967175650Z [2024-05-10T23:11:04.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:11:04.969182960Z [2024-05-10T23:11:04.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:11:04.974575278Z [2024-05-10T23:11:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:11:03.049243+00:00, run_end_date=2024-05-10 23:11:04.780846+00:00, run_duration=1.731603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:11:01.232882+00:00, queued_by_job_id=2, pid=3086 2024-05-10T23:11:04.974864162Z [2024-05-10T23:11:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:11:03.024884+00:00, run_end_date=2024-05-10 23:11:04.261796+00:00, run_duration=1.236912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:11:01.232882+00:00, queued_by_job_id=2, pid=3085 2024-05-10T23:12:00.352883393Z [2024-05-10T23:12:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:12:00+00:00, run_after=2024-05-10T23:13:00+00:00 2024-05-10T23:12:00.363654897Z [2024-05-10T23:12:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:12:00.375158931Z [2024-05-10T23:12:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:12:00+00:00, run_after=2024-05-10T23:13:00+00:00 2024-05-10T23:12:00.382798827Z [2024-05-10T23:12:00.382+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:12:00.472571965Z [2024-05-10T23:12:00.471+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:12:00.472616974Z 2024-05-10T23:12:00.472638186Z 2024-05-10T23:12:00.472647954Z 2024-05-10T23:12:00.472656750Z 2024-05-10T23:12:00.473134432Z [2024-05-10T23:12:00.472+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:12:00.473595664Z [2024-05-10T23:12:00.473+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:12:00.474172624Z [2024-05-10T23:12:00.473+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:12:00.474637594Z [2024-05-10T23:12:00.474+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:12:00.476202467Z [2024-05-10T23:12:00.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:12:00.476221972Z 2024-05-10T23:12:00.476230974Z 2024-05-10T23:12:00.476239577Z 2024-05-10T23:12:00.476248184Z 2024-05-10T23:12:00.484055949Z [2024-05-10T23:12:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:12:00.484506730Z [2024-05-10T23:12:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:12:00.485032005Z [2024-05-10T23:12:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:12:00.485367701Z [2024-05-10T23:12:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:12:00.485901732Z [2024-05-10T23:12:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:12:00.486284558Z [2024-05-10T23:12:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:12:00.486796189Z [2024-05-10T23:12:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:12:00.487117455Z [2024-05-10T23:12:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:12:00.716058277Z [2024-05-10T23:12:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:12:00.716301957Z [2024-05-10T23:12:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:11:00+00:00 exited with status queued for try_number 1 2024-05-10T23:12:00.716663220Z [2024-05-10T23:12:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:11:00+00:00 exited with status queued for try_number 1 2024-05-10T23:12:00.717120163Z [2024-05-10T23:12:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:11:00+00:00 exited with status queued for try_number 1 2024-05-10T23:12:00.725907290Z [2024-05-10T23:12:00.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e5fbaac-2c9b-4ea3-bedd-2fad8a9ceb58 2024-05-10T23:12:00.726367441Z [2024-05-10T23:12:00.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20e6f663-8ac8-4fe5-8ae9-c1571b625b6d 2024-05-10T23:12:00.726802515Z [2024-05-10T23:12:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53e69a5f-8a58-4c26-b1d2-8f3492b00b09 2024-05-10T23:12:00.727163800Z [2024-05-10T23:12:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 033d3f9d-69b4-4d0c-959e-6abb472080eb 2024-05-10T23:12:01.897703348Z [2024-05-10T23:12:01.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:12:01.898270816Z [2024-05-10T23:12:01.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:10:00+00:00, run_id=scheduled__2024-05-10T23:10:00+00:00, run_start_date=2024-05-10 23:12:00.392683+00:00, run_end_date=2024-05-10 23:12:01.897845+00:00, run_duration=1.505162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:10:00+00:00, data_interval_end=2024-05-10 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:12:01.906353667Z [2024-05-10T23:12:01.906+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:12:00+00:00, run_after=2024-05-10T23:14:00+00:00 2024-05-10T23:12:03.069477492Z [2024-05-10T23:12:03.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:12:03.069816352Z [2024-05-10T23:12:03.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:11:00+00:00, run_id=scheduled__2024-05-10T23:11:00+00:00, run_start_date=2024-05-10 23:12:00.393972+00:00, run_end_date=2024-05-10 23:12:03.069325+00:00, run_duration=2.675353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:11:00+00:00, data_interval_end=2024-05-10 23:12:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:12:03.079257083Z [2024-05-10T23:12:03.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:12:00+00:00, run_after=2024-05-10T23:13:00+00:00 2024-05-10T23:12:03.146013931Z [2024-05-10T23:12:03.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:12:03.149230333Z [2024-05-10T23:12:03.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:11:00+00:00 exited with status success for try_number 1 2024-05-10T23:12:03.165572399Z [2024-05-10T23:12:03.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:12:01.415993+00:00, run_end_date=2024-05-10 23:12:01.850205+00:00, run_duration=0.434212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:12:00.478746+00:00, queued_by_job_id=2, pid=3119 2024-05-10T23:12:03.166797256Z [2024-05-10T23:12:03.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:11:00+00:00, map_index=-1, run_start_date=2024-05-10 23:12:01.603977+00:00, run_end_date=2024-05-10 23:12:02.074866+00:00, run_duration=0.470889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:12:00.478746+00:00, queued_by_job_id=2, pid=3120 2024-05-10T23:12:04.744162573Z [2024-05-10T23:12:04.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:12:04.744303024Z [2024-05-10T23:12:04.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:11:00+00:00, run_id=scheduled__2024-05-10T23:11:00+00:00, run_start_date=2024-05-10 23:12:00.395045+00:00, run_end_date=2024-05-10 23:12:04.743884+00:00, run_duration=4.348839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:11:00+00:00, data_interval_end=2024-05-10 23:12:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:12:04.754066629Z [2024-05-10T23:12:04.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:12:00+00:00, run_after=2024-05-10T23:13:00+00:00 2024-05-10T23:12:04.805223520Z [2024-05-10T23:12:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:11:00+00:00 exited with status success for try_number 1 2024-05-10T23:12:04.814409304Z [2024-05-10T23:12:04.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:11:00+00:00, map_index=-1, run_start_date=2024-05-10 23:12:02.546275+00:00, run_end_date=2024-05-10 23:12:04.248241+00:00, run_duration=1.701966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:12:00.478746+00:00, queued_by_job_id=2, pid=3143 2024-05-10T23:12:05.715893185Z [2024-05-10T23:12:05.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:12:05.716144507Z [2024-05-10T23:12:05.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:11:00+00:00, run_id=scheduled__2024-05-10T23:11:00+00:00, run_start_date=2024-05-10 23:12:00.396020+00:00, run_end_date=2024-05-10 23:12:05.715792+00:00, run_duration=5.319772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:11:00+00:00, data_interval_end=2024-05-10 23:12:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:12:05.725186897Z [2024-05-10T23:12:05.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:12:00+00:00, run_after=2024-05-10T23:13:00+00:00 2024-05-10T23:12:05.762183754Z [2024-05-10T23:12:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:11:00+00:00 exited with status success for try_number 1 2024-05-10T23:12:05.769817971Z [2024-05-10T23:12:05.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:11:00+00:00, map_index=-1, run_start_date=2024-05-10 23:12:02.560607+00:00, run_end_date=2024-05-10 23:12:05.250224+00:00, run_duration=2.689617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:12:00.478746+00:00, queued_by_job_id=2, pid=3144 2024-05-10T23:13:00.308007691Z [2024-05-10T23:13:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:13:00+00:00, run_after=2024-05-10T23:14:00+00:00 2024-05-10T23:13:00.326974841Z [2024-05-10T23:13:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:13:00+00:00, run_after=2024-05-10T23:14:00+00:00 2024-05-10T23:13:00.336943049Z [2024-05-10T23:13:00.336+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:13:00.409316116Z [2024-05-10T23:13:00.408+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:13:00.409354097Z 2024-05-10T23:13:00.409361601Z 2024-05-10T23:13:00.409368256Z 2024-05-10T23:13:00.409679937Z [2024-05-10T23:13:00.409+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:13:00.409952882Z [2024-05-10T23:13:00.409+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:13:00.410144359Z [2024-05-10T23:13:00.409+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:13:00.410703290Z [2024-05-10T23:13:00.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:13:00.410715189Z 2024-05-10T23:13:00.410722652Z 2024-05-10T23:13:00.410729676Z 2024-05-10T23:13:00.414163753Z [2024-05-10T23:13:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:13:00.414514264Z [2024-05-10T23:13:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:13:00.414920684Z [2024-05-10T23:13:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:13:00.415187117Z [2024-05-10T23:13:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:13:00.415586254Z [2024-05-10T23:13:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:13:00.415856840Z [2024-05-10T23:13:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:13:00.699716433Z [2024-05-10T23:13:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status queued for try_number 1 2024-05-10T23:13:00.699822659Z [2024-05-10T23:13:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status queued for try_number 1 2024-05-10T23:13:00.699924081Z [2024-05-10T23:13:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status queued for try_number 1 2024-05-10T23:13:00.708312373Z [2024-05-10T23:13:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 162b9658-954b-4165-ac20-e74d21d42eaf 2024-05-10T23:13:00.708388942Z [2024-05-10T23:13:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b0f0f93-9f90-41e6-b6a8-ba2c9249b11b 2024-05-10T23:13:00.708484251Z [2024-05-10T23:13:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ccaf595-0c31-4545-99b8-bab3b347bf45 2024-05-10T23:13:02.072021891Z [2024-05-10T23:13:02.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:13:02.073001422Z [2024-05-10T23:13:02.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:12:00+00:00, run_id=scheduled__2024-05-10T23:12:00+00:00, run_start_date=2024-05-10 23:13:00.354777+00:00, run_end_date=2024-05-10 23:13:02.071943+00:00, run_duration=1.717166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:12:00+00:00, data_interval_end=2024-05-10 23:13:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:13:02.081838655Z [2024-05-10T23:13:02.081+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:13:00+00:00, run_after=2024-05-10T23:14:00+00:00 2024-05-10T23:13:02.125630802Z [2024-05-10T23:13:02.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status success for try_number 1 2024-05-10T23:13:02.131179519Z [2024-05-10T23:13:02.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:12:00+00:00, map_index=-1, run_start_date=2024-05-10 23:13:01.303396+00:00, run_end_date=2024-05-10 23:13:01.670127+00:00, run_duration=0.366731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:13:00.411474+00:00, queued_by_job_id=2, pid=3176 2024-05-10T23:13:04.232348023Z [2024-05-10T23:13:04.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:13:04.232579496Z [2024-05-10T23:13:04.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:12:00+00:00, run_id=scheduled__2024-05-10T23:12:00+00:00, run_start_date=2024-05-10 23:13:00.357298+00:00, run_end_date=2024-05-10 23:13:04.231999+00:00, run_duration=3.874701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:12:00+00:00, data_interval_end=2024-05-10 23:13:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:13:04.256436922Z [2024-05-10T23:13:04.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:13:00+00:00, run_after=2024-05-10T23:14:00+00:00 2024-05-10T23:13:04.270352837Z [2024-05-10T23:13:04.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:13:04.271140465Z [2024-05-10T23:13:04.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:12:00+00:00, run_id=scheduled__2024-05-10T23:12:00+00:00, run_start_date=2024-05-10 23:13:00.356195+00:00, run_end_date=2024-05-10 23:13:04.270551+00:00, run_duration=3.914356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:12:00+00:00, data_interval_end=2024-05-10 23:13:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:13:04.284165184Z [2024-05-10T23:13:04.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:13:00+00:00, run_after=2024-05-10T23:14:00+00:00 2024-05-10T23:13:04.328606245Z [2024-05-10T23:13:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status success for try_number 1 2024-05-10T23:13:04.329067290Z [2024-05-10T23:13:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status success for try_number 1 2024-05-10T23:13:04.338273166Z [2024-05-10T23:13:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:12:00+00:00, map_index=-1, run_start_date=2024-05-10 23:13:02.245131+00:00, run_end_date=2024-05-10 23:13:03.833263+00:00, run_duration=1.588132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:13:00.411474+00:00, queued_by_job_id=2, pid=3194 2024-05-10T23:13:04.338790330Z [2024-05-10T23:13:04.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:12:00+00:00, map_index=-1, run_start_date=2024-05-10 23:13:02.242698+00:00, run_end_date=2024-05-10 23:13:03.506328+00:00, run_duration=1.26363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:13:00.411474+00:00, queued_by_job_id=2, pid=3195 2024-05-10T23:14:00.815070540Z [2024-05-10T23:14:00.814+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:14:00.841145631Z [2024-05-10T23:14:00.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:14:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:14:00.860676566Z [2024-05-10T23:14:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:14:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:14:00.869842526Z [2024-05-10T23:14:00.869+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:14:00.995000307Z [2024-05-10T23:14:00.993+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:14:00.995044802Z 2024-05-10T23:14:00.995055144Z 2024-05-10T23:14:00.995062804Z 2024-05-10T23:14:00.995070196Z 2024-05-10T23:14:00.995450331Z [2024-05-10T23:14:00.994+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:14:00.995952964Z [2024-05-10T23:14:00.995+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:14:00.996369440Z [2024-05-10T23:14:00.996+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:14:00.996751255Z [2024-05-10T23:14:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:14:00.998352127Z [2024-05-10T23:14:00.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:14:00.998384304Z 2024-05-10T23:14:00.998418835Z 2024-05-10T23:14:00.998426528Z 2024-05-10T23:14:00.998433532Z 2024-05-10T23:14:01.008689948Z [2024-05-10T23:14:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:14:01.009285043Z [2024-05-10T23:14:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:14:01.012195674Z [2024-05-10T23:14:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:14:01.012249357Z [2024-05-10T23:14:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:14:01.015030020Z [2024-05-10T23:14:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:14:01.015259117Z [2024-05-10T23:14:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:14:01.015746049Z [2024-05-10T23:14:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:14:01.016612319Z [2024-05-10T23:14:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:14:01.413657004Z [2024-05-10T23:14:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status queued for try_number 1 2024-05-10T23:14:01.414066915Z [2024-05-10T23:14:01.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:13:00+00:00 exited with status queued for try_number 1 2024-05-10T23:14:01.414324686Z [2024-05-10T23:14:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:13:00+00:00 exited with status queued for try_number 1 2024-05-10T23:14:01.414543285Z [2024-05-10T23:14:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:13:00+00:00 exited with status queued for try_number 1 2024-05-10T23:14:01.427849353Z [2024-05-10T23:14:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe42fe1-3b3d-4f62-bfec-23cb5800a404 2024-05-10T23:14:01.428035398Z [2024-05-10T23:14:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12c0d533-b112-4ec3-bf46-ffc63746d35a 2024-05-10T23:14:01.428275919Z [2024-05-10T23:14:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d252bf-b9b5-4619-a685-3cd6cf28fecf 2024-05-10T23:14:01.428553568Z [2024-05-10T23:14:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f84bb86-0008-4cae-a52d-aee7e4695f11 2024-05-10T23:14:02.915419595Z [2024-05-10T23:14:02.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:14:02.915898879Z [2024-05-10T23:14:02.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:12:00+00:00, run_id=scheduled__2024-05-10T23:12:00+00:00, run_start_date=2024-05-10 23:14:00.890677+00:00, run_end_date=2024-05-10 23:14:02.915540+00:00, run_duration=2.024863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:12:00+00:00, data_interval_end=2024-05-10 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:14:02.924490980Z [2024-05-10T23:14:02.924+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:14:00+00:00, run_after=2024-05-10T23:16:00+00:00 2024-05-10T23:14:02.962213364Z [2024-05-10T23:14:02.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:14:02.962682469Z [2024-05-10T23:14:02.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:13:00+00:00, run_id=scheduled__2024-05-10T23:13:00+00:00, run_start_date=2024-05-10 23:14:00.895223+00:00, run_end_date=2024-05-10 23:14:02.962293+00:00, run_duration=2.06707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:13:00+00:00, data_interval_end=2024-05-10 23:14:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:14:02.978672483Z [2024-05-10T23:14:02.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:14:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:14:03.020507399Z [2024-05-10T23:14:03.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:12:00+00:00 exited with status success for try_number 1 2024-05-10T23:14:03.020531288Z [2024-05-10T23:14:03.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:13:00+00:00 exited with status success for try_number 1 2024-05-10T23:14:03.026872380Z [2024-05-10T23:14:03.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:12:00+00:00, map_index=-1, run_start_date=2024-05-10 23:14:02.249809+00:00, run_end_date=2024-05-10 23:14:02.764040+00:00, run_duration=0.514231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:14:01.000399+00:00, queued_by_job_id=2, pid=3229 2024-05-10T23:14:03.026980062Z [2024-05-10T23:14:03.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:13:00+00:00, map_index=-1, run_start_date=2024-05-10 23:14:02.145733+00:00, run_end_date=2024-05-10 23:14:02.650931+00:00, run_duration=0.505198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:14:01.000399+00:00, queued_by_job_id=2, pid=3228 2024-05-10T23:14:05.155772591Z [2024-05-10T23:14:05.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:14:05.155797484Z [2024-05-10T23:14:05.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:13:00+00:00, run_id=scheduled__2024-05-10T23:13:00+00:00, run_start_date=2024-05-10 23:14:00.897383+00:00, run_end_date=2024-05-10 23:14:05.154452+00:00, run_duration=4.257069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:13:00+00:00, data_interval_end=2024-05-10 23:14:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:14:05.165053121Z [2024-05-10T23:14:05.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:14:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:14:05.207781907Z [2024-05-10T23:14:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:13:00+00:00 exited with status success for try_number 1 2024-05-10T23:14:05.213979277Z [2024-05-10T23:14:05.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:13:00+00:00, map_index=-1, run_start_date=2024-05-10 23:14:03.724733+00:00, run_end_date=2024-05-10 23:14:04.962002+00:00, run_duration=1.237269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:14:01.000399+00:00, queued_by_job_id=2, pid=3253 2024-05-10T23:14:06.306009409Z [2024-05-10T23:14:06.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:14:06.308963712Z [2024-05-10T23:14:06.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:13:00+00:00, run_id=scheduled__2024-05-10T23:13:00+00:00, run_start_date=2024-05-10 23:14:00.899368+00:00, run_end_date=2024-05-10 23:14:06.305470+00:00, run_duration=5.406102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:13:00+00:00, data_interval_end=2024-05-10 23:14:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:14:06.325988265Z [2024-05-10T23:14:06.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:14:00+00:00, run_after=2024-05-10T23:15:00+00:00 2024-05-10T23:14:06.381651865Z [2024-05-10T23:14:06.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:13:00+00:00 exited with status success for try_number 1 2024-05-10T23:14:06.392044049Z [2024-05-10T23:14:06.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:13:00+00:00, map_index=-1, run_start_date=2024-05-10 23:14:03.586156+00:00, run_end_date=2024-05-10 23:14:05.214848+00:00, run_duration=1.628692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:14:01.000399+00:00, queued_by_job_id=2, pid=3252 2024-05-10T23:15:00.978394007Z [2024-05-10T23:15:00.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:15:00.991870394Z [2024-05-10T23:15:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:16:00+00:00 2024-05-10T23:15:01.000572505Z [2024-05-10T23:15:01.000+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:15:01.025660848Z [2024-05-10T23:15:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:16:00+00:00 2024-05-10T23:15:01.144957247Z [2024-05-10T23:15:01.144+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:15:01.144987190Z 2024-05-10T23:15:01.144991350Z 2024-05-10T23:15:01.144995475Z 2024-05-10T23:15:01.144998720Z 2024-05-10T23:15:01.145133505Z [2024-05-10T23:15:01.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:15:01.145380153Z [2024-05-10T23:15:01.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:15:01.145607546Z [2024-05-10T23:15:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:15:01.145810718Z [2024-05-10T23:15:01.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:15:01.146498628Z [2024-05-10T23:15:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:15:01.146509849Z 2024-05-10T23:15:01.146513653Z 2024-05-10T23:15:01.146516958Z 2024-05-10T23:15:01.146520228Z 2024-05-10T23:15:01.150302729Z [2024-05-10T23:15:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:15:01.150513683Z [2024-05-10T23:15:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:15:01.150800544Z [2024-05-10T23:15:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:15:01.150957773Z [2024-05-10T23:15:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:15:01.151199359Z [2024-05-10T23:15:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:15:01.151352236Z [2024-05-10T23:15:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:15:01.151593801Z [2024-05-10T23:15:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:15:01.151735612Z [2024-05-10T23:15:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:15:01.661569406Z [2024-05-10T23:15:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:01.661600665Z [2024-05-10T23:15:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:01.661620443Z [2024-05-10T23:15:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:01.661700424Z [2024-05-10T23:15:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:01.669783039Z [2024-05-10T23:15:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 335a048a-b751-4c14-a185-7e8ddce7cba5 2024-05-10T23:15:01.669833443Z [2024-05-10T23:15:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to d211d181-e3bc-446e-ba17-78971669df6c 2024-05-10T23:15:01.670005903Z [2024-05-10T23:15:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 445c6ed5-571c-43ee-bd8b-b562afccf6d4 2024-05-10T23:15:01.670108775Z [2024-05-10T23:15:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d848480-d336-4e32-a8da-9e29761aab75 2024-05-10T23:15:02.861723335Z [2024-05-10T23:15:02.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:15:02.861978746Z [2024-05-10T23:15:02.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:14:00+00:00, run_id=scheduled__2024-05-10T23:14:00+00:00, run_start_date=2024-05-10 23:15:01.047905+00:00, run_end_date=2024-05-10 23:15:02.861610+00:00, run_duration=1.813705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:14:00+00:00, data_interval_end=2024-05-10 23:15:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:15:02.878621598Z [2024-05-10T23:15:02.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:16:00+00:00 2024-05-10T23:15:02.919733396Z [2024-05-10T23:15:02.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:02.927623130Z [2024-05-10T23:15:02.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:14:00+00:00, map_index=-1, run_start_date=2024-05-10 23:15:02.085147+00:00, run_end_date=2024-05-10 23:15:02.496588+00:00, run_duration=0.411441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:01.147422+00:00, queued_by_job_id=2, pid=3287 2024-05-10T23:15:04.077479146Z [2024-05-10T23:15:04.072+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:15:04.077501158Z 2024-05-10T23:15:04.077506410Z [2024-05-10T23:15:04.073+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:15:04.077511252Z [2024-05-10T23:15:04.073+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:15:04.077515441Z 2024-05-10T23:15:04.077520732Z [2024-05-10T23:15:04.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:15:04.077525583Z [2024-05-10T23:15:04.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:15:04.146762309Z [2024-05-10T23:15:04.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:04.146800149Z [2024-05-10T23:15:04.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:04.151559783Z [2024-05-10T23:15:04.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0466bb71-840b-49ac-adae-9970b68ef1e8 2024-05-10T23:15:04.151647566Z [2024-05-10T23:15:04.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:15:03.528112+00:00, run_end_date=2024-05-10 23:15:03.944859+00:00, run_duration=0.416747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:01.147422+00:00, queued_by_job_id=2, pid=3313 2024-05-10T23:15:05.340635873Z [2024-05-10T23:15:05.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:15:05.341380988Z [2024-05-10T23:15:05.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:14:00+00:00, run_id=scheduled__2024-05-10T23:14:00+00:00, run_start_date=2024-05-10 23:15:01.049611+00:00, run_end_date=2024-05-10 23:15:05.340896+00:00, run_duration=4.291285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:14:00+00:00, data_interval_end=2024-05-10 23:15:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:15:05.353050754Z [2024-05-10T23:15:05.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:16:00+00:00 2024-05-10T23:15:05.359689255Z [2024-05-10T23:15:05.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:15:05.360142169Z [2024-05-10T23:15:05.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:14:00+00:00, run_id=scheduled__2024-05-10T23:14:00+00:00, run_start_date=2024-05-10 23:15:01.051307+00:00, run_end_date=2024-05-10 23:15:05.359829+00:00, run_duration=4.308522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:14:00+00:00, data_interval_end=2024-05-10 23:15:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:15:05.368405290Z [2024-05-10T23:15:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:16:00+00:00 2024-05-10T23:15:05.436600028Z [2024-05-10T23:15:05.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:05.436884248Z [2024-05-10T23:15:05.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:05.442726536Z [2024-05-10T23:15:05.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:14:00+00:00, map_index=-1, run_start_date=2024-05-10 23:15:03.418585+00:00, run_end_date=2024-05-10 23:15:05.025833+00:00, run_duration=1.607248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:01.147422+00:00, queued_by_job_id=2, pid=3311 2024-05-10T23:15:05.443123973Z [2024-05-10T23:15:05.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:14:00+00:00, map_index=-1, run_start_date=2024-05-10 23:15:03.462092+00:00, run_end_date=2024-05-10 23:15:05.083005+00:00, run_duration=1.620913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:01.147422+00:00, queued_by_job_id=2, pid=3312 2024-05-10T23:15:06.531724394Z [2024-05-10T23:15:06.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:15:06.531787281Z 2024-05-10T23:15:06.531795054Z [2024-05-10T23:15:06.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:15:06.532295097Z [2024-05-10T23:15:06.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:15:06.532323353Z 2024-05-10T23:15:06.534596165Z [2024-05-10T23:15:06.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:15:06.534835148Z [2024-05-10T23:15:06.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:15:06.627091230Z [2024-05-10T23:15:06.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:06.629469525Z [2024-05-10T23:15:06.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:06.635176269Z [2024-05-10T23:15:06.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4624d747-9eee-49d3-94a7-e58b84c7f5eb 2024-05-10T23:15:06.635416055Z [2024-05-10T23:15:06.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:15:05.744814+00:00, run_end_date=2024-05-10 23:15:06.140425+00:00, run_duration=0.395611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:04.074434+00:00, queued_by_job_id=2, pid=3346 2024-05-10T23:15:11.361566052Z [2024-05-10T23:15:11.361+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:15:11.361601626Z 2024-05-10T23:15:11.361619651Z [2024-05-10T23:15:11.361+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:15:11.362120047Z [2024-05-10T23:15:11.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:15:11.362132780Z 2024-05-10T23:15:11.364126329Z [2024-05-10T23:15:11.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:15:11.364179765Z [2024-05-10T23:15:11.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:15:11.429206664Z [2024-05-10T23:15:11.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status queued for try_number 1 2024-05-10T23:15:11.429351929Z [2024-05-10T23:15:11.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:11.436496679Z [2024-05-10T23:15:11.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54d6d81b-0c13-46e6-867d-45a4f936e235 2024-05-10T23:15:11.436642238Z [2024-05-10T23:15:11.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=0, run_start_date=2024-05-10 23:15:08.260355+00:00, run_end_date=2024-05-10 23:15:10.261578+00:00, run_duration=2.001223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:06.532751+00:00, queued_by_job_id=2, pid=3357 2024-05-10T23:15:14.245035709Z [2024-05-10T23:15:14.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:15:14.245413425Z [2024-05-10T23:15:14.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:10:00+00:00, run_id=scheduled__2024-05-10T23:10:00+00:00, run_start_date=2024-05-10 23:15:01.045966+00:00, run_end_date=2024-05-10 23:15:14.244926+00:00, run_duration=13.19896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:10:00+00:00, data_interval_end=2024-05-10 23:15:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:15:14.251587664Z [2024-05-10T23:15:14.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:15:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:15:14.287649146Z [2024-05-10T23:15:14.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:10:00+00:00 exited with status success for try_number 1 2024-05-10T23:15:14.293506166Z [2024-05-10T23:15:14.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:10:00+00:00, map_index=-1, run_start_date=2024-05-10 23:15:13.131776+00:00, run_end_date=2024-05-10 23:15:13.482132+00:00, run_duration=0.350356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:15:11.362395+00:00, queued_by_job_id=2, pid=3370 2024-05-10T23:15:33.685589087Z [2024-05-10T23:15:33.684+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:16:00.960297416Z [2024-05-10T23:16:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:16:00.982057203Z [2024-05-10T23:16:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:16:00+00:00, run_after=2024-05-10T23:17:00+00:00 2024-05-10T23:16:00.997462875Z [2024-05-10T23:16:00.997+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:16:00+00:00, run_after=2024-05-10T23:17:00+00:00 2024-05-10T23:16:01.017714735Z [2024-05-10T23:16:01.017+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:16:01.113592363Z [2024-05-10T23:16:01.113+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:16:01.113639387Z 2024-05-10T23:16:01.113643974Z 2024-05-10T23:16:01.113646971Z 2024-05-10T23:16:01.113650136Z 2024-05-10T23:16:01.113660593Z [2024-05-10T23:16:01.113+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:16:01.113695019Z [2024-05-10T23:16:01.113+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:16:01.113792399Z [2024-05-10T23:16:01.113+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:16:01.113850680Z [2024-05-10T23:16:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:16:01.114436789Z [2024-05-10T23:16:01.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:16:01.114444535Z 2024-05-10T23:16:01.114448262Z 2024-05-10T23:16:01.114451748Z 2024-05-10T23:16:01.114455144Z 2024-05-10T23:16:01.117763261Z [2024-05-10T23:16:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:16:01.118115674Z [2024-05-10T23:16:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:16:01.118407922Z [2024-05-10T23:16:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:16:01.118548260Z [2024-05-10T23:16:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:16:01.118847565Z [2024-05-10T23:16:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:16:01.119018554Z [2024-05-10T23:16:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:16:01.119260728Z [2024-05-10T23:16:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:16:01.119464383Z [2024-05-10T23:16:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:16:01.697674428Z [2024-05-10T23:16:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status queued for try_number 1 2024-05-10T23:16:01.697702609Z [2024-05-10T23:16:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:16:01.702709701Z [2024-05-10T23:16:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:16:01.702882612Z [2024-05-10T23:16:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:16:01.722122971Z [2024-05-10T23:16:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a1c4181-ee82-484c-bd6b-9a69c6565d8d 2024-05-10T23:16:01.722306849Z [2024-05-10T23:16:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c243fd7-a386-4087-b101-e5a51d77aed4 2024-05-10T23:16:01.724622139Z [2024-05-10T23:16:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5253aaf-f5ef-47f0-b15d-5fc3533f717a 2024-05-10T23:16:01.724868439Z [2024-05-10T23:16:01.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to e32726c6-527c-4bb4-8bf8-834a4ef57bca 2024-05-10T23:16:03.115949198Z [2024-05-10T23:16:03.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:16:03.116429295Z [2024-05-10T23:16:03.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:15:00+00:00, run_id=scheduled__2024-05-10T23:15:00+00:00, run_start_date=2024-05-10 23:16:01.035511+00:00, run_end_date=2024-05-10 23:16:03.115833+00:00, run_duration=2.080322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:15:00+00:00, data_interval_end=2024-05-10 23:16:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:16:03.127167541Z [2024-05-10T23:16:03.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:16:00+00:00, run_after=2024-05-10T23:17:00+00:00 2024-05-10T23:16:03.136366515Z [2024-05-10T23:16:03.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:16:03.136696505Z [2024-05-10T23:16:03.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:14:00+00:00, run_id=scheduled__2024-05-10T23:14:00+00:00, run_start_date=2024-05-10 23:16:01.034069+00:00, run_end_date=2024-05-10 23:16:03.136284+00:00, run_duration=2.102215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:14:00+00:00, data_interval_end=2024-05-10 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:16:03.145699576Z [2024-05-10T23:16:03.145+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:16:00+00:00, run_after=2024-05-10T23:18:00+00:00 2024-05-10T23:16:03.219796197Z [2024-05-10T23:16:03.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:14:00+00:00 exited with status success for try_number 1 2024-05-10T23:16:03.219843947Z [2024-05-10T23:16:03.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:16:03.230758263Z [2024-05-10T23:16:03.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:14:00+00:00, map_index=-1, run_start_date=2024-05-10 23:16:02.151644+00:00, run_end_date=2024-05-10 23:16:02.572252+00:00, run_duration=0.420608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:16:01.115268+00:00, queued_by_job_id=2, pid=3381 2024-05-10T23:16:03.231116299Z [2024-05-10T23:16:03.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=-1, run_start_date=2024-05-10 23:16:01.967322+00:00, run_end_date=2024-05-10 23:16:02.494908+00:00, run_duration=0.527586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:16:01.115268+00:00, queued_by_job_id=2, pid=3380 2024-05-10T23:16:05.032334343Z [2024-05-10T23:16:05.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:16:05.032632544Z [2024-05-10T23:16:05.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:15:00+00:00, run_id=scheduled__2024-05-10T23:15:00+00:00, run_start_date=2024-05-10 23:16:01.037520+00:00, run_end_date=2024-05-10 23:16:05.032085+00:00, run_duration=3.994565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:15:00+00:00, data_interval_end=2024-05-10 23:16:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:16:05.041783929Z [2024-05-10T23:16:05.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:16:00+00:00, run_after=2024-05-10T23:17:00+00:00 2024-05-10T23:16:05.050144659Z [2024-05-10T23:16:05.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:16:05.050440256Z [2024-05-10T23:16:05.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:15:00+00:00, run_id=scheduled__2024-05-10T23:15:00+00:00, run_start_date=2024-05-10 23:16:01.036590+00:00, run_end_date=2024-05-10 23:16:05.050027+00:00, run_duration=4.013437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:15:00+00:00, data_interval_end=2024-05-10 23:16:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:16:05.064698946Z [2024-05-10T23:16:05.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:16:00+00:00, run_after=2024-05-10T23:17:00+00:00 2024-05-10T23:16:05.118364519Z [2024-05-10T23:16:05.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:16:05.123244218Z [2024-05-10T23:16:05.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=-1, run_start_date=2024-05-10 23:16:03.343398+00:00, run_end_date=2024-05-10 23:16:04.536986+00:00, run_duration=1.193588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:16:01.115268+00:00, queued_by_job_id=2, pid=3404 2024-05-10T23:16:06.193033629Z [2024-05-10T23:16:06.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:16:06.198129247Z [2024-05-10T23:16:06.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=-1, run_start_date=2024-05-10 23:16:03.401670+00:00, run_end_date=2024-05-10 23:16:04.945654+00:00, run_duration=1.543984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:16:01.115268+00:00, queued_by_job_id=2, pid=3405 2024-05-10T23:17:00.786330332Z [2024-05-10T23:17:00.785+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:17:00.799993632Z [2024-05-10T23:17:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:17:00+00:00, run_after=2024-05-10T23:18:00+00:00 2024-05-10T23:17:00.813418296Z [2024-05-10T23:17:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:17:00+00:00, run_after=2024-05-10T23:18:00+00:00 2024-05-10T23:17:00.873030953Z [2024-05-10T23:17:00.872+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:17:00.873071920Z 2024-05-10T23:17:00.873092182Z 2024-05-10T23:17:00.873095564Z 2024-05-10T23:17:00.873322092Z [2024-05-10T23:17:00.873+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:17:00.873611177Z [2024-05-10T23:17:00.873+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:17:00.873933238Z [2024-05-10T23:17:00.873+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:17:00.874728488Z [2024-05-10T23:17:00.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:17:00.874736340Z 2024-05-10T23:17:00.874739801Z 2024-05-10T23:17:00.874742743Z 2024-05-10T23:17:00.878487675Z [2024-05-10T23:17:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:17:00.878751099Z [2024-05-10T23:17:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:17:00.879032513Z [2024-05-10T23:17:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:17:00.879209011Z [2024-05-10T23:17:00.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:17:00.879464614Z [2024-05-10T23:17:00.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:17:00.879635203Z [2024-05-10T23:17:00.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:17:01.262808960Z [2024-05-10T23:17:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status queued for try_number 1 2024-05-10T23:17:01.263012105Z [2024-05-10T23:17:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status queued for try_number 1 2024-05-10T23:17:01.263118774Z [2024-05-10T23:17:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status queued for try_number 1 2024-05-10T23:17:01.273314447Z [2024-05-10T23:17:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to de959b7d-d234-4bca-a44a-a34c5589ae5a 2024-05-10T23:17:01.273517454Z [2024-05-10T23:17:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae6f6922-c193-481d-a8ce-8a9312405c3a 2024-05-10T23:17:01.273735373Z [2024-05-10T23:17:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6913b8b2-7686-47d4-95be-98b0491a13b7 2024-05-10T23:17:02.295970927Z [2024-05-10T23:17:02.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:17:02.297166189Z [2024-05-10T23:17:02.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:16:00+00:00, run_id=scheduled__2024-05-10T23:16:00+00:00, run_start_date=2024-05-10 23:17:00.823405+00:00, run_end_date=2024-05-10 23:17:02.296706+00:00, run_duration=1.473301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:16:00+00:00, data_interval_end=2024-05-10 23:17:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:17:02.317263590Z [2024-05-10T23:17:02.316+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:17:00+00:00, run_after=2024-05-10T23:18:00+00:00 2024-05-10T23:17:02.364006338Z [2024-05-10T23:17:02.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status success for try_number 1 2024-05-10T23:17:02.371429280Z [2024-05-10T23:17:02.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:16:00+00:00, map_index=-1, run_start_date=2024-05-10 23:17:01.730213+00:00, run_end_date=2024-05-10 23:17:02.141742+00:00, run_duration=0.411529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:17:00.875590+00:00, queued_by_job_id=2, pid=3436 2024-05-10T23:17:04.574248168Z [2024-05-10T23:17:04.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:17:04.574618880Z [2024-05-10T23:17:04.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:16:00+00:00, run_id=scheduled__2024-05-10T23:16:00+00:00, run_start_date=2024-05-10 23:17:00.825404+00:00, run_end_date=2024-05-10 23:17:04.574104+00:00, run_duration=3.7487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:16:00+00:00, data_interval_end=2024-05-10 23:17:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:17:04.584750261Z [2024-05-10T23:17:04.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:17:00+00:00, run_after=2024-05-10T23:18:00+00:00 2024-05-10T23:17:04.591841823Z [2024-05-10T23:17:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:17:04.592078548Z [2024-05-10T23:17:04.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:16:00+00:00, run_id=scheduled__2024-05-10T23:16:00+00:00, run_start_date=2024-05-10 23:17:00.824500+00:00, run_end_date=2024-05-10 23:17:04.591532+00:00, run_duration=3.767032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:16:00+00:00, data_interval_end=2024-05-10 23:17:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:17:04.602134134Z [2024-05-10T23:17:04.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:17:00+00:00, run_after=2024-05-10T23:18:00+00:00 2024-05-10T23:17:04.632396151Z [2024-05-10T23:17:04.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status success for try_number 1 2024-05-10T23:17:04.632561700Z [2024-05-10T23:17:04.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status success for try_number 1 2024-05-10T23:17:04.640057116Z [2024-05-10T23:17:04.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:16:00+00:00, map_index=-1, run_start_date=2024-05-10 23:17:02.740674+00:00, run_end_date=2024-05-10 23:17:04.315278+00:00, run_duration=1.574604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:17:00.875590+00:00, queued_by_job_id=2, pid=3454 2024-05-10T23:17:04.640362160Z [2024-05-10T23:17:04.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:16:00+00:00, map_index=-1, run_start_date=2024-05-10 23:17:02.772980+00:00, run_end_date=2024-05-10 23:17:04.034938+00:00, run_duration=1.261958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:17:00.875590+00:00, queued_by_job_id=2, pid=3455 2024-05-10T23:18:00.241148768Z [2024-05-10T23:18:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:18:00.250518898Z [2024-05-10T23:18:00.250+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:18:00.264561220Z [2024-05-10T23:18:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:18:00+00:00, run_after=2024-05-10T23:19:00+00:00 2024-05-10T23:18:00.279538945Z [2024-05-10T23:18:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:18:00+00:00, run_after=2024-05-10T23:19:00+00:00 2024-05-10T23:18:00.386315509Z [2024-05-10T23:18:00.385+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:18:00.386344577Z 2024-05-10T23:18:00.386350813Z 2024-05-10T23:18:00.386355200Z 2024-05-10T23:18:00.386371858Z 2024-05-10T23:18:00.386491451Z [2024-05-10T23:18:00.386+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:18:00.386679149Z [2024-05-10T23:18:00.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:18:00.386830063Z [2024-05-10T23:18:00.386+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:18:00.386978704Z [2024-05-10T23:18:00.386+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:18:00.387765388Z [2024-05-10T23:18:00.387+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:18:00.387776339Z 2024-05-10T23:18:00.387782249Z 2024-05-10T23:18:00.387786910Z 2024-05-10T23:18:00.387791342Z 2024-05-10T23:18:00.392175698Z [2024-05-10T23:18:00.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:18:00.392377131Z [2024-05-10T23:18:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:18:00.392634734Z [2024-05-10T23:18:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:18:00.392776958Z [2024-05-10T23:18:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:18:00.393035421Z [2024-05-10T23:18:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:18:00.393145850Z [2024-05-10T23:18:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:18:00.393386912Z [2024-05-10T23:18:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:18:00.393510779Z [2024-05-10T23:18:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:18:00.955675236Z [2024-05-10T23:18:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status queued for try_number 1 2024-05-10T23:18:00.955763128Z [2024-05-10T23:18:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:17:00+00:00 exited with status queued for try_number 1 2024-05-10T23:18:00.955886611Z [2024-05-10T23:18:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:17:00+00:00 exited with status queued for try_number 1 2024-05-10T23:18:00.955988889Z [2024-05-10T23:18:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:17:00+00:00 exited with status queued for try_number 1 2024-05-10T23:18:00.965644615Z [2024-05-10T23:18:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 232725aa-ea7a-4e76-9912-c57d53a90100 2024-05-10T23:18:00.965715230Z [2024-05-10T23:18:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9eee9e1-24e4-411f-9df3-18939107b541 2024-05-10T23:18:00.965901141Z [2024-05-10T23:18:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86fd8700-0ffe-4532-a85a-03ae40218141 2024-05-10T23:18:00.966061310Z [2024-05-10T23:18:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4dc3241-6c89-45bc-9285-a84d67bd4d07 2024-05-10T23:18:02.221223784Z [2024-05-10T23:18:02.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:18:02.221762183Z [2024-05-10T23:18:02.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:16:00+00:00, run_id=scheduled__2024-05-10T23:16:00+00:00, run_start_date=2024-05-10 23:18:00.292261+00:00, run_end_date=2024-05-10 23:18:02.221134+00:00, run_duration=1.928873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:16:00+00:00, data_interval_end=2024-05-10 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:18:02.229378094Z [2024-05-10T23:18:02.229+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:18:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:18:02.252957706Z [2024-05-10T23:18:02.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:18:02.254053619Z [2024-05-10T23:18:02.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:17:00+00:00, run_id=scheduled__2024-05-10T23:17:00+00:00, run_start_date=2024-05-10 23:18:00.293470+00:00, run_end_date=2024-05-10 23:18:02.252899+00:00, run_duration=1.959429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:17:00+00:00, data_interval_end=2024-05-10 23:18:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:18:02.269738040Z [2024-05-10T23:18:02.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:18:00+00:00, run_after=2024-05-10T23:19:00+00:00 2024-05-10T23:18:02.326786773Z [2024-05-10T23:18:02.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:16:00+00:00 exited with status success for try_number 1 2024-05-10T23:18:02.326819264Z [2024-05-10T23:18:02.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:17:00+00:00 exited with status success for try_number 1 2024-05-10T23:18:02.334956391Z [2024-05-10T23:18:02.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:17:00+00:00, map_index=-1, run_start_date=2024-05-10 23:18:01.323792+00:00, run_end_date=2024-05-10 23:18:01.702592+00:00, run_duration=0.3788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:18:00.389041+00:00, queued_by_job_id=2, pid=3489 2024-05-10T23:18:02.335032980Z [2024-05-10T23:18:02.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:16:00+00:00, map_index=-1, run_start_date=2024-05-10 23:18:01.329588+00:00, run_end_date=2024-05-10 23:18:01.761154+00:00, run_duration=0.431566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:18:00.389041+00:00, queued_by_job_id=2, pid=3490 2024-05-10T23:18:03.706119519Z [2024-05-10T23:18:03.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:18:03.706635294Z [2024-05-10T23:18:03.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:17:00+00:00, run_id=scheduled__2024-05-10T23:17:00+00:00, run_start_date=2024-05-10 23:18:00.294588+00:00, run_end_date=2024-05-10 23:18:03.706284+00:00, run_duration=3.411696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:17:00+00:00, data_interval_end=2024-05-10 23:18:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:18:03.716262141Z [2024-05-10T23:18:03.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:18:00+00:00, run_after=2024-05-10T23:19:00+00:00 2024-05-10T23:18:03.763362459Z [2024-05-10T23:18:03.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:17:00+00:00 exited with status success for try_number 1 2024-05-10T23:18:03.770813841Z [2024-05-10T23:18:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:17:00+00:00, map_index=-1, run_start_date=2024-05-10 23:18:02.334827+00:00, run_end_date=2024-05-10 23:18:03.583400+00:00, run_duration=1.248573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:18:00.389041+00:00, queued_by_job_id=2, pid=3513 2024-05-10T23:18:04.813193738Z [2024-05-10T23:18:04.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:18:04.813393328Z [2024-05-10T23:18:04.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:17:00+00:00, run_id=scheduled__2024-05-10T23:17:00+00:00, run_start_date=2024-05-10 23:18:00.295537+00:00, run_end_date=2024-05-10 23:18:04.813055+00:00, run_duration=4.517518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:17:00+00:00, data_interval_end=2024-05-10 23:18:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:18:04.822207060Z [2024-05-10T23:18:04.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:18:00+00:00, run_after=2024-05-10T23:19:00+00:00 2024-05-10T23:18:04.860087354Z [2024-05-10T23:18:04.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:17:00+00:00 exited with status success for try_number 1 2024-05-10T23:18:04.867567114Z [2024-05-10T23:18:04.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:17:00+00:00, map_index=-1, run_start_date=2024-05-10 23:18:02.445596+00:00, run_end_date=2024-05-10 23:18:03.967035+00:00, run_duration=1.521439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:18:00.389041+00:00, queued_by_job_id=2, pid=3514 2024-05-10T23:19:00.629386403Z [2024-05-10T23:19:00.628+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:19:00.650015847Z [2024-05-10T23:19:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:19:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:19:00.669007337Z [2024-05-10T23:19:00.668+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:19:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:19:00.755655881Z [2024-05-10T23:19:00.755+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:19:00.755700933Z 2024-05-10T23:19:00.755712048Z 2024-05-10T23:19:00.755721089Z 2024-05-10T23:19:00.756682087Z [2024-05-10T23:19:00.755+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:19:00.757267191Z [2024-05-10T23:19:00.756+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:19:00.757736522Z [2024-05-10T23:19:00.757+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:19:00.759468091Z [2024-05-10T23:19:00.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:19:00.759492495Z 2024-05-10T23:19:00.759501366Z 2024-05-10T23:19:00.759510087Z 2024-05-10T23:19:00.767245768Z [2024-05-10T23:19:00.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:19:00.767624054Z [2024-05-10T23:19:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:19:00.768453039Z [2024-05-10T23:19:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:19:00.768829773Z [2024-05-10T23:19:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:19:00.769444271Z [2024-05-10T23:19:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:19:00.769842734Z [2024-05-10T23:19:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:19:00.995889861Z [2024-05-10T23:19:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status queued for try_number 1 2024-05-10T23:19:00.998303648Z [2024-05-10T23:19:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status queued for try_number 1 2024-05-10T23:19:00.998631068Z [2024-05-10T23:19:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status queued for try_number 1 2024-05-10T23:19:01.015509257Z [2024-05-10T23:19:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4b94a1f-bb64-41b3-bbbe-e0ebe23b27d7 2024-05-10T23:19:01.017922576Z [2024-05-10T23:19:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5daacce1-add3-4254-8665-65ee3231967c 2024-05-10T23:19:01.026008392Z [2024-05-10T23:19:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60120e7a-60d9-42dc-a97b-814ee1c85e3a 2024-05-10T23:19:02.914889786Z [2024-05-10T23:19:02.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:19:02.917733030Z [2024-05-10T23:19:02.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:18:00+00:00, run_id=scheduled__2024-05-10T23:18:00+00:00, run_start_date=2024-05-10 23:19:00.681373+00:00, run_end_date=2024-05-10 23:19:02.914786+00:00, run_duration=2.233413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:18:00+00:00, data_interval_end=2024-05-10 23:19:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:19:02.935349388Z [2024-05-10T23:19:02.935+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:19:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:19:03.017084940Z [2024-05-10T23:19:03.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status success for try_number 1 2024-05-10T23:19:03.028306703Z [2024-05-10T23:19:03.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:18:00+00:00, map_index=-1, run_start_date=2024-05-10 23:19:01.722314+00:00, run_end_date=2024-05-10 23:19:02.103795+00:00, run_duration=0.381481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:19:00.761854+00:00, queued_by_job_id=2, pid=3545 2024-05-10T23:19:05.186079642Z [2024-05-10T23:19:05.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:19:05.186128612Z [2024-05-10T23:19:05.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:18:00+00:00, run_id=scheduled__2024-05-10T23:18:00+00:00, run_start_date=2024-05-10 23:19:00.682549+00:00, run_end_date=2024-05-10 23:19:05.185219+00:00, run_duration=4.50267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:18:00+00:00, data_interval_end=2024-05-10 23:19:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:19:05.199867739Z [2024-05-10T23:19:05.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:19:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:19:05.210734543Z [2024-05-10T23:19:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:19:05.210773847Z [2024-05-10T23:19:05.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:18:00+00:00, run_id=scheduled__2024-05-10T23:18:00+00:00, run_start_date=2024-05-10 23:19:00.683689+00:00, run_end_date=2024-05-10 23:19:05.210275+00:00, run_duration=4.526586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:18:00+00:00, data_interval_end=2024-05-10 23:19:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:19:05.222778778Z [2024-05-10T23:19:05.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:19:00+00:00, run_after=2024-05-10T23:20:00+00:00 2024-05-10T23:19:05.265798006Z [2024-05-10T23:19:05.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status success for try_number 1 2024-05-10T23:19:05.266130086Z [2024-05-10T23:19:05.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status success for try_number 1 2024-05-10T23:19:05.274974207Z [2024-05-10T23:19:05.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:18:00+00:00, map_index=-1, run_start_date=2024-05-10 23:19:02.723231+00:00, run_end_date=2024-05-10 23:19:04.066010+00:00, run_duration=1.342779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:19:00.761854+00:00, queued_by_job_id=2, pid=3563 2024-05-10T23:19:05.275153346Z [2024-05-10T23:19:05.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:18:00+00:00, map_index=-1, run_start_date=2024-05-10 23:19:02.859027+00:00, run_end_date=2024-05-10 23:19:04.615862+00:00, run_duration=1.756835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:19:00.761854+00:00, queued_by_job_id=2, pid=3564 2024-05-10T23:20:01.036638181Z [2024-05-10T23:20:01.036+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:20:01.050099476Z [2024-05-10T23:20:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:21:00+00:00 2024-05-10T23:20:01.062892423Z [2024-05-10T23:20:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:21:00+00:00 2024-05-10T23:20:01.078006889Z [2024-05-10T23:20:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:20:01.084833746Z [2024-05-10T23:20:01.084+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:20:01.208339978Z [2024-05-10T23:20:01.207+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T23:20:01.208368007Z 2024-05-10T23:20:01.208371757Z 2024-05-10T23:20:01.208375496Z 2024-05-10T23:20:01.208378952Z 2024-05-10T23:20:01.208382142Z 2024-05-10T23:20:01.208391157Z [2024-05-10T23:20:01.208+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:20:01.208465765Z [2024-05-10T23:20:01.208+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:20:01.208546552Z [2024-05-10T23:20:01.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:20:01.208626818Z [2024-05-10T23:20:01.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:20:01.208705336Z [2024-05-10T23:20:01.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:20:01.209300521Z [2024-05-10T23:20:01.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:20:01.209305231Z 2024-05-10T23:20:01.209309027Z 2024-05-10T23:20:01.209312301Z 2024-05-10T23:20:01.209315433Z 2024-05-10T23:20:01.209333387Z 2024-05-10T23:20:01.213299394Z [2024-05-10T23:20:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:20:01.213315854Z [2024-05-10T23:20:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:20:01.213511820Z [2024-05-10T23:20:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:20:01.213581547Z [2024-05-10T23:20:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:20:01.213746745Z [2024-05-10T23:20:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:20:01.213798696Z [2024-05-10T23:20:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:20:01.214053036Z [2024-05-10T23:20:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:20:01.214106919Z [2024-05-10T23:20:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:20:01.214289741Z [2024-05-10T23:20:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:20:01.214337010Z [2024-05-10T23:20:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:20:01.771068962Z [2024-05-10T23:20:01.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:01.771291805Z [2024-05-10T23:20:01.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:01.771474647Z [2024-05-10T23:20:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:19:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:01.771825578Z [2024-05-10T23:20:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:19:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:01.771987409Z [2024-05-10T23:20:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:19:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:01.784957748Z [2024-05-10T23:20:01.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97b05561-2e3a-41fa-af2f-3f333d74107e 2024-05-10T23:20:01.785507910Z [2024-05-10T23:20:01.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8fbcbfd-3a2a-4e1b-88b5-4e64f7ca7d45 2024-05-10T23:20:01.786128963Z [2024-05-10T23:20:01.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11b3b579-f10c-42f0-bf33-58a66d91307b 2024-05-10T23:20:01.786344096Z [2024-05-10T23:20:01.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42cf24c7-d0a5-41a7-8ef8-1043b9618260 2024-05-10T23:20:01.786566645Z [2024-05-10T23:20:01.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 571b606d-80c1-4824-8e35-df10fe431ae9 2024-05-10T23:20:03.279273579Z [2024-05-10T23:20:03.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:20:03.279530700Z [2024-05-10T23:20:03.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:19:00+00:00, run_id=scheduled__2024-05-10T23:19:00+00:00, run_start_date=2024-05-10 23:20:01.103131+00:00, run_end_date=2024-05-10 23:20:03.279205+00:00, run_duration=2.176074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:19:00+00:00, data_interval_end=2024-05-10 23:20:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:20:03.303075577Z [2024-05-10T23:20:03.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:21:00+00:00 2024-05-10T23:20:03.327392682Z [2024-05-10T23:20:03.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:20:03.327550195Z [2024-05-10T23:20:03.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:18:00+00:00, run_id=scheduled__2024-05-10T23:18:00+00:00, run_start_date=2024-05-10 23:20:01.101843+00:00, run_end_date=2024-05-10 23:20:03.327306+00:00, run_duration=2.225463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:18:00+00:00, data_interval_end=2024-05-10 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:20:03.338738171Z [2024-05-10T23:20:03.338+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:22:00+00:00 2024-05-10T23:20:03.416369964Z [2024-05-10T23:20:03.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:18:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:03.416920668Z [2024-05-10T23:20:03.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:19:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:03.432615780Z [2024-05-10T23:20:03.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:18:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:02.296357+00:00, run_end_date=2024-05-10 23:20:02.776646+00:00, run_duration=0.480289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:01.210355+00:00, queued_by_job_id=2, pid=3597 2024-05-10T23:20:03.433385121Z [2024-05-10T23:20:03.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:19:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:02.628898+00:00, run_end_date=2024-05-10 23:20:03.059356+00:00, run_duration=0.430458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:01.210355+00:00, queued_by_job_id=2, pid=3601 2024-05-10T23:20:04.527810220Z [2024-05-10T23:20:04.527+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:20:04.527876418Z 2024-05-10T23:20:04.527887344Z [2024-05-10T23:20:04.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:20:04.528442076Z [2024-05-10T23:20:04.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:20:04.528467333Z 2024-05-10T23:20:04.530911300Z [2024-05-10T23:20:04.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:20:04.530940179Z [2024-05-10T23:20:04.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:20:04.598570390Z [2024-05-10T23:20:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:04.599444760Z [2024-05-10T23:20:04.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:04.607883239Z [2024-05-10T23:20:04.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93839413-2374-4745-a4cb-f28deeb9e187 2024-05-10T23:20:04.608502828Z [2024-05-10T23:20:04.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:03.214459+00:00, run_end_date=2024-05-10 23:20:03.597812+00:00, run_duration=0.383353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:01.210355+00:00, queued_by_job_id=2, pid=3623 2024-05-10T23:20:05.955693945Z [2024-05-10T23:20:05.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:20:05.956396350Z [2024-05-10T23:20:05.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:19:00+00:00, run_id=scheduled__2024-05-10T23:19:00+00:00, run_start_date=2024-05-10 23:20:01.105536+00:00, run_end_date=2024-05-10 23:20:05.955687+00:00, run_duration=4.850151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:19:00+00:00, data_interval_end=2024-05-10 23:20:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:20:05.965727839Z [2024-05-10T23:20:05.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:21:00+00:00 2024-05-10T23:20:05.972975267Z [2024-05-10T23:20:05.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:20:05.973399787Z [2024-05-10T23:20:05.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:19:00+00:00, run_id=scheduled__2024-05-10T23:19:00+00:00, run_start_date=2024-05-10 23:20:01.104511+00:00, run_end_date=2024-05-10 23:20:05.973018+00:00, run_duration=4.868507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:19:00+00:00, data_interval_end=2024-05-10 23:20:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:20:05.982841636Z [2024-05-10T23:20:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:21:00+00:00 2024-05-10T23:20:06.037201933Z [2024-05-10T23:20:06.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:19:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:06.037392482Z [2024-05-10T23:20:06.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:19:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:06.044231101Z [2024-05-10T23:20:06.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:19:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:03.802186+00:00, run_end_date=2024-05-10 23:20:05.382404+00:00, run_duration=1.580218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:01.210355+00:00, queued_by_job_id=2, pid=3640 2024-05-10T23:20:06.044787632Z [2024-05-10T23:20:06.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:19:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:03.332253+00:00, run_end_date=2024-05-10 23:20:04.743066+00:00, run_duration=1.410813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:01.210355+00:00, queued_by_job_id=2, pid=3624 2024-05-10T23:20:07.104538991Z [2024-05-10T23:20:07.104+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:20:07.104568588Z 2024-05-10T23:20:07.104780045Z [2024-05-10T23:20:07.104+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:20:07.105333272Z [2024-05-10T23:20:07.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:20:07.105337792Z 2024-05-10T23:20:07.107343760Z [2024-05-10T23:20:07.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:20:07.107929185Z [2024-05-10T23:20:07.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:20:07.170871186Z [2024-05-10T23:20:07.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:07.171211357Z [2024-05-10T23:20:07.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:07.180405861Z [2024-05-10T23:20:07.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a9934f5-b4f6-401f-9873-aac896030eb3 2024-05-10T23:20:07.180894762Z [2024-05-10T23:20:07.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:06.220063+00:00, run_end_date=2024-05-10 23:20:06.561395+00:00, run_duration=0.341332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:04.528731+00:00, queued_by_job_id=2, pid=3663 2024-05-10T23:20:10.087602016Z [2024-05-10T23:20:10.087+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:20:10.087645453Z 2024-05-10T23:20:10.087916612Z [2024-05-10T23:20:10.087+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:20:10.088806713Z [2024-05-10T23:20:10.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:20:10.088820137Z 2024-05-10T23:20:10.091078348Z [2024-05-10T23:20:10.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:20:10.091366199Z [2024-05-10T23:20:10.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:20:10.146822446Z [2024-05-10T23:20:10.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status queued for try_number 1 2024-05-10T23:20:10.147100684Z [2024-05-10T23:20:10.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:10.153784589Z [2024-05-10T23:20:10.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0c525b6-c811-47fe-a780-56dd374ea08f 2024-05-10T23:20:10.154167674Z [2024-05-10T23:20:10.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=0, run_start_date=2024-05-10 23:20:08.677582+00:00, run_end_date=2024-05-10 23:20:09.035360+00:00, run_duration=0.357778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:07.105747+00:00, queued_by_job_id=2, pid=3674 2024-05-10T23:20:12.368573408Z [2024-05-10T23:20:12.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:20:12.368962701Z [2024-05-10T23:20:12.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:15:00+00:00, run_id=scheduled__2024-05-10T23:15:00+00:00, run_start_date=2024-05-10 23:20:01.098249+00:00, run_end_date=2024-05-10 23:20:12.368486+00:00, run_duration=11.270237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:15:00+00:00, data_interval_end=2024-05-10 23:20:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:20:12.375575749Z [2024-05-10T23:20:12.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:20:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:20:12.411270157Z [2024-05-10T23:20:12.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:15:00+00:00 exited with status success for try_number 1 2024-05-10T23:20:12.419836812Z [2024-05-10T23:20:12.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:15:00+00:00, map_index=-1, run_start_date=2024-05-10 23:20:11.703228+00:00, run_end_date=2024-05-10 23:20:12.026940+00:00, run_duration=0.323712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:20:10.089279+00:00, queued_by_job_id=2, pid=3682 2024-05-10T23:20:33.754122968Z [2024-05-10T23:20:33.753+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:21:00.435868720Z [2024-05-10T23:21:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:21:00+00:00, run_after=2024-05-10T23:22:00+00:00 2024-05-10T23:21:00.451689177Z [2024-05-10T23:21:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:21:00+00:00, run_after=2024-05-10T23:22:00+00:00 2024-05-10T23:21:00.457821517Z [2024-05-10T23:21:00.457+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:21:00.529838252Z [2024-05-10T23:21:00.529+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:21:00.529928261Z 2024-05-10T23:21:00.529941357Z 2024-05-10T23:21:00.529949950Z 2024-05-10T23:21:00.529981751Z [2024-05-10T23:21:00.529+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:21:00.530008980Z [2024-05-10T23:21:00.529+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:21:00.530092712Z [2024-05-10T23:21:00.529+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:21:00.530737034Z [2024-05-10T23:21:00.530+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:21:00.530753755Z 2024-05-10T23:21:00.530763144Z 2024-05-10T23:21:00.530779597Z 2024-05-10T23:21:00.534052503Z [2024-05-10T23:21:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:21:00.534135255Z [2024-05-10T23:21:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:21:00.534447424Z [2024-05-10T23:21:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:21:00.534484246Z [2024-05-10T23:21:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:21:00.534763975Z [2024-05-10T23:21:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:21:00.534796539Z [2024-05-10T23:21:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:21:00.769061693Z [2024-05-10T23:21:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:21:00.769606459Z [2024-05-10T23:21:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:21:00.769743496Z [2024-05-10T23:21:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:21:00.778830841Z [2024-05-10T23:21:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02712b1d-3c4b-4ca4-a227-7987c31473c9 2024-05-10T23:21:00.779006724Z [2024-05-10T23:21:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 826990d5-d30e-4f1c-af9d-a993131e2308 2024-05-10T23:21:00.779162140Z [2024-05-10T23:21:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 929aea8f-ec28-4e00-aee0-218530da429e 2024-05-10T23:21:01.918927912Z [2024-05-10T23:21:01.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:21:01.919493207Z [2024-05-10T23:21:01.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:20:00+00:00, run_id=scheduled__2024-05-10T23:20:00+00:00, run_start_date=2024-05-10 23:21:00.468463+00:00, run_end_date=2024-05-10 23:21:01.919116+00:00, run_duration=1.450653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:20:00+00:00, data_interval_end=2024-05-10 23:21:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:21:01.929406326Z [2024-05-10T23:21:01.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:21:00+00:00, run_after=2024-05-10T23:22:00+00:00 2024-05-10T23:21:01.997626725Z [2024-05-10T23:21:01.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:21:02.007794210Z [2024-05-10T23:21:02.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:21:01.398598+00:00, run_end_date=2024-05-10 23:21:01.802247+00:00, run_duration=0.403649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:21:00.531429+00:00, queued_by_job_id=2, pid=3691 2024-05-10T23:21:03.668719990Z [2024-05-10T23:21:03.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:21:03.669171030Z [2024-05-10T23:21:03.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:20:00+00:00, run_id=scheduled__2024-05-10T23:20:00+00:00, run_start_date=2024-05-10 23:21:00.469750+00:00, run_end_date=2024-05-10 23:21:03.668622+00:00, run_duration=3.198872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:20:00+00:00, data_interval_end=2024-05-10 23:21:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:21:03.677698009Z [2024-05-10T23:21:03.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:21:00+00:00, run_after=2024-05-10T23:22:00+00:00 2024-05-10T23:21:03.832850543Z [2024-05-10T23:21:03.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:21:03.840635489Z [2024-05-10T23:21:03.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:21:02.286063+00:00, run_end_date=2024-05-10 23:21:03.616456+00:00, run_duration=1.330393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:21:00.531429+00:00, queued_by_job_id=2, pid=3710 2024-05-10T23:21:06.003918801Z [2024-05-10T23:21:06.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:21:06.004755590Z [2024-05-10T23:21:06.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:20:00+00:00, run_id=scheduled__2024-05-10T23:20:00+00:00, run_start_date=2024-05-10 23:21:00.470968+00:00, run_end_date=2024-05-10 23:21:06.003898+00:00, run_duration=5.53293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:20:00+00:00, data_interval_end=2024-05-10 23:21:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:21:06.014612004Z [2024-05-10T23:21:06.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:21:00+00:00, run_after=2024-05-10T23:22:00+00:00 2024-05-10T23:21:06.061424816Z [2024-05-10T23:21:06.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:21:06.070989186Z [2024-05-10T23:21:06.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:21:02.240271+00:00, run_end_date=2024-05-10 23:21:05.011419+00:00, run_duration=2.771148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:21:00.531429+00:00, queued_by_job_id=2, pid=3709 2024-05-10T23:22:00.902693366Z [2024-05-10T23:22:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:22:00+00:00, run_after=2024-05-10T23:23:00+00:00 2024-05-10T23:22:00.911363568Z [2024-05-10T23:22:00.911+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:22:00.917945686Z [2024-05-10T23:22:00.917+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:22:00.929812357Z [2024-05-10T23:22:00.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:22:00+00:00, run_after=2024-05-10T23:23:00+00:00 2024-05-10T23:22:01.023276632Z [2024-05-10T23:22:01.021+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:22:01.023303323Z 2024-05-10T23:22:01.023307625Z 2024-05-10T23:22:01.023311231Z 2024-05-10T23:22:01.023314603Z 2024-05-10T23:22:01.023318465Z [2024-05-10T23:22:01.021+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:22:01.023321922Z [2024-05-10T23:22:01.021+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:22:01.023324923Z [2024-05-10T23:22:01.021+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:22:01.023342276Z [2024-05-10T23:22:01.021+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:22:01.023345466Z [2024-05-10T23:22:01.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:22:01.023348427Z 2024-05-10T23:22:01.023351412Z 2024-05-10T23:22:01.023354459Z 2024-05-10T23:22:01.023357507Z 2024-05-10T23:22:01.027469533Z [2024-05-10T23:22:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:22:01.029204872Z [2024-05-10T23:22:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:22:01.029223863Z [2024-05-10T23:22:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:22:01.029228675Z [2024-05-10T23:22:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:22:01.029233364Z [2024-05-10T23:22:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:22:01.029237409Z [2024-05-10T23:22:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:22:01.029241912Z [2024-05-10T23:22:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:22:01.029246228Z [2024-05-10T23:22:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:22:01.373278211Z [2024-05-10T23:22:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:22:01.373324829Z [2024-05-10T23:22:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:21:00+00:00 exited with status queued for try_number 1 2024-05-10T23:22:01.373398016Z [2024-05-10T23:22:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:21:00+00:00 exited with status queued for try_number 1 2024-05-10T23:22:01.373495833Z [2024-05-10T23:22:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:21:00+00:00 exited with status queued for try_number 1 2024-05-10T23:22:01.383784837Z [2024-05-10T23:22:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc31db60-bfb1-4e4f-8455-3ee2d92df467 2024-05-10T23:22:01.383824426Z [2024-05-10T23:22:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0111e6de-0d4f-4e46-9036-b5d01f2a3b41 2024-05-10T23:22:01.383944468Z [2024-05-10T23:22:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 664ed74d-91e6-486c-9800-b8676496e1bd 2024-05-10T23:22:01.384034518Z [2024-05-10T23:22:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to a66b5493-9110-40ee-900d-60b6883b39d9 2024-05-10T23:22:02.620405095Z [2024-05-10T23:22:02.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:22:02.620728726Z [2024-05-10T23:22:02.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:20:00+00:00, run_id=scheduled__2024-05-10T23:20:00+00:00, run_start_date=2024-05-10 23:22:00.943574+00:00, run_end_date=2024-05-10 23:22:02.620286+00:00, run_duration=1.676712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:20:00+00:00, data_interval_end=2024-05-10 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:22:02.629917667Z [2024-05-10T23:22:02.629+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:22:00+00:00, run_after=2024-05-10T23:24:00+00:00 2024-05-10T23:22:02.641251350Z [2024-05-10T23:22:02.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:22:02.641377701Z [2024-05-10T23:22:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:21:00+00:00, run_id=scheduled__2024-05-10T23:21:00+00:00, run_start_date=2024-05-10 23:22:00.945602+00:00, run_end_date=2024-05-10 23:22:02.641081+00:00, run_duration=1.695479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:21:00+00:00, data_interval_end=2024-05-10 23:22:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:22:02.655322770Z [2024-05-10T23:22:02.654+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:22:00+00:00, run_after=2024-05-10T23:23:00+00:00 2024-05-10T23:22:02.713477592Z [2024-05-10T23:22:02.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:22:02.713507794Z [2024-05-10T23:22:02.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:21:00+00:00 exited with status success for try_number 1 2024-05-10T23:22:02.721357722Z [2024-05-10T23:22:02.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:22:01.740769+00:00, run_end_date=2024-05-10 23:22:02.116511+00:00, run_duration=0.375742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:22:01.023458+00:00, queued_by_job_id=2, pid=3738 2024-05-10T23:22:02.721459099Z [2024-05-10T23:22:02.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:21:00+00:00, map_index=-1, run_start_date=2024-05-10 23:22:02.039587+00:00, run_end_date=2024-05-10 23:22:02.443973+00:00, run_duration=0.404386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:22:01.023458+00:00, queued_by_job_id=2, pid=3749 2024-05-10T23:22:04.665900516Z [2024-05-10T23:22:04.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:22:04.666484348Z [2024-05-10T23:22:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:21:00+00:00, run_id=scheduled__2024-05-10T23:21:00+00:00, run_start_date=2024-05-10 23:22:00.947561+00:00, run_end_date=2024-05-10 23:22:04.665951+00:00, run_duration=3.71839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:21:00+00:00, data_interval_end=2024-05-10 23:22:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:22:04.676789827Z [2024-05-10T23:22:04.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:22:00+00:00, run_after=2024-05-10T23:23:00+00:00 2024-05-10T23:22:05.772697164Z [2024-05-10T23:22:05.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:22:05.772917040Z [2024-05-10T23:22:05.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:21:00+00:00, run_id=scheduled__2024-05-10T23:21:00+00:00, run_start_date=2024-05-10 23:22:00.949292+00:00, run_end_date=2024-05-10 23:22:05.772593+00:00, run_duration=4.823301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:21:00+00:00, data_interval_end=2024-05-10 23:22:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:22:05.781672425Z [2024-05-10T23:22:05.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:22:00+00:00, run_after=2024-05-10T23:23:00+00:00 2024-05-10T23:22:05.826747200Z [2024-05-10T23:22:05.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:21:00+00:00 exited with status success for try_number 1 2024-05-10T23:22:05.827088031Z [2024-05-10T23:22:05.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:21:00+00:00 exited with status success for try_number 1 2024-05-10T23:22:05.833414661Z [2024-05-10T23:22:05.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:21:00+00:00, map_index=-1, run_start_date=2024-05-10 23:22:02.966192+00:00, run_end_date=2024-05-10 23:22:04.906618+00:00, run_duration=1.940426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:22:01.023458+00:00, queued_by_job_id=2, pid=3767 2024-05-10T23:22:05.833693734Z [2024-05-10T23:22:05.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:21:00+00:00, map_index=-1, run_start_date=2024-05-10 23:22:03.079547+00:00, run_end_date=2024-05-10 23:22:04.620904+00:00, run_duration=1.541357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:22:01.023458+00:00, queued_by_job_id=2, pid=3768 2024-05-10T23:23:00.203624367Z [2024-05-10T23:23:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:23:00+00:00, run_after=2024-05-10T23:24:00+00:00 2024-05-10T23:23:00.219322057Z [2024-05-10T23:23:00.219+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:23:00.239608212Z [2024-05-10T23:23:00.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:23:00+00:00, run_after=2024-05-10T23:24:00+00:00 2024-05-10T23:23:00.370969481Z [2024-05-10T23:23:00.370+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:23:00.370995826Z 2024-05-10T23:23:00.370999580Z 2024-05-10T23:23:00.371002680Z 2024-05-10T23:23:00.374093011Z [2024-05-10T23:23:00.370+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:23:00.374999137Z [2024-05-10T23:23:00.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:23:00.375749847Z [2024-05-10T23:23:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:23:00.378544511Z [2024-05-10T23:23:00.378+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:23:00.378570611Z 2024-05-10T23:23:00.378574124Z 2024-05-10T23:23:00.378577075Z 2024-05-10T23:23:00.381897638Z [2024-05-10T23:23:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:23:00.381983766Z [2024-05-10T23:23:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:23:00.382246813Z [2024-05-10T23:23:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:23:00.382257324Z [2024-05-10T23:23:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:23:00.382420136Z [2024-05-10T23:23:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:23:00.382491557Z [2024-05-10T23:23:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:23:00.650936138Z [2024-05-10T23:23:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status queued for try_number 1 2024-05-10T23:23:00.654319308Z [2024-05-10T23:23:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status queued for try_number 1 2024-05-10T23:23:00.654434599Z [2024-05-10T23:23:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status queued for try_number 1 2024-05-10T23:23:00.673797651Z [2024-05-10T23:23:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to e160bf9d-d464-4684-8de8-9d5f7e22053d 2024-05-10T23:23:00.674130740Z [2024-05-10T23:23:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 176cd42c-8122-4184-b156-3b36b62ed05b 2024-05-10T23:23:00.674292813Z [2024-05-10T23:23:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 315577b1-8e24-4852-9458-86c29d795762 2024-05-10T23:23:03.104144254Z [2024-05-10T23:23:03.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:23:03.104599337Z [2024-05-10T23:23:03.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:22:00+00:00, run_id=scheduled__2024-05-10T23:22:00+00:00, run_start_date=2024-05-10 23:23:00.257873+00:00, run_end_date=2024-05-10 23:23:03.104064+00:00, run_duration=2.846191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:22:00+00:00, data_interval_end=2024-05-10 23:23:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:23:03.116349890Z [2024-05-10T23:23:03.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:23:00+00:00, run_after=2024-05-10T23:24:00+00:00 2024-05-10T23:23:03.196638808Z [2024-05-10T23:23:03.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status success for try_number 1 2024-05-10T23:23:03.203632074Z [2024-05-10T23:23:03.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:22:00+00:00, map_index=-1, run_start_date=2024-05-10 23:23:01.433576+00:00, run_end_date=2024-05-10 23:23:01.988852+00:00, run_duration=0.555276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:23:00.379229+00:00, queued_by_job_id=2, pid=3800 2024-05-10T23:23:05.347606392Z [2024-05-10T23:23:05.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:23:05.348304957Z [2024-05-10T23:23:05.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:22:00+00:00, run_id=scheduled__2024-05-10T23:22:00+00:00, run_start_date=2024-05-10 23:23:00.259443+00:00, run_end_date=2024-05-10 23:23:05.347787+00:00, run_duration=5.088344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:22:00+00:00, data_interval_end=2024-05-10 23:23:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:23:05.362471207Z [2024-05-10T23:23:05.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:23:00+00:00, run_after=2024-05-10T23:24:00+00:00 2024-05-10T23:23:05.790975501Z [2024-05-10T23:23:05.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:23:05.791312700Z [2024-05-10T23:23:05.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:22:00+00:00, run_id=scheduled__2024-05-10T23:22:00+00:00, run_start_date=2024-05-10 23:23:00.260614+00:00, run_end_date=2024-05-10 23:23:05.790853+00:00, run_duration=5.530239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:22:00+00:00, data_interval_end=2024-05-10 23:23:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:23:05.800268838Z [2024-05-10T23:23:05.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:23:00+00:00, run_after=2024-05-10T23:24:00+00:00 2024-05-10T23:23:05.833647470Z [2024-05-10T23:23:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status success for try_number 1 2024-05-10T23:23:05.834058533Z [2024-05-10T23:23:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status success for try_number 1 2024-05-10T23:23:05.846103270Z [2024-05-10T23:23:05.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:22:00+00:00, map_index=-1, run_start_date=2024-05-10 23:23:02.850518+00:00, run_end_date=2024-05-10 23:23:05.271059+00:00, run_duration=2.420541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:23:00.379229+00:00, queued_by_job_id=2, pid=3819 2024-05-10T23:23:05.846637836Z [2024-05-10T23:23:05.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:22:00+00:00, map_index=-1, run_start_date=2024-05-10 23:23:02.724242+00:00, run_end_date=2024-05-10 23:23:05.658348+00:00, run_duration=2.934106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:23:00.379229+00:00, queued_by_job_id=2, pid=3818 2024-05-10T23:24:00.793147093Z [2024-05-10T23:24:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:24:00.808994586Z [2024-05-10T23:24:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:24:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:24:00.821597917Z [2024-05-10T23:24:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:24:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:24:00.830837132Z [2024-05-10T23:24:00.830+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:24:00.939208489Z [2024-05-10T23:24:00.938+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:24:00.939239788Z 2024-05-10T23:24:00.939245791Z 2024-05-10T23:24:00.939250470Z 2024-05-10T23:24:00.939276676Z 2024-05-10T23:24:00.939558207Z [2024-05-10T23:24:00.939+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:24:00.939925876Z [2024-05-10T23:24:00.939+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:24:00.940345237Z [2024-05-10T23:24:00.940+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:24:00.940724409Z [2024-05-10T23:24:00.940+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:24:00.942235681Z [2024-05-10T23:24:00.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:24:00.942260926Z 2024-05-10T23:24:00.942267725Z 2024-05-10T23:24:00.942273697Z 2024-05-10T23:24:00.942279701Z 2024-05-10T23:24:00.948655551Z [2024-05-10T23:24:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:24:00.949067806Z [2024-05-10T23:24:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:24:00.949463576Z [2024-05-10T23:24:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:24:00.949703301Z [2024-05-10T23:24:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:24:00.950128882Z [2024-05-10T23:24:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:24:00.950339870Z [2024-05-10T23:24:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:24:00.950771592Z [2024-05-10T23:24:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:24:00.951020001Z [2024-05-10T23:24:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:24:01.497552518Z [2024-05-10T23:24:01.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status queued for try_number 1 2024-05-10T23:24:01.497778352Z [2024-05-10T23:24:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:23:00+00:00 exited with status queued for try_number 1 2024-05-10T23:24:01.497968039Z [2024-05-10T23:24:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:23:00+00:00 exited with status queued for try_number 1 2024-05-10T23:24:01.501797194Z [2024-05-10T23:24:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:23:00+00:00 exited with status queued for try_number 1 2024-05-10T23:24:01.531593426Z [2024-05-10T23:24:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to a790ebe7-8486-4db9-aff2-f0ab079d4904 2024-05-10T23:24:01.531817572Z [2024-05-10T23:24:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to eab431b9-a94d-4c53-ac88-6694fea86e33 2024-05-10T23:24:01.532001126Z [2024-05-10T23:24:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2430168-8b2b-4693-b49d-7fd906cb1234 2024-05-10T23:24:01.532224885Z [2024-05-10T23:24:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 419789ed-6ce9-4ebf-9a76-6d3a649e4896 2024-05-10T23:24:03.029050095Z [2024-05-10T23:24:03.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:24:03.034468545Z [2024-05-10T23:24:03.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:23:00+00:00, run_id=scheduled__2024-05-10T23:23:00+00:00, run_start_date=2024-05-10 23:24:00.850248+00:00, run_end_date=2024-05-10 23:24:03.028946+00:00, run_duration=2.178698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:23:00+00:00, data_interval_end=2024-05-10 23:24:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:24:03.061128741Z [2024-05-10T23:24:03.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:24:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:24:04.166771364Z [2024-05-10T23:24:04.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:24:04.167006366Z [2024-05-10T23:24:04.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:22:00+00:00, run_id=scheduled__2024-05-10T23:22:00+00:00, run_start_date=2024-05-10 23:24:00.848167+00:00, run_end_date=2024-05-10 23:24:04.166612+00:00, run_duration=3.318445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:22:00+00:00, data_interval_end=2024-05-10 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:24:04.174361931Z [2024-05-10T23:24:04.174+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:24:00+00:00, run_after=2024-05-10T23:26:00+00:00 2024-05-10T23:24:04.230042542Z [2024-05-10T23:24:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:22:00+00:00 exited with status success for try_number 1 2024-05-10T23:24:04.230088178Z [2024-05-10T23:24:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:23:00+00:00 exited with status success for try_number 1 2024-05-10T23:24:04.237113827Z [2024-05-10T23:24:04.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:22:00+00:00, map_index=-1, run_start_date=2024-05-10 23:24:02.733401+00:00, run_end_date=2024-05-10 23:24:03.090759+00:00, run_duration=0.357358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:24:00.944127+00:00, queued_by_job_id=2, pid=3861 2024-05-10T23:24:04.237336943Z [2024-05-10T23:24:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:23:00+00:00, map_index=-1, run_start_date=2024-05-10 23:24:02.400745+00:00, run_end_date=2024-05-10 23:24:02.865207+00:00, run_duration=0.464462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:24:00.944127+00:00, queued_by_job_id=2, pid=3853 2024-05-10T23:24:05.552099032Z [2024-05-10T23:24:05.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:24:05.552461271Z [2024-05-10T23:24:05.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:23:00+00:00, run_id=scheduled__2024-05-10T23:23:00+00:00, run_start_date=2024-05-10 23:24:00.855484+00:00, run_end_date=2024-05-10 23:24:05.552004+00:00, run_duration=4.69652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:23:00+00:00, data_interval_end=2024-05-10 23:24:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:24:05.563383795Z [2024-05-10T23:24:05.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:24:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:24:05.569813281Z [2024-05-10T23:24:05.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:24:05.570187974Z [2024-05-10T23:24:05.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:23:00+00:00, run_id=scheduled__2024-05-10T23:23:00+00:00, run_start_date=2024-05-10 23:24:00.853686+00:00, run_end_date=2024-05-10 23:24:05.569746+00:00, run_duration=4.71606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:23:00+00:00, data_interval_end=2024-05-10 23:24:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:24:05.581007194Z [2024-05-10T23:24:05.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:24:00+00:00, run_after=2024-05-10T23:25:00+00:00 2024-05-10T23:24:05.611638900Z [2024-05-10T23:24:05.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:23:00+00:00 exited with status success for try_number 1 2024-05-10T23:24:05.611828206Z [2024-05-10T23:24:05.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:23:00+00:00 exited with status success for try_number 1 2024-05-10T23:24:05.626904251Z [2024-05-10T23:24:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:23:00+00:00, map_index=-1, run_start_date=2024-05-10 23:24:03.635131+00:00, run_end_date=2024-05-10 23:24:04.941935+00:00, run_duration=1.306804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:24:00.944127+00:00, queued_by_job_id=2, pid=3878 2024-05-10T23:24:05.627219456Z [2024-05-10T23:24:05.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:23:00+00:00, map_index=-1, run_start_date=2024-05-10 23:24:03.505003+00:00, run_end_date=2024-05-10 23:24:05.246767+00:00, run_duration=1.741764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:24:00.944127+00:00, queued_by_job_id=2, pid=3877 2024-05-10T23:25:00.731721918Z [2024-05-10T23:25:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:26:00+00:00 2024-05-10T23:25:00.739531656Z [2024-05-10T23:25:00.739+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:25:00.750370304Z [2024-05-10T23:25:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:25:00.761665541Z [2024-05-10T23:25:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:26:00+00:00 2024-05-10T23:25:00.839839411Z [2024-05-10T23:25:00.839+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:25:00.839881722Z 2024-05-10T23:25:00.839892608Z 2024-05-10T23:25:00.839930634Z 2024-05-10T23:25:00.839940154Z 2024-05-10T23:25:00.840066639Z [2024-05-10T23:25:00.839+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:25:00.840348333Z [2024-05-10T23:25:00.840+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:25:00.840505839Z [2024-05-10T23:25:00.840+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:25:00.840638634Z [2024-05-10T23:25:00.840+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:25:00.841567196Z [2024-05-10T23:25:00.841+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:25:00.841586416Z 2024-05-10T23:25:00.841590619Z 2024-05-10T23:25:00.841593656Z 2024-05-10T23:25:00.841596992Z 2024-05-10T23:25:00.847844071Z [2024-05-10T23:25:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:25:00.848113332Z [2024-05-10T23:25:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:25:00.848529922Z [2024-05-10T23:25:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:25:00.848753373Z [2024-05-10T23:25:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:25:00.849118476Z [2024-05-10T23:25:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:25:00.849373773Z [2024-05-10T23:25:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:25:00.849721332Z [2024-05-10T23:25:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:25:00.849936537Z [2024-05-10T23:25:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:25:01.351024809Z [2024-05-10T23:25:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:01.354128464Z [2024-05-10T23:25:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:01.354296500Z [2024-05-10T23:25:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:01.354367508Z [2024-05-10T23:25:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:01.371426321Z [2024-05-10T23:25:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cb7b4cc-ce0b-4583-b7ac-339fd049dfc8 2024-05-10T23:25:01.371452271Z [2024-05-10T23:25:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 384c23d6-ce3e-4f5c-bc57-e950d6cbd101 2024-05-10T23:25:01.371602629Z [2024-05-10T23:25:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d84132d-7aec-43c3-aaa0-58f4b0d34322 2024-05-10T23:25:01.374106952Z [2024-05-10T23:25:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1d2be36-69ac-45e8-bef8-ee7374c499b1 2024-05-10T23:25:02.639650500Z [2024-05-10T23:25:02.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:25:02.640380611Z [2024-05-10T23:25:02.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:24:00+00:00, run_id=scheduled__2024-05-10T23:24:00+00:00, run_start_date=2024-05-10 23:25:00.773643+00:00, run_end_date=2024-05-10 23:25:02.639808+00:00, run_duration=1.866165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:24:00+00:00, data_interval_end=2024-05-10 23:25:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:25:02.650197382Z [2024-05-10T23:25:02.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:26:00+00:00 2024-05-10T23:25:02.702645202Z [2024-05-10T23:25:02.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:02.708861727Z [2024-05-10T23:25:02.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:24:00+00:00, map_index=-1, run_start_date=2024-05-10 23:25:01.932055+00:00, run_end_date=2024-05-10 23:25:02.388167+00:00, run_duration=0.456112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:00.843453+00:00, queued_by_job_id=2, pid=3911 2024-05-10T23:25:03.801131683Z [2024-05-10T23:25:03.800+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:25:03.801164724Z 2024-05-10T23:25:03.801589376Z [2024-05-10T23:25:03.801+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:25:03.802222764Z [2024-05-10T23:25:03.801+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:25:03.802232570Z 2024-05-10T23:25:03.805052417Z [2024-05-10T23:25:03.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:25:03.805222307Z [2024-05-10T23:25:03.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:25:03.872802514Z [2024-05-10T23:25:03.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:03.872958984Z [2024-05-10T23:25:03.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:03.883653226Z [2024-05-10T23:25:03.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fed212f-d4b3-48b5-9850-24be848c1c80 2024-05-10T23:25:03.883820547Z [2024-05-10T23:25:03.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:25:02.884861+00:00, run_end_date=2024-05-10 23:25:03.223136+00:00, run_duration=0.338275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:00.843453+00:00, queued_by_job_id=2, pid=3936 2024-05-10T23:25:04.771201901Z [2024-05-10T23:25:04.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:25:04.771596483Z [2024-05-10T23:25:04.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:24:00+00:00, run_id=scheduled__2024-05-10T23:24:00+00:00, run_start_date=2024-05-10 23:25:00.775718+00:00, run_end_date=2024-05-10 23:25:04.771090+00:00, run_duration=3.995372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:24:00+00:00, data_interval_end=2024-05-10 23:25:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:25:04.783132092Z [2024-05-10T23:25:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:26:00+00:00 2024-05-10T23:25:04.790869765Z [2024-05-10T23:25:04.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:25:04.791219219Z [2024-05-10T23:25:04.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:24:00+00:00, run_id=scheduled__2024-05-10T23:24:00+00:00, run_start_date=2024-05-10 23:25:00.774690+00:00, run_end_date=2024-05-10 23:25:04.790772+00:00, run_duration=4.016082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:24:00+00:00, data_interval_end=2024-05-10 23:25:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:25:04.800558820Z [2024-05-10T23:25:04.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:26:00+00:00 2024-05-10T23:25:04.853092686Z [2024-05-10T23:25:04.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:04.853713186Z [2024-05-10T23:25:04.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:04.867501013Z [2024-05-10T23:25:04.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:24:00+00:00, map_index=-1, run_start_date=2024-05-10 23:25:02.780983+00:00, run_end_date=2024-05-10 23:25:04.416616+00:00, run_duration=1.635633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:00.843453+00:00, queued_by_job_id=2, pid=3930 2024-05-10T23:25:04.868360525Z [2024-05-10T23:25:04.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:24:00+00:00, map_index=-1, run_start_date=2024-05-10 23:25:03.069034+00:00, run_end_date=2024-05-10 23:25:04.391961+00:00, run_duration=1.322927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:00.843453+00:00, queued_by_job_id=2, pid=3941 2024-05-10T23:25:07.012189985Z [2024-05-10T23:25:07.011+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:25:07.012241958Z 2024-05-10T23:25:07.012503229Z [2024-05-10T23:25:07.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:25:07.013234316Z [2024-05-10T23:25:07.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:25:07.013246575Z 2024-05-10T23:25:07.015712149Z [2024-05-10T23:25:07.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:25:07.015975417Z [2024-05-10T23:25:07.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:25:07.079526503Z [2024-05-10T23:25:07.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:07.079735895Z [2024-05-10T23:25:07.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:07.087745446Z [2024-05-10T23:25:07.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to a31debcd-7786-4fa7-95cc-ee4bdd8c13e0 2024-05-10T23:25:07.089027523Z [2024-05-10T23:25:07.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:25:05.495203+00:00, run_end_date=2024-05-10 23:25:05.823461+00:00, run_duration=0.328258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:03.802543+00:00, queued_by_job_id=2, pid=3970 2024-05-10T23:25:10.072593573Z [2024-05-10T23:25:10.072+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:25:10.072651444Z 2024-05-10T23:25:10.072682916Z [2024-05-10T23:25:10.072+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:25:10.073148709Z [2024-05-10T23:25:10.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:25:10.073173211Z 2024-05-10T23:25:10.075443312Z [2024-05-10T23:25:10.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:25:10.075532083Z [2024-05-10T23:25:10.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:25:10.138186593Z [2024-05-10T23:25:10.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status queued for try_number 1 2024-05-10T23:25:10.138497409Z [2024-05-10T23:25:10.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:10.148210359Z [2024-05-10T23:25:10.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d29914b-2db7-41fc-bbee-5737480ad054 2024-05-10T23:25:10.148883026Z [2024-05-10T23:25:10.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=0, run_start_date=2024-05-10 23:25:08.861692+00:00, run_end_date=2024-05-10 23:25:09.191880+00:00, run_duration=0.330188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:07.013745+00:00, queued_by_job_id=2, pid=3981 2024-05-10T23:25:12.102202707Z [2024-05-10T23:25:12.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:25:12.102872484Z [2024-05-10T23:25:12.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:20:00+00:00, run_id=scheduled__2024-05-10T23:20:00+00:00, run_start_date=2024-05-10 23:25:00.771999+00:00, run_end_date=2024-05-10 23:25:12.102101+00:00, run_duration=11.330102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:20:00+00:00, data_interval_end=2024-05-10 23:25:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:25:12.109150073Z [2024-05-10T23:25:12.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:25:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:25:12.999489873Z [2024-05-10T23:25:12.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:20:00+00:00 exited with status success for try_number 1 2024-05-10T23:25:13.006257116Z [2024-05-10T23:25:13.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:20:00+00:00, map_index=-1, run_start_date=2024-05-10 23:25:11.684775+00:00, run_end_date=2024-05-10 23:25:12.054998+00:00, run_duration=0.370223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:25:10.073429+00:00, queued_by_job_id=2, pid=3989 2024-05-10T23:25:33.829561308Z [2024-05-10T23:25:33.828+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:26:00.702762794Z [2024-05-10T23:26:00.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:26:00+00:00, run_after=2024-05-10T23:27:00+00:00 2024-05-10T23:26:00.709987188Z [2024-05-10T23:26:00.709+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:26:00.722381422Z [2024-05-10T23:26:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:26:00+00:00, run_after=2024-05-10T23:27:00+00:00 2024-05-10T23:26:00.730257621Z [2024-05-10T23:26:00.729+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:26:00.863631016Z [2024-05-10T23:26:00.862+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:26:00.863812177Z 2024-05-10T23:26:00.863897803Z 2024-05-10T23:26:00.863904526Z 2024-05-10T23:26:00.863910351Z 2024-05-10T23:26:00.864121393Z [2024-05-10T23:26:00.863+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:26:00.864131490Z [2024-05-10T23:26:00.863+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:26:00.864146552Z [2024-05-10T23:26:00.863+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:26:00.864160762Z [2024-05-10T23:26:00.863+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:26:00.865003672Z [2024-05-10T23:26:00.864+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:26:00.865026791Z 2024-05-10T23:26:00.865032470Z 2024-05-10T23:26:00.865036562Z 2024-05-10T23:26:00.865040439Z 2024-05-10T23:26:00.871034258Z [2024-05-10T23:26:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:26:00.871082879Z [2024-05-10T23:26:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:26:00.871332932Z [2024-05-10T23:26:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:26:00.871420930Z [2024-05-10T23:26:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:26:00.871647777Z [2024-05-10T23:26:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:26:00.871753351Z [2024-05-10T23:26:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:26:00.871952311Z [2024-05-10T23:26:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:26:00.872062721Z [2024-05-10T23:26:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:26:01.321042362Z [2024-05-10T23:26:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status queued for try_number 1 2024-05-10T23:26:01.321102789Z [2024-05-10T23:26:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:26:01.321174931Z [2024-05-10T23:26:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:26:01.321190820Z [2024-05-10T23:26:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:26:01.331127530Z [2024-05-10T23:26:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 273c210b-f70c-41ce-87cf-0e3c0db62c9f 2024-05-10T23:26:01.331157525Z [2024-05-10T23:26:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e9b2992-d349-4cce-9a93-a1088c2e7c29 2024-05-10T23:26:01.331266134Z [2024-05-10T23:26:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66961496-7c08-4825-a540-e84686cc0ea2 2024-05-10T23:26:01.331356209Z [2024-05-10T23:26:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce564efe-d10e-4fcb-8574-670fd5120e2b 2024-05-10T23:26:02.472362968Z [2024-05-10T23:26:02.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:26:02.472568656Z [2024-05-10T23:26:02.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:24:00+00:00, run_id=scheduled__2024-05-10T23:24:00+00:00, run_start_date=2024-05-10 23:26:00.742975+00:00, run_end_date=2024-05-10 23:26:02.472198+00:00, run_duration=1.729223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:24:00+00:00, data_interval_end=2024-05-10 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:26:02.480419144Z [2024-05-10T23:26:02.479+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:26:00+00:00, run_after=2024-05-10T23:28:00+00:00 2024-05-10T23:26:02.499145512Z [2024-05-10T23:26:02.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:26:02.499296212Z [2024-05-10T23:26:02.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:25:00+00:00, run_id=scheduled__2024-05-10T23:25:00+00:00, run_start_date=2024-05-10 23:26:00.744436+00:00, run_end_date=2024-05-10 23:26:02.499018+00:00, run_duration=1.754582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:25:00+00:00, data_interval_end=2024-05-10 23:26:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:26:02.513669972Z [2024-05-10T23:26:02.513+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:26:00+00:00, run_after=2024-05-10T23:27:00+00:00 2024-05-10T23:26:02.554594907Z [2024-05-10T23:26:02.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:24:00+00:00 exited with status success for try_number 1 2024-05-10T23:26:02.563487390Z [2024-05-10T23:26:02.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:24:00+00:00, map_index=-1, run_start_date=2024-05-10 23:26:01.708947+00:00, run_end_date=2024-05-10 23:26:02.065072+00:00, run_duration=0.356125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:26:00.866477+00:00, queued_by_job_id=2, pid=3999 2024-05-10T23:26:03.682241218Z [2024-05-10T23:26:03.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:26:03.687950174Z [2024-05-10T23:26:03.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=-1, run_start_date=2024-05-10 23:26:01.978182+00:00, run_end_date=2024-05-10 23:26:02.404372+00:00, run_duration=0.42619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:26:00.866477+00:00, queued_by_job_id=2, pid=4005 2024-05-10T23:26:06.234002477Z [2024-05-10T23:26:06.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:26:06.234515298Z [2024-05-10T23:26:06.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:25:00+00:00, run_id=scheduled__2024-05-10T23:25:00+00:00, run_start_date=2024-05-10 23:26:00.745578+00:00, run_end_date=2024-05-10 23:26:06.234200+00:00, run_duration=5.488622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:25:00+00:00, data_interval_end=2024-05-10 23:26:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:26:06.243185343Z [2024-05-10T23:26:06.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:26:00+00:00, run_after=2024-05-10T23:27:00+00:00 2024-05-10T23:26:06.249523423Z [2024-05-10T23:26:06.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:26:06.250030467Z [2024-05-10T23:26:06.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:25:00+00:00, run_id=scheduled__2024-05-10T23:25:00+00:00, run_start_date=2024-05-10 23:26:00.746918+00:00, run_end_date=2024-05-10 23:26:06.249695+00:00, run_duration=5.502777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:25:00+00:00, data_interval_end=2024-05-10 23:26:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:26:06.259218649Z [2024-05-10T23:26:06.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:26:00+00:00, run_after=2024-05-10T23:27:00+00:00 2024-05-10T23:26:06.305297218Z [2024-05-10T23:26:06.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:26:06.305746007Z [2024-05-10T23:26:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:26:06.313574935Z [2024-05-10T23:26:06.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=-1, run_start_date=2024-05-10 23:26:02.996580+00:00, run_end_date=2024-05-10 23:26:05.253189+00:00, run_duration=2.256609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:26:00.866477+00:00, queued_by_job_id=2, pid=4018 2024-05-10T23:26:06.314144802Z [2024-05-10T23:26:06.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=-1, run_start_date=2024-05-10 23:26:03.253196+00:00, run_end_date=2024-05-10 23:26:05.227565+00:00, run_duration=1.974369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:26:00.866477+00:00, queued_by_job_id=2, pid=4024 2024-05-10T23:27:00.597099567Z [2024-05-10T23:27:00.596+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:27:00.611922796Z [2024-05-10T23:27:00.611+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:27:00+00:00, run_after=2024-05-10T23:28:00+00:00 2024-05-10T23:27:00.625928140Z [2024-05-10T23:27:00.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:27:00+00:00, run_after=2024-05-10T23:28:00+00:00 2024-05-10T23:27:00.689965644Z [2024-05-10T23:27:00.688+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:27:00.690010735Z 2024-05-10T23:27:00.690021882Z 2024-05-10T23:27:00.690031095Z 2024-05-10T23:27:00.690066094Z [2024-05-10T23:27:00.689+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:27:00.690312890Z [2024-05-10T23:27:00.690+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:27:00.690376618Z [2024-05-10T23:27:00.690+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:27:00.691319772Z [2024-05-10T23:27:00.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:27:00.691342664Z 2024-05-10T23:27:00.691351936Z 2024-05-10T23:27:00.691360758Z 2024-05-10T23:27:00.695910374Z [2024-05-10T23:27:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:27:00.696013092Z [2024-05-10T23:27:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:27:00.696370711Z [2024-05-10T23:27:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:27:00.696597781Z [2024-05-10T23:27:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:27:00.696977008Z [2024-05-10T23:27:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:27:00.697085200Z [2024-05-10T23:27:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:27:00.944334170Z [2024-05-10T23:27:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status queued for try_number 1 2024-05-10T23:27:00.944570241Z [2024-05-10T23:27:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status queued for try_number 1 2024-05-10T23:27:00.944606982Z [2024-05-10T23:27:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status queued for try_number 1 2024-05-10T23:27:00.954077451Z [2024-05-10T23:27:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72d75bc3-d9cb-4612-8f33-49651b8644c2 2024-05-10T23:27:00.954111434Z [2024-05-10T23:27:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d518598-fbe2-4328-9a18-ba95957b8c5e 2024-05-10T23:27:00.954249488Z [2024-05-10T23:27:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6da77507-8f1c-48d1-9a6d-48640928d20a 2024-05-10T23:27:02.192718208Z [2024-05-10T23:27:02.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:27:02.193117680Z [2024-05-10T23:27:02.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:26:00+00:00, run_id=scheduled__2024-05-10T23:26:00+00:00, run_start_date=2024-05-10 23:27:00.636565+00:00, run_end_date=2024-05-10 23:27:02.192671+00:00, run_duration=1.556106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:26:00+00:00, data_interval_end=2024-05-10 23:27:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:27:02.202827394Z [2024-05-10T23:27:02.202+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:27:00+00:00, run_after=2024-05-10T23:28:00+00:00 2024-05-10T23:27:02.977626300Z [2024-05-10T23:27:02.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status success for try_number 1 2024-05-10T23:27:02.982766688Z [2024-05-10T23:27:02.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:26:00+00:00, map_index=-1, run_start_date=2024-05-10 23:27:01.619814+00:00, run_end_date=2024-05-10 23:27:02.124778+00:00, run_duration=0.504964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:27:00.692352+00:00, queued_by_job_id=2, pid=4056 2024-05-10T23:27:04.606588558Z [2024-05-10T23:27:04.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:27:04.607152173Z [2024-05-10T23:27:04.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:26:00+00:00, run_id=scheduled__2024-05-10T23:26:00+00:00, run_start_date=2024-05-10 23:27:00.638071+00:00, run_end_date=2024-05-10 23:27:04.606741+00:00, run_duration=3.96867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:26:00+00:00, data_interval_end=2024-05-10 23:27:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:27:04.626224022Z [2024-05-10T23:27:04.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:27:00+00:00, run_after=2024-05-10T23:28:00+00:00 2024-05-10T23:27:04.662762235Z [2024-05-10T23:27:04.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status success for try_number 1 2024-05-10T23:27:04.668017013Z [2024-05-10T23:27:04.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:26:00+00:00, map_index=-1, run_start_date=2024-05-10 23:27:02.851077+00:00, run_end_date=2024-05-10 23:27:04.292952+00:00, run_duration=1.441875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:27:00.692352+00:00, queued_by_job_id=2, pid=4074 2024-05-10T23:27:05.384202051Z [2024-05-10T23:27:05.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:27:05.384591569Z [2024-05-10T23:27:05.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:26:00+00:00, run_id=scheduled__2024-05-10T23:26:00+00:00, run_start_date=2024-05-10 23:27:00.639200+00:00, run_end_date=2024-05-10 23:27:05.384061+00:00, run_duration=4.744861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:26:00+00:00, data_interval_end=2024-05-10 23:27:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:27:05.395405093Z [2024-05-10T23:27:05.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:27:00+00:00, run_after=2024-05-10T23:28:00+00:00 2024-05-10T23:27:05.440313806Z [2024-05-10T23:27:05.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status success for try_number 1 2024-05-10T23:27:05.447478599Z [2024-05-10T23:27:05.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:26:00+00:00, map_index=-1, run_start_date=2024-05-10 23:27:02.885618+00:00, run_end_date=2024-05-10 23:27:04.486277+00:00, run_duration=1.600659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:27:00.692352+00:00, queued_by_job_id=2, pid=4075 2024-05-10T23:28:00.437700795Z [2024-05-10T23:28:00.437+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:28:00.450986429Z [2024-05-10T23:28:00.450+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:28:00+00:00, run_after=2024-05-10T23:29:00+00:00 2024-05-10T23:28:00.460772177Z [2024-05-10T23:28:00.460+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:28:00.489696306Z [2024-05-10T23:28:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:28:00+00:00, run_after=2024-05-10T23:29:00+00:00 2024-05-10T23:28:00.580016896Z [2024-05-10T23:28:00.579+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:28:00.580062223Z 2024-05-10T23:28:00.580072255Z 2024-05-10T23:28:00.580080750Z 2024-05-10T23:28:00.580089121Z 2024-05-10T23:28:00.580098205Z [2024-05-10T23:28:00.579+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:28:00.580106686Z [2024-05-10T23:28:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:28:00.580155268Z [2024-05-10T23:28:00.579+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:28:00.580196820Z [2024-05-10T23:28:00.579+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:28:00.580706641Z [2024-05-10T23:28:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:28:00.580722412Z 2024-05-10T23:28:00.580726767Z 2024-05-10T23:28:00.580730261Z 2024-05-10T23:28:00.580733552Z 2024-05-10T23:28:00.584301956Z [2024-05-10T23:28:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:28:00.584325348Z [2024-05-10T23:28:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:28:00.584641589Z [2024-05-10T23:28:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:28:00.584812190Z [2024-05-10T23:28:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:28:00.585084428Z [2024-05-10T23:28:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:28:00.585261619Z [2024-05-10T23:28:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:28:00.585518356Z [2024-05-10T23:28:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:28:00.585685397Z [2024-05-10T23:28:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:28:01.025251201Z [2024-05-10T23:28:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status queued for try_number 1 2024-05-10T23:28:01.025275495Z [2024-05-10T23:28:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:27:00+00:00 exited with status queued for try_number 1 2024-05-10T23:28:01.025279188Z [2024-05-10T23:28:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:27:00+00:00 exited with status queued for try_number 1 2024-05-10T23:28:01.025282511Z [2024-05-10T23:28:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:27:00+00:00 exited with status queued for try_number 1 2024-05-10T23:28:01.043247540Z [2024-05-10T23:28:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23fe0b41-35e4-4d0e-9aba-327001683ff0 2024-05-10T23:28:01.043547577Z [2024-05-10T23:28:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97c365fb-c27d-4bde-886c-0690b1b3f529 2024-05-10T23:28:01.043554442Z [2024-05-10T23:28:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32a82198-df68-4767-90b5-ac7f23b80b98 2024-05-10T23:28:01.046019943Z [2024-05-10T23:28:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb76177d-bb42-4dd6-9c55-4168d83c97c2 2024-05-10T23:28:02.332450775Z [2024-05-10T23:28:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:28:02.332917951Z [2024-05-10T23:28:02.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:26:00+00:00, run_id=scheduled__2024-05-10T23:26:00+00:00, run_start_date=2024-05-10 23:28:00.503659+00:00, run_end_date=2024-05-10 23:28:02.332336+00:00, run_duration=1.828677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:26:00+00:00, data_interval_end=2024-05-10 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:28:02.343362626Z [2024-05-10T23:28:02.342+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:28:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:28:02.359467351Z [2024-05-10T23:28:02.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:28:02.360809000Z [2024-05-10T23:28:02.360+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:27:00+00:00, run_id=scheduled__2024-05-10T23:27:00+00:00, run_start_date=2024-05-10 23:28:00.505340+00:00, run_end_date=2024-05-10 23:28:02.360269+00:00, run_duration=1.854929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:27:00+00:00, data_interval_end=2024-05-10 23:28:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:28:02.373051589Z [2024-05-10T23:28:02.372+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:28:00+00:00, run_after=2024-05-10T23:29:00+00:00 2024-05-10T23:28:02.436163877Z [2024-05-10T23:28:02.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:26:00+00:00 exited with status success for try_number 1 2024-05-10T23:28:02.436424757Z [2024-05-10T23:28:02.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:27:00+00:00 exited with status success for try_number 1 2024-05-10T23:28:02.448624839Z [2024-05-10T23:28:02.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:26:00+00:00, map_index=-1, run_start_date=2024-05-10 23:28:01.572281+00:00, run_end_date=2024-05-10 23:28:01.920930+00:00, run_duration=0.348649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:28:00.581585+00:00, queued_by_job_id=2, pid=4109 2024-05-10T23:28:02.448771002Z [2024-05-10T23:28:02.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:27:00+00:00, map_index=-1, run_start_date=2024-05-10 23:28:01.454047+00:00, run_end_date=2024-05-10 23:28:01.938052+00:00, run_duration=0.484005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:28:00.581585+00:00, queued_by_job_id=2, pid=4108 2024-05-10T23:28:04.506195770Z [2024-05-10T23:28:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:28:04.506783953Z [2024-05-10T23:28:04.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:27:00+00:00, run_id=scheduled__2024-05-10T23:27:00+00:00, run_start_date=2024-05-10 23:28:00.506853+00:00, run_end_date=2024-05-10 23:28:04.506202+00:00, run_duration=3.999349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:27:00+00:00, data_interval_end=2024-05-10 23:28:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:28:04.517109880Z [2024-05-10T23:28:04.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:28:00+00:00, run_after=2024-05-10T23:29:00+00:00 2024-05-10T23:28:04.556871079Z [2024-05-10T23:28:04.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:27:00+00:00 exited with status success for try_number 1 2024-05-10T23:28:04.563048168Z [2024-05-10T23:28:04.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:27:00+00:00, map_index=-1, run_start_date=2024-05-10 23:28:02.601644+00:00, run_end_date=2024-05-10 23:28:03.953737+00:00, run_duration=1.352093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:28:00.581585+00:00, queued_by_job_id=2, pid=4133 2024-05-10T23:28:05.598860595Z [2024-05-10T23:28:05.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:28:05.599010731Z [2024-05-10T23:28:05.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:27:00+00:00, run_id=scheduled__2024-05-10T23:27:00+00:00, run_start_date=2024-05-10 23:28:00.508264+00:00, run_end_date=2024-05-10 23:28:05.598771+00:00, run_duration=5.090507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:27:00+00:00, data_interval_end=2024-05-10 23:28:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:28:05.607186527Z [2024-05-10T23:28:05.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:28:00+00:00, run_after=2024-05-10T23:29:00+00:00 2024-05-10T23:28:05.631038096Z [2024-05-10T23:28:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:27:00+00:00 exited with status success for try_number 1 2024-05-10T23:28:05.636230504Z [2024-05-10T23:28:05.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:27:00+00:00, map_index=-1, run_start_date=2024-05-10 23:28:02.595601+00:00, run_end_date=2024-05-10 23:28:04.554953+00:00, run_duration=1.959352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:28:00.581585+00:00, queued_by_job_id=2, pid=4132 2024-05-10T23:29:00.090127660Z [2024-05-10T23:29:00.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:29:00.120648028Z [2024-05-10T23:29:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:29:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:29:00.133553099Z [2024-05-10T23:29:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:29:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:29:00.197621944Z [2024-05-10T23:29:00.196+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:29:00.197659080Z 2024-05-10T23:29:00.197663148Z 2024-05-10T23:29:00.197666780Z 2024-05-10T23:29:00.198320051Z [2024-05-10T23:29:00.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:29:00.199236201Z [2024-05-10T23:29:00.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:29:00.199977434Z [2024-05-10T23:29:00.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:29:00.203369640Z [2024-05-10T23:29:00.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:29:00.203387288Z 2024-05-10T23:29:00.203391950Z 2024-05-10T23:29:00.203396188Z 2024-05-10T23:29:00.210452832Z [2024-05-10T23:29:00.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:29:00.210860314Z [2024-05-10T23:29:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:29:00.211462745Z [2024-05-10T23:29:00.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:29:00.212005821Z [2024-05-10T23:29:00.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:29:00.212423414Z [2024-05-10T23:29:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:29:00.212661935Z [2024-05-10T23:29:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:29:00.755396496Z [2024-05-10T23:29:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status queued for try_number 1 2024-05-10T23:29:00.755431229Z [2024-05-10T23:29:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status queued for try_number 1 2024-05-10T23:29:00.755474866Z [2024-05-10T23:29:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status queued for try_number 1 2024-05-10T23:29:00.774637188Z [2024-05-10T23:29:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26da115f-d515-48f4-a65b-0e7e37a24cf3 2024-05-10T23:29:00.774710875Z [2024-05-10T23:29:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9517d02e-f1ab-4b34-9216-702dbf1c9876 2024-05-10T23:29:00.774720325Z [2024-05-10T23:29:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cccab82-aa6e-4a72-a783-d57b1aacc2a0 2024-05-10T23:29:02.027045887Z [2024-05-10T23:29:02.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:29:02.027349346Z [2024-05-10T23:29:02.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:28:00+00:00, run_id=scheduled__2024-05-10T23:28:00+00:00, run_start_date=2024-05-10 23:29:00.143865+00:00, run_end_date=2024-05-10 23:29:02.026934+00:00, run_duration=1.883069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:28:00+00:00, data_interval_end=2024-05-10 23:29:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:29:02.041521725Z [2024-05-10T23:29:02.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:29:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:29:02.088207666Z [2024-05-10T23:29:02.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status success for try_number 1 2024-05-10T23:29:02.099179700Z [2024-05-10T23:29:02.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:28:00+00:00, map_index=-1, run_start_date=2024-05-10 23:29:01.411980+00:00, run_end_date=2024-05-10 23:29:01.861549+00:00, run_duration=0.449569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:29:00.205376+00:00, queued_by_job_id=2, pid=4165 2024-05-10T23:29:04.952528478Z [2024-05-10T23:29:04.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:29:04.953238318Z [2024-05-10T23:29:04.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:28:00+00:00, run_id=scheduled__2024-05-10T23:28:00+00:00, run_start_date=2024-05-10 23:29:00.146152+00:00, run_end_date=2024-05-10 23:29:04.952529+00:00, run_duration=4.806377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:28:00+00:00, data_interval_end=2024-05-10 23:29:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:29:04.970682741Z [2024-05-10T23:29:04.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:29:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:29:04.981292507Z [2024-05-10T23:29:04.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:29:04.981456007Z [2024-05-10T23:29:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:28:00+00:00, run_id=scheduled__2024-05-10T23:28:00+00:00, run_start_date=2024-05-10 23:29:00.145161+00:00, run_end_date=2024-05-10 23:29:04.981120+00:00, run_duration=4.835959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:28:00+00:00, data_interval_end=2024-05-10 23:29:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:29:04.994318313Z [2024-05-10T23:29:04.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:29:00+00:00, run_after=2024-05-10T23:30:00+00:00 2024-05-10T23:29:05.045608926Z [2024-05-10T23:29:05.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status success for try_number 1 2024-05-10T23:29:05.045983446Z [2024-05-10T23:29:05.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status success for try_number 1 2024-05-10T23:29:05.056021355Z [2024-05-10T23:29:05.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:28:00+00:00, map_index=-1, run_start_date=2024-05-10 23:29:02.484468+00:00, run_end_date=2024-05-10 23:29:03.858393+00:00, run_duration=1.373925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:29:00.205376+00:00, queued_by_job_id=2, pid=4178 2024-05-10T23:29:05.056057994Z [2024-05-10T23:29:05.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:28:00+00:00, map_index=-1, run_start_date=2024-05-10 23:29:02.723649+00:00, run_end_date=2024-05-10 23:29:04.481094+00:00, run_duration=1.757445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:29:00.205376+00:00, queued_by_job_id=2, pid=4184 2024-05-10T23:30:01.017711334Z [2024-05-10T23:30:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:30:01.028931101Z [2024-05-10T23:30:01.027+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:30:01.045947165Z [2024-05-10T23:30:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:30:01.060923582Z [2024-05-10T23:30:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:31:00+00:00 2024-05-10T23:30:01.086542333Z [2024-05-10T23:30:01.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:31:00+00:00 2024-05-10T23:30:01.223736306Z [2024-05-10T23:30:01.223+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T23:30:01.223771930Z 2024-05-10T23:30:01.223775753Z 2024-05-10T23:30:01.223783466Z 2024-05-10T23:30:01.223786737Z 2024-05-10T23:30:01.223790105Z 2024-05-10T23:30:01.224008785Z [2024-05-10T23:30:01.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:30:01.224223042Z [2024-05-10T23:30:01.224+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:30:01.224427728Z [2024-05-10T23:30:01.224+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:30:01.224585090Z [2024-05-10T23:30:01.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:30:01.224792962Z [2024-05-10T23:30:01.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:30:01.225684977Z [2024-05-10T23:30:01.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:30:01.225696108Z 2024-05-10T23:30:01.225700198Z 2024-05-10T23:30:01.225703568Z 2024-05-10T23:30:01.225706908Z 2024-05-10T23:30:01.225710047Z 2024-05-10T23:30:01.229593214Z [2024-05-10T23:30:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:30:01.229779244Z [2024-05-10T23:30:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:30:01.230101581Z [2024-05-10T23:30:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:30:01.230248708Z [2024-05-10T23:30:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:30:01.230490932Z [2024-05-10T23:30:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:30:01.230612127Z [2024-05-10T23:30:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:30:01.230836191Z [2024-05-10T23:30:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:30:01.230998584Z [2024-05-10T23:30:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:30:01.231203743Z [2024-05-10T23:30:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:30:01.231334074Z [2024-05-10T23:30:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:30:01.768409952Z [2024-05-10T23:30:01.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:01.769204711Z [2024-05-10T23:30:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:01.769404988Z [2024-05-10T23:30:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:29:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:01.769506120Z [2024-05-10T23:30:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:29:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:01.769651611Z [2024-05-10T23:30:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:29:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:01.792535956Z [2024-05-10T23:30:01.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc66060a-cb26-41e7-b3bd-7df36eae6877 2024-05-10T23:30:01.798149086Z [2024-05-10T23:30:01.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 833feec0-9d2a-405a-80c4-6ac7f0c02c9b 2024-05-10T23:30:01.798429600Z [2024-05-10T23:30:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1af61946-3ef2-49a7-9899-c39e114fa82b 2024-05-10T23:30:01.798592083Z [2024-05-10T23:30:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to e285551b-15f4-4979-8235-15e1cbb6eb20 2024-05-10T23:30:01.798751697Z [2024-05-10T23:30:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d133cf7-ce7a-44b8-9957-eed00858a4d5 2024-05-10T23:30:02.960044578Z [2024-05-10T23:30:02.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:30:02.960469752Z [2024-05-10T23:30:02.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:28:00+00:00, run_id=scheduled__2024-05-10T23:28:00+00:00, run_start_date=2024-05-10 23:30:01.130881+00:00, run_end_date=2024-05-10 23:30:02.960106+00:00, run_duration=1.829225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:28:00+00:00, data_interval_end=2024-05-10 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:30:02.968294307Z [2024-05-10T23:30:02.967+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:32:00+00:00 2024-05-10T23:30:02.987601109Z [2024-05-10T23:30:02.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:30:02.987936596Z [2024-05-10T23:30:02.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:29:00+00:00, run_id=scheduled__2024-05-10T23:29:00+00:00, run_start_date=2024-05-10 23:30:01.132505+00:00, run_end_date=2024-05-10 23:30:02.987508+00:00, run_duration=1.855003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:29:00+00:00, data_interval_end=2024-05-10 23:30:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:30:02.998162396Z [2024-05-10T23:30:02.997+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:31:00+00:00 2024-05-10T23:30:03.051616444Z [2024-05-10T23:30:03.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:28:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:03.051841602Z [2024-05-10T23:30:03.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:29:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:03.060976298Z [2024-05-10T23:30:03.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:29:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:02.259953+00:00, run_end_date=2024-05-10 23:30:02.651019+00:00, run_duration=0.391066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:01.226804+00:00, queued_by_job_id=2, pid=4219 2024-05-10T23:30:03.061398433Z [2024-05-10T23:30:03.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:28:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:02.190886+00:00, run_end_date=2024-05-10 23:30:02.660700+00:00, run_duration=0.469814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:01.226804+00:00, queued_by_job_id=2, pid=4218 2024-05-10T23:30:04.173257887Z [2024-05-10T23:30:04.172+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:30:04.173304369Z 2024-05-10T23:30:04.173833081Z [2024-05-10T23:30:04.173+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:30:04.175177260Z [2024-05-10T23:30:04.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:30:04.175208969Z 2024-05-10T23:30:04.179783068Z [2024-05-10T23:30:04.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:30:04.179971920Z [2024-05-10T23:30:04.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:30:04.240308764Z [2024-05-10T23:30:04.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:04.240465837Z [2024-05-10T23:30:04.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:04.247820778Z [2024-05-10T23:30:04.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cd47a26-21ff-4f7d-931c-54d281fe3b76 2024-05-10T23:30:04.248044123Z [2024-05-10T23:30:04.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:03.619060+00:00, run_end_date=2024-05-10 23:30:03.986884+00:00, run_duration=0.367824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:01.226804+00:00, queued_by_job_id=2, pid=4250 2024-05-10T23:30:05.449669781Z [2024-05-10T23:30:05.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:30:05.450239711Z [2024-05-10T23:30:05.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:29:00+00:00, run_id=scheduled__2024-05-10T23:29:00+00:00, run_start_date=2024-05-10 23:30:01.134066+00:00, run_end_date=2024-05-10 23:30:05.449586+00:00, run_duration=4.31552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:29:00+00:00, data_interval_end=2024-05-10 23:30:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:30:05.460765735Z [2024-05-10T23:30:05.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:31:00+00:00 2024-05-10T23:30:05.527586801Z [2024-05-10T23:30:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:29:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:05.528196668Z [2024-05-10T23:30:05.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:29:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:05.537392656Z [2024-05-10T23:30:05.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:29:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:03.564761+00:00, run_end_date=2024-05-10 23:30:05.350804+00:00, run_duration=1.786043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:01.226804+00:00, queued_by_job_id=2, pid=4249 2024-05-10T23:30:05.538030354Z [2024-05-10T23:30:05.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:29:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:03.527449+00:00, run_end_date=2024-05-10 23:30:05.060227+00:00, run_duration=1.532778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:01.226804+00:00, queued_by_job_id=2, pid=4248 2024-05-10T23:30:06.123659973Z [2024-05-10T23:30:06.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:30:06.123941291Z [2024-05-10T23:30:06.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:29:00+00:00, run_id=scheduled__2024-05-10T23:29:00+00:00, run_start_date=2024-05-10 23:30:01.135444+00:00, run_end_date=2024-05-10 23:30:06.123560+00:00, run_duration=4.988116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:29:00+00:00, data_interval_end=2024-05-10 23:30:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:30:06.135059033Z [2024-05-10T23:30:06.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:31:00+00:00 2024-05-10T23:30:07.283587487Z [2024-05-10T23:30:07.283+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:30:07.283634019Z 2024-05-10T23:30:07.284477586Z [2024-05-10T23:30:07.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:30:07.285977934Z [2024-05-10T23:30:07.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:30:07.286005535Z 2024-05-10T23:30:07.290477438Z [2024-05-10T23:30:07.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:30:07.290812870Z [2024-05-10T23:30:07.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:30:07.353706351Z [2024-05-10T23:30:07.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:07.354003921Z [2024-05-10T23:30:07.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:07.360012148Z [2024-05-10T23:30:07.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to a51b3cd5-18af-44f9-b86f-a067377ac721 2024-05-10T23:30:07.360366806Z [2024-05-10T23:30:07.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:05.844423+00:00, run_end_date=2024-05-10 23:30:06.174414+00:00, run_duration=0.329991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:04.175914+00:00, queued_by_job_id=2, pid=4282 2024-05-10T23:30:10.333047320Z [2024-05-10T23:30:10.332+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:30:10.333079304Z 2024-05-10T23:30:10.333188024Z [2024-05-10T23:30:10.332+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:30:10.334131070Z [2024-05-10T23:30:10.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:30:10.334142946Z 2024-05-10T23:30:10.336392267Z [2024-05-10T23:30:10.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:30:10.336501275Z [2024-05-10T23:30:10.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:30:10.406689249Z [2024-05-10T23:30:10.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status queued for try_number 1 2024-05-10T23:30:10.406854391Z [2024-05-10T23:30:10.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:10.415411506Z [2024-05-10T23:30:10.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47f23e5c-1a4e-4f56-ad6e-05ab1652d7c7 2024-05-10T23:30:10.415812156Z [2024-05-10T23:30:10.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=0, run_start_date=2024-05-10 23:30:08.947817+00:00, run_end_date=2024-05-10 23:30:09.358906+00:00, run_duration=0.411089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:07.287048+00:00, queued_by_job_id=2, pid=4293 2024-05-10T23:30:12.644405343Z [2024-05-10T23:30:12.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:30:12.644867194Z [2024-05-10T23:30:12.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:25:00+00:00, run_id=scheduled__2024-05-10T23:25:00+00:00, run_start_date=2024-05-10 23:30:01.128895+00:00, run_end_date=2024-05-10 23:30:12.644500+00:00, run_duration=11.515605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:25:00+00:00, data_interval_end=2024-05-10 23:30:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:30:12.651990056Z [2024-05-10T23:30:12.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:30:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:30:12.679483168Z [2024-05-10T23:30:12.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:25:00+00:00 exited with status success for try_number 1 2024-05-10T23:30:12.684544639Z [2024-05-10T23:30:12.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:25:00+00:00, map_index=-1, run_start_date=2024-05-10 23:30:12.050744+00:00, run_end_date=2024-05-10 23:30:12.359405+00:00, run_duration=0.308661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:30:10.334512+00:00, queued_by_job_id=2, pid=4301 2024-05-10T23:30:33.907154488Z [2024-05-10T23:30:33.906+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:31:01.056016073Z [2024-05-10T23:31:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:31:00+00:00, run_after=2024-05-10T23:32:00+00:00 2024-05-10T23:31:01.073955367Z [2024-05-10T23:31:01.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:31:01.079979016Z [2024-05-10T23:31:01.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:31:00+00:00, run_after=2024-05-10T23:32:00+00:00 2024-05-10T23:31:01.145310754Z [2024-05-10T23:31:01.144+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:31:01.145336923Z 2024-05-10T23:31:01.145340551Z 2024-05-10T23:31:01.145343705Z 2024-05-10T23:31:01.145509292Z [2024-05-10T23:31:01.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:31:01.145760229Z [2024-05-10T23:31:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:31:01.146037262Z [2024-05-10T23:31:01.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:31:01.146567775Z [2024-05-10T23:31:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:31:01.146579395Z 2024-05-10T23:31:01.146582790Z 2024-05-10T23:31:01.146585757Z 2024-05-10T23:31:01.149645451Z [2024-05-10T23:31:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:31:01.149873283Z [2024-05-10T23:31:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:31:01.150237916Z [2024-05-10T23:31:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:31:01.150454070Z [2024-05-10T23:31:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:31:01.150743945Z [2024-05-10T23:31:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:31:01.150971537Z [2024-05-10T23:31:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:31:01.369733275Z [2024-05-10T23:31:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:31:01.370060123Z [2024-05-10T23:31:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:31:01.370416306Z [2024-05-10T23:31:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:31:01.381184185Z [2024-05-10T23:31:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92f97e99-a1c3-4100-bc00-546f0ec9e690 2024-05-10T23:31:01.381457748Z [2024-05-10T23:31:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to c58dfdaa-5ae5-49b6-ac0a-bc725de849a1 2024-05-10T23:31:01.381771994Z [2024-05-10T23:31:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e088a97-401c-40f4-9f72-9c25e7b9788e 2024-05-10T23:31:02.551559578Z [2024-05-10T23:31:02.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:31:02.551584839Z [2024-05-10T23:31:02.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:30:00+00:00, run_id=scheduled__2024-05-10T23:30:00+00:00, run_start_date=2024-05-10 23:31:01.096092+00:00, run_end_date=2024-05-10 23:31:02.550510+00:00, run_duration=1.454418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:30:00+00:00, data_interval_end=2024-05-10 23:31:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:31:02.562168175Z [2024-05-10T23:31:02.560+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:31:00+00:00, run_after=2024-05-10T23:32:00+00:00 2024-05-10T23:31:02.606278102Z [2024-05-10T23:31:02.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:31:02.610662844Z [2024-05-10T23:31:02.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:31:01.902666+00:00, run_end_date=2024-05-10 23:31:02.352493+00:00, run_duration=0.449827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:31:01.147219+00:00, queued_by_job_id=2, pid=4310 2024-05-10T23:31:05.724065236Z [2024-05-10T23:31:05.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:31:05.724391523Z [2024-05-10T23:31:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:30:00+00:00, run_id=scheduled__2024-05-10T23:30:00+00:00, run_start_date=2024-05-10 23:31:01.097617+00:00, run_end_date=2024-05-10 23:31:05.723830+00:00, run_duration=4.626213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:30:00+00:00, data_interval_end=2024-05-10 23:31:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:31:05.733432793Z [2024-05-10T23:31:05.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:31:00+00:00, run_after=2024-05-10T23:32:00+00:00 2024-05-10T23:31:05.769266058Z [2024-05-10T23:31:05.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:31:05.774798468Z [2024-05-10T23:31:05.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:31:03.157036+00:00, run_end_date=2024-05-10 23:31:05.134283+00:00, run_duration=1.977247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:31:01.147219+00:00, queued_by_job_id=2, pid=4329 2024-05-10T23:31:07.514389490Z [2024-05-10T23:31:07.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:31:07.514991262Z [2024-05-10T23:31:07.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:30:00+00:00, run_id=scheduled__2024-05-10T23:30:00+00:00, run_start_date=2024-05-10 23:31:01.098802+00:00, run_end_date=2024-05-10 23:31:07.514260+00:00, run_duration=6.415458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:30:00+00:00, data_interval_end=2024-05-10 23:31:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:31:07.532870544Z [2024-05-10T23:31:07.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:31:00+00:00, run_after=2024-05-10T23:32:00+00:00 2024-05-10T23:31:07.577053858Z [2024-05-10T23:31:07.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:31:07.588848275Z [2024-05-10T23:31:07.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:31:03.006666+00:00, run_end_date=2024-05-10 23:31:06.448813+00:00, run_duration=3.442147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:31:01.147219+00:00, queued_by_job_id=2, pid=4328 2024-05-10T23:32:00.952556742Z [2024-05-10T23:32:00.952+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:32:00.959849253Z [2024-05-10T23:32:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:32:00.973086731Z [2024-05-10T23:32:00.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:32:00+00:00, run_after=2024-05-10T23:33:00+00:00 2024-05-10T23:32:00.986899314Z [2024-05-10T23:32:00.986+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:32:00+00:00, run_after=2024-05-10T23:33:00+00:00 2024-05-10T23:32:01.094213467Z [2024-05-10T23:32:01.092+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:32:01.094248529Z 2024-05-10T23:32:01.094253009Z 2024-05-10T23:32:01.094256137Z 2024-05-10T23:32:01.094258992Z 2024-05-10T23:32:01.094262709Z [2024-05-10T23:32:01.092+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:32:01.094265804Z [2024-05-10T23:32:01.092+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:32:01.094268692Z [2024-05-10T23:32:01.093+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:32:01.094271620Z [2024-05-10T23:32:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:32:01.097964173Z [2024-05-10T23:32:01.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:32:01.097985663Z 2024-05-10T23:32:01.097989487Z 2024-05-10T23:32:01.097992715Z 2024-05-10T23:32:01.097995831Z 2024-05-10T23:32:01.127712576Z [2024-05-10T23:32:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:32:01.127734549Z [2024-05-10T23:32:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:32:01.127738442Z [2024-05-10T23:32:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:32:01.127741473Z [2024-05-10T23:32:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:32:01.127744551Z [2024-05-10T23:32:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:32:01.127747934Z [2024-05-10T23:32:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:32:01.127765715Z [2024-05-10T23:32:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:32:01.127768948Z [2024-05-10T23:32:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:32:01.606167161Z [2024-05-10T23:32:01.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:32:01.606266037Z [2024-05-10T23:32:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:31:00+00:00 exited with status queued for try_number 1 2024-05-10T23:32:01.606296885Z [2024-05-10T23:32:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:31:00+00:00 exited with status queued for try_number 1 2024-05-10T23:32:01.606368763Z [2024-05-10T23:32:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:31:00+00:00 exited with status queued for try_number 1 2024-05-10T23:32:01.615224080Z [2024-05-10T23:32:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac40fcc2-4fad-4db4-87ed-b54f0cc4b1d3 2024-05-10T23:32:01.615324569Z [2024-05-10T23:32:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 495c6910-f6e7-4fae-9a09-167fce779457 2024-05-10T23:32:01.615372731Z [2024-05-10T23:32:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9580f45-f92d-4c5b-8f16-9edc5c851486 2024-05-10T23:32:01.615467523Z [2024-05-10T23:32:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47e8f277-a553-4323-9038-3a7dff81b869 2024-05-10T23:32:02.934009956Z [2024-05-10T23:32:02.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:32:02.934264304Z [2024-05-10T23:32:02.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:30:00+00:00, run_id=scheduled__2024-05-10T23:30:00+00:00, run_start_date=2024-05-10 23:32:00.997521+00:00, run_end_date=2024-05-10 23:32:02.933908+00:00, run_duration=1.936387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:30:00+00:00, data_interval_end=2024-05-10 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:32:02.945380207Z [2024-05-10T23:32:02.944+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:32:00+00:00, run_after=2024-05-10T23:34:00+00:00 2024-05-10T23:32:02.967872326Z [2024-05-10T23:32:02.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:32:02.968037638Z [2024-05-10T23:32:02.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:31:00+00:00, run_id=scheduled__2024-05-10T23:31:00+00:00, run_start_date=2024-05-10 23:32:00.998774+00:00, run_end_date=2024-05-10 23:32:02.967771+00:00, run_duration=1.968997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:31:00+00:00, data_interval_end=2024-05-10 23:32:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:32:02.982812025Z [2024-05-10T23:32:02.982+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:32:00+00:00, run_after=2024-05-10T23:33:00+00:00 2024-05-10T23:32:03.042818193Z [2024-05-10T23:32:03.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:32:03.045453792Z [2024-05-10T23:32:03.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:31:00+00:00 exited with status success for try_number 1 2024-05-10T23:32:03.056818394Z [2024-05-10T23:32:03.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:31:00+00:00, map_index=-1, run_start_date=2024-05-10 23:32:02.336966+00:00, run_end_date=2024-05-10 23:32:02.732314+00:00, run_duration=0.395348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:32:01.095571+00:00, queued_by_job_id=2, pid=4364 2024-05-10T23:32:03.057252507Z [2024-05-10T23:32:03.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:32:02.174612+00:00, run_end_date=2024-05-10 23:32:02.527972+00:00, run_duration=0.35336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:32:01.095571+00:00, queued_by_job_id=2, pid=4363 2024-05-10T23:32:04.962711226Z [2024-05-10T23:32:04.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:32:04.963081390Z [2024-05-10T23:32:04.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:31:00+00:00, run_id=scheduled__2024-05-10T23:31:00+00:00, run_start_date=2024-05-10 23:32:00.999876+00:00, run_end_date=2024-05-10 23:32:04.962767+00:00, run_duration=3.962891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:31:00+00:00, data_interval_end=2024-05-10 23:32:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:32:04.983020818Z [2024-05-10T23:32:04.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:32:00+00:00, run_after=2024-05-10T23:33:00+00:00 2024-05-10T23:32:05.022259497Z [2024-05-10T23:32:05.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:31:00+00:00 exited with status success for try_number 1 2024-05-10T23:32:05.027332160Z [2024-05-10T23:32:05.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:31:00+00:00, map_index=-1, run_start_date=2024-05-10 23:32:03.426311+00:00, run_end_date=2024-05-10 23:32:04.825539+00:00, run_duration=1.399228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:32:01.095571+00:00, queued_by_job_id=2, pid=4388 2024-05-10T23:32:06.088096932Z [2024-05-10T23:32:06.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:32:06.088232373Z [2024-05-10T23:32:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:31:00+00:00, run_id=scheduled__2024-05-10T23:31:00+00:00, run_start_date=2024-05-10 23:32:01.000870+00:00, run_end_date=2024-05-10 23:32:06.087981+00:00, run_duration=5.087111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:31:00+00:00, data_interval_end=2024-05-10 23:32:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:32:06.096811309Z [2024-05-10T23:32:06.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:32:00+00:00, run_after=2024-05-10T23:33:00+00:00 2024-05-10T23:32:06.124674449Z [2024-05-10T23:32:06.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:31:00+00:00 exited with status success for try_number 1 2024-05-10T23:32:06.130502708Z [2024-05-10T23:32:06.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:31:00+00:00, map_index=-1, run_start_date=2024-05-10 23:32:03.234343+00:00, run_end_date=2024-05-10 23:32:05.167309+00:00, run_duration=1.932966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:32:01.095571+00:00, queued_by_job_id=2, pid=4387 2024-05-10T23:33:00.814796174Z [2024-05-10T23:33:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:33:00+00:00, run_after=2024-05-10T23:34:00+00:00 2024-05-10T23:33:00.828995808Z [2024-05-10T23:33:00.828+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:33:00.848862054Z [2024-05-10T23:33:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:33:00+00:00, run_after=2024-05-10T23:34:00+00:00 2024-05-10T23:33:01.010621463Z [2024-05-10T23:33:01.009+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:33:01.010647764Z 2024-05-10T23:33:01.010665140Z 2024-05-10T23:33:01.010668550Z 2024-05-10T23:33:01.010678009Z [2024-05-10T23:33:01.009+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:33:01.010681662Z [2024-05-10T23:33:01.010+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:33:01.013096260Z [2024-05-10T23:33:01.010+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:33:01.013112770Z [2024-05-10T23:33:01.011+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:33:01.013116204Z 2024-05-10T23:33:01.013119336Z 2024-05-10T23:33:01.013130269Z 2024-05-10T23:33:01.022481481Z [2024-05-10T23:33:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:33:01.022566154Z [2024-05-10T23:33:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:33:01.022740968Z [2024-05-10T23:33:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:33:01.022810509Z [2024-05-10T23:33:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:33:01.022971723Z [2024-05-10T23:33:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:33:01.023039505Z [2024-05-10T23:33:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:33:01.944744764Z [2024-05-10T23:33:01.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status queued for try_number 1 2024-05-10T23:33:01.946847065Z [2024-05-10T23:33:01.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status queued for try_number 1 2024-05-10T23:33:01.946968403Z [2024-05-10T23:33:01.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status queued for try_number 1 2024-05-10T23:33:01.955204613Z [2024-05-10T23:33:01.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f130c68-c16e-4c0f-86e2-269d40b34499 2024-05-10T23:33:01.955344924Z [2024-05-10T23:33:01.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a09b39c-a0fc-4165-8c07-d41a13aa63e7 2024-05-10T23:33:01.955498132Z [2024-05-10T23:33:01.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d048c7c-ccc7-4fb0-af24-e8d300e9bb45 2024-05-10T23:33:04.554979600Z [2024-05-10T23:33:04.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:33:04.555227940Z [2024-05-10T23:33:04.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:32:00+00:00, run_id=scheduled__2024-05-10T23:32:00+00:00, run_start_date=2024-05-10 23:33:00.860547+00:00, run_end_date=2024-05-10 23:33:04.554946+00:00, run_duration=3.694399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:32:00+00:00, data_interval_end=2024-05-10 23:33:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:33:04.567566766Z [2024-05-10T23:33:04.567+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:33:00+00:00, run_after=2024-05-10T23:34:00+00:00 2024-05-10T23:33:04.693141796Z [2024-05-10T23:33:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status success for try_number 1 2024-05-10T23:33:04.702518875Z [2024-05-10T23:33:04.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:32:00+00:00, map_index=-1, run_start_date=2024-05-10 23:33:02.911946+00:00, run_end_date=2024-05-10 23:33:03.625267+00:00, run_duration=0.713321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:33:01.011953+00:00, queued_by_job_id=2, pid=4419 2024-05-10T23:33:06.580110447Z [2024-05-10T23:33:06.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:33:06.582199248Z [2024-05-10T23:33:06.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:32:00+00:00, run_id=scheduled__2024-05-10T23:32:00+00:00, run_start_date=2024-05-10 23:33:00.861862+00:00, run_end_date=2024-05-10 23:33:06.581812+00:00, run_duration=5.71995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:32:00+00:00, data_interval_end=2024-05-10 23:33:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:33:06.593502567Z [2024-05-10T23:33:06.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:33:00+00:00, run_after=2024-05-10T23:34:00+00:00 2024-05-10T23:33:06.601450784Z [2024-05-10T23:33:06.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:33:06.601836682Z [2024-05-10T23:33:06.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:32:00+00:00, run_id=scheduled__2024-05-10T23:32:00+00:00, run_start_date=2024-05-10 23:33:00.862974+00:00, run_end_date=2024-05-10 23:33:06.601498+00:00, run_duration=5.738524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:32:00+00:00, data_interval_end=2024-05-10 23:33:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:33:06.611902526Z [2024-05-10T23:33:06.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:33:00+00:00, run_after=2024-05-10T23:34:00+00:00 2024-05-10T23:33:06.647028355Z [2024-05-10T23:33:06.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status success for try_number 1 2024-05-10T23:33:06.647210886Z [2024-05-10T23:33:06.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status success for try_number 1 2024-05-10T23:33:06.656371619Z [2024-05-10T23:33:06.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:32:00+00:00, map_index=-1, run_start_date=2024-05-10 23:33:05.197723+00:00, run_end_date=2024-05-10 23:33:06.368405+00:00, run_duration=1.170682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:33:01.011953+00:00, queued_by_job_id=2, pid=4453 2024-05-10T23:33:06.657376918Z [2024-05-10T23:33:06.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:32:00+00:00, map_index=-1, run_start_date=2024-05-10 23:33:04.832175+00:00, run_end_date=2024-05-10 23:33:06.462050+00:00, run_duration=1.629875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:33:01.011953+00:00, queued_by_job_id=2, pid=4432 2024-05-10T23:34:01.131631282Z [2024-05-10T23:34:01.131+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:34:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:34:01.145480530Z [2024-05-10T23:34:01.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:34:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:34:01.153224380Z [2024-05-10T23:34:01.152+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:34:01.161369201Z [2024-05-10T23:34:01.161+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:34:01.246332113Z [2024-05-10T23:34:01.245+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:34:01.246363873Z 2024-05-10T23:34:01.246368438Z 2024-05-10T23:34:01.246371438Z 2024-05-10T23:34:01.246374436Z 2024-05-10T23:34:01.246514476Z [2024-05-10T23:34:01.246+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:34:01.246658803Z [2024-05-10T23:34:01.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:34:01.246776751Z [2024-05-10T23:34:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:34:01.246890302Z [2024-05-10T23:34:01.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:34:01.247547982Z [2024-05-10T23:34:01.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:34:01.247553522Z 2024-05-10T23:34:01.247557034Z 2024-05-10T23:34:01.247560091Z 2024-05-10T23:34:01.247563243Z 2024-05-10T23:34:01.251522361Z [2024-05-10T23:34:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:34:01.251714590Z [2024-05-10T23:34:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:34:01.252084545Z [2024-05-10T23:34:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:34:01.252244730Z [2024-05-10T23:34:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:34:01.252495422Z [2024-05-10T23:34:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:34:01.252623538Z [2024-05-10T23:34:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:34:01.252839139Z [2024-05-10T23:34:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:34:01.252965077Z [2024-05-10T23:34:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:34:01.858071922Z [2024-05-10T23:34:01.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status queued for try_number 1 2024-05-10T23:34:01.858440031Z [2024-05-10T23:34:01.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:33:00+00:00 exited with status queued for try_number 1 2024-05-10T23:34:01.862324830Z [2024-05-10T23:34:01.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:33:00+00:00 exited with status queued for try_number 1 2024-05-10T23:34:01.862475662Z [2024-05-10T23:34:01.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:33:00+00:00 exited with status queued for try_number 1 2024-05-10T23:34:01.886644983Z [2024-05-10T23:34:01.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90cebd27-cfc2-45ec-951e-bbb677b9b887 2024-05-10T23:34:01.886704031Z [2024-05-10T23:34:01.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16d51b53-d18c-44eb-8735-277eace8d5ac 2024-05-10T23:34:01.886807814Z [2024-05-10T23:34:01.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to b24d20f3-6fa6-4dcc-9ffb-ffb3711e05ef 2024-05-10T23:34:01.886894166Z [2024-05-10T23:34:01.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9948922e-f812-41cd-a77d-2766faf1de8a 2024-05-10T23:34:04.335089786Z [2024-05-10T23:34:04.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:34:04.335425310Z [2024-05-10T23:34:04.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:32:00+00:00, run_id=scheduled__2024-05-10T23:32:00+00:00, run_start_date=2024-05-10 23:34:01.172694+00:00, run_end_date=2024-05-10 23:34:04.335065+00:00, run_duration=3.162371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:32:00+00:00, data_interval_end=2024-05-10 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:34:04.346527626Z [2024-05-10T23:34:04.346+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:34:00+00:00, run_after=2024-05-10T23:36:00+00:00 2024-05-10T23:34:04.369316775Z [2024-05-10T23:34:04.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:34:04.369591045Z [2024-05-10T23:34:04.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:33:00+00:00, run_id=scheduled__2024-05-10T23:33:00+00:00, run_start_date=2024-05-10 23:34:01.174309+00:00, run_end_date=2024-05-10 23:34:04.369279+00:00, run_duration=3.19497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:33:00+00:00, data_interval_end=2024-05-10 23:34:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:34:04.394405940Z [2024-05-10T23:34:04.394+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:34:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:34:04.576067152Z [2024-05-10T23:34:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:32:00+00:00 exited with status success for try_number 1 2024-05-10T23:34:04.588471710Z [2024-05-10T23:34:04.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:32:00+00:00, map_index=-1, run_start_date=2024-05-10 23:34:02.381367+00:00, run_end_date=2024-05-10 23:34:03.169341+00:00, run_duration=0.787974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:34:01.248653+00:00, queued_by_job_id=2, pid=4466 2024-05-10T23:34:05.688466646Z [2024-05-10T23:34:05.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:33:00+00:00 exited with status success for try_number 1 2024-05-10T23:34:05.694236327Z [2024-05-10T23:34:05.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:33:00+00:00, map_index=-1, run_start_date=2024-05-10 23:34:03.445068+00:00, run_end_date=2024-05-10 23:34:04.239464+00:00, run_duration=0.794396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:34:01.248653+00:00, queued_by_job_id=2, pid=4478 2024-05-10T23:34:08.233685750Z [2024-05-10T23:34:08.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:34:08.234193055Z [2024-05-10T23:34:08.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:33:00+00:00, run_id=scheduled__2024-05-10T23:33:00+00:00, run_start_date=2024-05-10 23:34:01.175554+00:00, run_end_date=2024-05-10 23:34:08.233579+00:00, run_duration=7.058025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:33:00+00:00, data_interval_end=2024-05-10 23:34:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:34:08.248989027Z [2024-05-10T23:34:08.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:34:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:34:08.259394815Z [2024-05-10T23:34:08.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:34:08.260113343Z [2024-05-10T23:34:08.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:33:00+00:00, run_id=scheduled__2024-05-10T23:33:00+00:00, run_start_date=2024-05-10 23:34:01.179604+00:00, run_end_date=2024-05-10 23:34:08.259302+00:00, run_duration=7.079698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:33:00+00:00, data_interval_end=2024-05-10 23:34:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:34:08.273462054Z [2024-05-10T23:34:08.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:34:00+00:00, run_after=2024-05-10T23:35:00+00:00 2024-05-10T23:34:08.359817766Z [2024-05-10T23:34:08.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:33:00+00:00 exited with status success for try_number 1 2024-05-10T23:34:08.368202977Z [2024-05-10T23:34:08.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:33:00+00:00 exited with status success for try_number 1 2024-05-10T23:34:08.399595482Z [2024-05-10T23:34:08.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:33:00+00:00, map_index=-1, run_start_date=2024-05-10 23:34:04.443905+00:00, run_end_date=2024-05-10 23:34:07.107277+00:00, run_duration=2.663372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:34:01.248653+00:00, queued_by_job_id=2, pid=4490 2024-05-10T23:34:08.405834365Z [2024-05-10T23:34:08.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:33:00+00:00, map_index=-1, run_start_date=2024-05-10 23:34:05.113515+00:00, run_end_date=2024-05-10 23:34:07.234539+00:00, run_duration=2.121024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:34:01.248653+00:00, queued_by_job_id=2, pid=4501 2024-05-10T23:35:00.184130841Z [2024-05-10T23:35:00.183+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:35:00.198876952Z [2024-05-10T23:35:00.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:36:00+00:00 2024-05-10T23:35:00.213720275Z [2024-05-10T23:35:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:36:00+00:00 2024-05-10T23:35:00.225890142Z [2024-05-10T23:35:00.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:35:00.353966168Z [2024-05-10T23:35:00.351+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:35:00.353994574Z 2024-05-10T23:35:00.353998533Z 2024-05-10T23:35:00.354001973Z 2024-05-10T23:35:00.354004997Z 2024-05-10T23:35:00.354008049Z [2024-05-10T23:35:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:35:00.354011533Z [2024-05-10T23:35:00.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:35:00.354014576Z [2024-05-10T23:35:00.352+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:35:00.354017713Z [2024-05-10T23:35:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:35:00.354128322Z [2024-05-10T23:35:00.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:35:00.354150265Z 2024-05-10T23:35:00.354160029Z 2024-05-10T23:35:00.354164341Z 2024-05-10T23:35:00.354169130Z 2024-05-10T23:35:00.360571663Z [2024-05-10T23:35:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:35:00.360858103Z [2024-05-10T23:35:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:35:00.361483767Z [2024-05-10T23:35:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:35:00.361520249Z [2024-05-10T23:35:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:35:00.363162144Z [2024-05-10T23:35:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:35:00.363196380Z [2024-05-10T23:35:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:35:00.363602007Z [2024-05-10T23:35:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:35:00.363984652Z [2024-05-10T23:35:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:35:00.924787176Z [2024-05-10T23:35:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:00.927076898Z [2024-05-10T23:35:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:00.927237176Z [2024-05-10T23:35:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:00.927373017Z [2024-05-10T23:35:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:00.941820931Z [2024-05-10T23:35:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5395dcdb-2b64-4696-912b-ed9d67aa60b8 2024-05-10T23:35:00.942583310Z [2024-05-10T23:35:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 413d845a-c288-4e42-8f7c-b22864710415 2024-05-10T23:35:00.942822829Z [2024-05-10T23:35:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67af3106-4c40-45a4-b162-d0c705ac275c 2024-05-10T23:35:00.943062745Z [2024-05-10T23:35:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb9c6f69-9e4a-4cb3-8ff8-f5dd2f9d346e 2024-05-10T23:35:02.343416562Z [2024-05-10T23:35:02.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:35:02.343776606Z [2024-05-10T23:35:02.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:34:00+00:00, run_id=scheduled__2024-05-10T23:34:00+00:00, run_start_date=2024-05-10 23:35:00.238415+00:00, run_end_date=2024-05-10 23:35:02.343367+00:00, run_duration=2.104952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:34:00+00:00, data_interval_end=2024-05-10 23:35:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:35:02.364493482Z [2024-05-10T23:35:02.364+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:36:00+00:00 2024-05-10T23:35:02.444664538Z [2024-05-10T23:35:02.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:02.455209495Z [2024-05-10T23:35:02.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:34:00+00:00, map_index=-1, run_start_date=2024-05-10 23:35:01.214228+00:00, run_end_date=2024-05-10 23:35:01.638704+00:00, run_duration=0.424476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:00.355823+00:00, queued_by_job_id=2, pid=4528 2024-05-10T23:35:03.565419818Z [2024-05-10T23:35:03.564+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:35:03.565449184Z 2024-05-10T23:35:03.565746163Z [2024-05-10T23:35:03.565+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:35:03.567700215Z [2024-05-10T23:35:03.567+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:35:03.567713097Z 2024-05-10T23:35:03.573186415Z [2024-05-10T23:35:03.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:35:03.573209473Z [2024-05-10T23:35:03.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:35:03.626819563Z [2024-05-10T23:35:03.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:03.626908725Z [2024-05-10T23:35:03.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:03.633912176Z [2024-05-10T23:35:03.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to d199e5a2-964d-4e28-ac16-0e73cafdbb9a 2024-05-10T23:35:03.634221725Z [2024-05-10T23:35:03.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:35:02.340331+00:00, run_end_date=2024-05-10 23:35:02.656558+00:00, run_duration=0.316227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:00.355823+00:00, queued_by_job_id=2, pid=4552 2024-05-10T23:35:04.199028965Z [2024-05-10T23:35:04.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:35:04.199432403Z [2024-05-10T23:35:04.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:34:00+00:00, run_id=scheduled__2024-05-10T23:34:00+00:00, run_start_date=2024-05-10 23:35:00.240292+00:00, run_end_date=2024-05-10 23:35:04.198958+00:00, run_duration=3.958666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:34:00+00:00, data_interval_end=2024-05-10 23:35:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:35:04.209634814Z [2024-05-10T23:35:04.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:36:00+00:00 2024-05-10T23:35:04.216482340Z [2024-05-10T23:35:04.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:35:04.216923690Z [2024-05-10T23:35:04.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:34:00+00:00, run_id=scheduled__2024-05-10T23:34:00+00:00, run_start_date=2024-05-10 23:35:00.239370+00:00, run_end_date=2024-05-10 23:35:04.216525+00:00, run_duration=3.977155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:34:00+00:00, data_interval_end=2024-05-10 23:35:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:35:04.227444184Z [2024-05-10T23:35:04.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:36:00+00:00 2024-05-10T23:35:04.278813462Z [2024-05-10T23:35:04.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:04.279175434Z [2024-05-10T23:35:04.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:04.287185366Z [2024-05-10T23:35:04.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:34:00+00:00, map_index=-1, run_start_date=2024-05-10 23:35:02.376822+00:00, run_end_date=2024-05-10 23:35:03.703066+00:00, run_duration=1.326244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:00.355823+00:00, queued_by_job_id=2, pid=4554 2024-05-10T23:35:04.287969435Z [2024-05-10T23:35:04.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:34:00+00:00, map_index=-1, run_start_date=2024-05-10 23:35:02.371053+00:00, run_end_date=2024-05-10 23:35:04.009520+00:00, run_duration=1.638467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:00.355823+00:00, queued_by_job_id=2, pid=4553 2024-05-10T23:35:06.370113798Z [2024-05-10T23:35:06.366+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:35:06.370139795Z 2024-05-10T23:35:06.370143339Z [2024-05-10T23:35:06.366+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:35:06.370155660Z [2024-05-10T23:35:06.367+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:35:06.370159006Z 2024-05-10T23:35:06.374996774Z [2024-05-10T23:35:06.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:35:06.375018799Z [2024-05-10T23:35:06.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:35:06.443682409Z [2024-05-10T23:35:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:06.443706428Z [2024-05-10T23:35:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:06.449806827Z [2024-05-10T23:35:06.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cd44404-6864-4937-bbb0-e3a768915c4d 2024-05-10T23:35:06.450053417Z [2024-05-10T23:35:06.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:35:05.210573+00:00, run_end_date=2024-05-10 23:35:05.535659+00:00, run_duration=0.325086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:03.568528+00:00, queued_by_job_id=2, pid=4588 2024-05-10T23:35:08.472605358Z [2024-05-10T23:35:08.472+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:35:08.472633165Z 2024-05-10T23:35:08.472759594Z [2024-05-10T23:35:08.472+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:35:08.473342560Z [2024-05-10T23:35:08.473+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:35:08.473354900Z 2024-05-10T23:35:08.475703735Z [2024-05-10T23:35:08.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:35:08.475937443Z [2024-05-10T23:35:08.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:35:08.538785422Z [2024-05-10T23:35:08.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status queued for try_number 1 2024-05-10T23:35:08.549689284Z [2024-05-10T23:35:08.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67079aae-5e5b-499a-a19a-89666e12ab98 2024-05-10T23:35:08.619069669Z [2024-05-10T23:35:08.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:08.623833774Z [2024-05-10T23:35:08.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=0, run_start_date=2024-05-10 23:35:08.063166+00:00, run_end_date=2024-05-10 23:35:08.393666+00:00, run_duration=0.3305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:06.368543+00:00, queued_by_job_id=2, pid=4599 2024-05-10T23:35:10.459443756Z [2024-05-10T23:35:10.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:35:10.459626733Z [2024-05-10T23:35:10.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:30:00+00:00, run_id=scheduled__2024-05-10T23:30:00+00:00, run_start_date=2024-05-10 23:35:00.237236+00:00, run_end_date=2024-05-10 23:35:10.459321+00:00, run_duration=10.222085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:30:00+00:00, data_interval_end=2024-05-10 23:35:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:35:10.466962337Z [2024-05-10T23:35:10.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:35:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:35:11.563165715Z [2024-05-10T23:35:11.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:30:00+00:00 exited with status success for try_number 1 2024-05-10T23:35:11.568664363Z [2024-05-10T23:35:11.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:30:00+00:00, map_index=-1, run_start_date=2024-05-10 23:35:10.072838+00:00, run_end_date=2024-05-10 23:35:10.433873+00:00, run_duration=0.361035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:35:08.473742+00:00, queued_by_job_id=2, pid=4607 2024-05-10T23:35:33.974422376Z [2024-05-10T23:35:33.973+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:36:00.069589498Z [2024-05-10T23:36:00.069+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:36:00.090223445Z [2024-05-10T23:36:00.089+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:36:00+00:00, run_after=2024-05-10T23:37:00+00:00 2024-05-10T23:36:00.127504449Z [2024-05-10T23:36:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:36:00.146738038Z [2024-05-10T23:36:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:36:00+00:00, run_after=2024-05-10T23:37:00+00:00 2024-05-10T23:36:00.230048441Z [2024-05-10T23:36:00.229+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:36:00.230092168Z 2024-05-10T23:36:00.230102213Z 2024-05-10T23:36:00.230111160Z 2024-05-10T23:36:00.230119552Z 2024-05-10T23:36:00.230130582Z [2024-05-10T23:36:00.229+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:36:00.230258625Z [2024-05-10T23:36:00.229+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:36:00.230280087Z [2024-05-10T23:36:00.229+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:36:00.230288497Z [2024-05-10T23:36:00.230+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:36:00.230832019Z [2024-05-10T23:36:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:36:00.230873775Z 2024-05-10T23:36:00.230900515Z 2024-05-10T23:36:00.230941902Z 2024-05-10T23:36:00.230950884Z 2024-05-10T23:36:00.234914177Z [2024-05-10T23:36:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:36:00.235070692Z [2024-05-10T23:36:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:36:00.235086210Z [2024-05-10T23:36:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:36:00.235213438Z [2024-05-10T23:36:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:36:00.235407162Z [2024-05-10T23:36:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:36:00.235419650Z [2024-05-10T23:36:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:36:00.235555959Z [2024-05-10T23:36:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:36:00.235679353Z [2024-05-10T23:36:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:36:00.703730986Z [2024-05-10T23:36:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status queued for try_number 1 2024-05-10T23:36:00.703868755Z [2024-05-10T23:36:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:36:00.703974526Z [2024-05-10T23:36:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:36:00.704102515Z [2024-05-10T23:36:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:36:00.715148592Z [2024-05-10T23:36:00.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e1cd8cd-37b4-4f64-8b0d-4728bfa16308 2024-05-10T23:36:00.715229217Z [2024-05-10T23:36:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8460244a-b3d1-4b5c-a947-4bb6f3193787 2024-05-10T23:36:00.715301251Z [2024-05-10T23:36:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35a9709b-c67c-4ab2-90a4-c8955c0c2ce7 2024-05-10T23:36:00.715422013Z [2024-05-10T23:36:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11425203-4010-4177-bda0-6f888d50a282 2024-05-10T23:36:01.952716392Z [2024-05-10T23:36:01.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:36:01.953055411Z [2024-05-10T23:36:01.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:34:00+00:00, run_id=scheduled__2024-05-10T23:34:00+00:00, run_start_date=2024-05-10 23:36:00.164753+00:00, run_end_date=2024-05-10 23:36:01.952589+00:00, run_duration=1.787836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:34:00+00:00, data_interval_end=2024-05-10 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:36:01.965701887Z [2024-05-10T23:36:01.965+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:36:00+00:00, run_after=2024-05-10T23:38:00+00:00 2024-05-10T23:36:02.090840714Z [2024-05-10T23:36:02.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:34:00+00:00 exited with status success for try_number 1 2024-05-10T23:36:02.107104366Z [2024-05-10T23:36:02.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:34:00+00:00, map_index=-1, run_start_date=2024-05-10 23:36:01.350960+00:00, run_end_date=2024-05-10 23:36:01.902831+00:00, run_duration=0.551871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:36:00.231516+00:00, queued_by_job_id=2, pid=4617 2024-05-10T23:36:03.166580601Z [2024-05-10T23:36:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:36:03.167090423Z [2024-05-10T23:36:03.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:35:00+00:00, run_id=scheduled__2024-05-10T23:35:00+00:00, run_start_date=2024-05-10 23:36:00.166142+00:00, run_end_date=2024-05-10 23:36:03.166563+00:00, run_duration=3.000421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:35:00+00:00, data_interval_end=2024-05-10 23:36:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:36:03.176362474Z [2024-05-10T23:36:03.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:36:00+00:00, run_after=2024-05-10T23:37:00+00:00 2024-05-10T23:36:03.254885785Z [2024-05-10T23:36:03.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:36:03.262901354Z [2024-05-10T23:36:03.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=-1, run_start_date=2024-05-10 23:36:01.611974+00:00, run_end_date=2024-05-10 23:36:02.140729+00:00, run_duration=0.528755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:36:00.231516+00:00, queued_by_job_id=2, pid=4619 2024-05-10T23:36:05.415160410Z [2024-05-10T23:36:05.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:36:05.415407623Z [2024-05-10T23:36:05.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:35:00+00:00, run_id=scheduled__2024-05-10T23:35:00+00:00, run_start_date=2024-05-10 23:36:00.167420+00:00, run_end_date=2024-05-10 23:36:05.415001+00:00, run_duration=5.247581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:35:00+00:00, data_interval_end=2024-05-10 23:36:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:36:05.426203590Z [2024-05-10T23:36:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:36:00+00:00, run_after=2024-05-10T23:37:00+00:00 2024-05-10T23:36:05.494285098Z [2024-05-10T23:36:05.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:36:05.503649719Z [2024-05-10T23:36:05.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=-1, run_start_date=2024-05-10 23:36:02.662656+00:00, run_end_date=2024-05-10 23:36:04.309333+00:00, run_duration=1.646677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:36:00.231516+00:00, queued_by_job_id=2, pid=4641 2024-05-10T23:36:06.872342575Z [2024-05-10T23:36:06.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:36:06.872509695Z [2024-05-10T23:36:06.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:35:00+00:00, run_id=scheduled__2024-05-10T23:35:00+00:00, run_start_date=2024-05-10 23:36:00.168526+00:00, run_end_date=2024-05-10 23:36:06.872229+00:00, run_duration=6.703703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:35:00+00:00, data_interval_end=2024-05-10 23:36:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:36:06.881157838Z [2024-05-10T23:36:06.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:36:00+00:00, run_after=2024-05-10T23:37:00+00:00 2024-05-10T23:36:06.914218985Z [2024-05-10T23:36:06.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:36:06.919486101Z [2024-05-10T23:36:06.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=-1, run_start_date=2024-05-10 23:36:02.911017+00:00, run_end_date=2024-05-10 23:36:06.182549+00:00, run_duration=3.271532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:36:00.231516+00:00, queued_by_job_id=2, pid=4642 2024-05-10T23:37:00.507087392Z [2024-05-10T23:37:00.506+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:37:00.532016644Z [2024-05-10T23:37:00.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:37:00+00:00, run_after=2024-05-10T23:38:00+00:00 2024-05-10T23:37:00.545870848Z [2024-05-10T23:37:00.545+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:37:00+00:00, run_after=2024-05-10T23:38:00+00:00 2024-05-10T23:37:00.637958896Z [2024-05-10T23:37:00.637+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:37:00.638003802Z 2024-05-10T23:37:00.638013441Z 2024-05-10T23:37:00.638021870Z 2024-05-10T23:37:00.638617676Z [2024-05-10T23:37:00.638+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:37:00.639189393Z [2024-05-10T23:37:00.638+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:37:00.639669207Z [2024-05-10T23:37:00.639+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:37:00.642822238Z [2024-05-10T23:37:00.642+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:37:00.642852423Z 2024-05-10T23:37:00.642860812Z 2024-05-10T23:37:00.642868806Z 2024-05-10T23:37:00.650238559Z [2024-05-10T23:37:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:37:00.650766287Z [2024-05-10T23:37:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:37:00.651240965Z [2024-05-10T23:37:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:37:00.651586147Z [2024-05-10T23:37:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:37:00.652104093Z [2024-05-10T23:37:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:37:00.652431722Z [2024-05-10T23:37:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:37:00.966760443Z [2024-05-10T23:37:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status queued for try_number 1 2024-05-10T23:37:00.966925111Z [2024-05-10T23:37:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status queued for try_number 1 2024-05-10T23:37:00.967100044Z [2024-05-10T23:37:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status queued for try_number 1 2024-05-10T23:37:00.974420412Z [2024-05-10T23:37:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 673b5922-8f81-4264-88c6-decbefc72861 2024-05-10T23:37:00.974629513Z [2024-05-10T23:37:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 417bbd4c-5395-4731-ae4d-b9b706ae43a0 2024-05-10T23:37:00.974816694Z [2024-05-10T23:37:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba44a12f-2ed8-4510-a965-ddc307e53304 2024-05-10T23:37:02.910841762Z [2024-05-10T23:37:02.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:37:02.912275477Z [2024-05-10T23:37:02.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:36:00+00:00, run_id=scheduled__2024-05-10T23:36:00+00:00, run_start_date=2024-05-10 23:37:00.555692+00:00, run_end_date=2024-05-10 23:37:02.911292+00:00, run_duration=2.3556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:36:00+00:00, data_interval_end=2024-05-10 23:37:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:37:02.936974887Z [2024-05-10T23:37:02.936+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:37:00+00:00, run_after=2024-05-10T23:38:00+00:00 2024-05-10T23:37:03.013446788Z [2024-05-10T23:37:03.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status success for try_number 1 2024-05-10T23:37:03.022103601Z [2024-05-10T23:37:03.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:36:00+00:00, map_index=-1, run_start_date=2024-05-10 23:37:01.508005+00:00, run_end_date=2024-05-10 23:37:01.946513+00:00, run_duration=0.438508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:37:00.644835+00:00, queued_by_job_id=2, pid=4673 2024-05-10T23:37:05.184568582Z [2024-05-10T23:37:05.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:37:05.187433544Z [2024-05-10T23:37:05.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:36:00+00:00, run_id=scheduled__2024-05-10T23:36:00+00:00, run_start_date=2024-05-10 23:37:00.557971+00:00, run_end_date=2024-05-10 23:37:05.179081+00:00, run_duration=4.62111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:36:00+00:00, data_interval_end=2024-05-10 23:37:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:37:05.206017667Z [2024-05-10T23:37:05.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:37:00+00:00, run_after=2024-05-10T23:38:00+00:00 2024-05-10T23:37:05.211919257Z [2024-05-10T23:37:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:37:05.211949188Z [2024-05-10T23:37:05.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:36:00+00:00, run_id=scheduled__2024-05-10T23:36:00+00:00, run_start_date=2024-05-10 23:37:00.556884+00:00, run_end_date=2024-05-10 23:37:05.210212+00:00, run_duration=4.653328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:36:00+00:00, data_interval_end=2024-05-10 23:37:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:37:05.220782128Z [2024-05-10T23:37:05.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:37:00+00:00, run_after=2024-05-10T23:38:00+00:00 2024-05-10T23:37:05.249828031Z [2024-05-10T23:37:05.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status success for try_number 1 2024-05-10T23:37:05.250070769Z [2024-05-10T23:37:05.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status success for try_number 1 2024-05-10T23:37:05.258325552Z [2024-05-10T23:37:05.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:36:00+00:00, map_index=-1, run_start_date=2024-05-10 23:37:02.554135+00:00, run_end_date=2024-05-10 23:37:04.715536+00:00, run_duration=2.161401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:37:00.644835+00:00, queued_by_job_id=2, pid=4692 2024-05-10T23:37:05.258756558Z [2024-05-10T23:37:05.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:36:00+00:00, map_index=-1, run_start_date=2024-05-10 23:37:02.536238+00:00, run_end_date=2024-05-10 23:37:04.561798+00:00, run_duration=2.02556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:37:00.644835+00:00, queued_by_job_id=2, pid=4691 2024-05-10T23:38:00.886999287Z [2024-05-10T23:38:00.886+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:38:00.898913607Z [2024-05-10T23:38:00.898+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:38:00.915150566Z [2024-05-10T23:38:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:38:00+00:00, run_after=2024-05-10T23:39:00+00:00 2024-05-10T23:38:00.942113443Z [2024-05-10T23:38:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:38:00+00:00, run_after=2024-05-10T23:39:00+00:00 2024-05-10T23:38:01.053485966Z [2024-05-10T23:38:01.052+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:38:01.053510036Z 2024-05-10T23:38:01.053515008Z 2024-05-10T23:38:01.053518585Z 2024-05-10T23:38:01.053522154Z 2024-05-10T23:38:01.053526752Z [2024-05-10T23:38:01.053+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:38:01.053530118Z [2024-05-10T23:38:01.053+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:38:01.053942746Z [2024-05-10T23:38:01.053+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:38:01.053989616Z [2024-05-10T23:38:01.053+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:38:01.054993366Z [2024-05-10T23:38:01.054+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:38:01.055005202Z 2024-05-10T23:38:01.055009518Z 2024-05-10T23:38:01.055019490Z 2024-05-10T23:38:01.055023421Z 2024-05-10T23:38:01.061987524Z [2024-05-10T23:38:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:38:01.062013394Z [2024-05-10T23:38:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:38:01.062017377Z [2024-05-10T23:38:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:38:01.062020617Z [2024-05-10T23:38:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:38:01.062024142Z [2024-05-10T23:38:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:38:01.062027172Z [2024-05-10T23:38:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:38:01.063459501Z [2024-05-10T23:38:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:38:01.063466202Z [2024-05-10T23:38:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:38:01.391011453Z [2024-05-10T23:38:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status queued for try_number 1 2024-05-10T23:38:01.393259154Z [2024-05-10T23:38:01.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:37:00+00:00 exited with status queued for try_number 1 2024-05-10T23:38:01.393361917Z [2024-05-10T23:38:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:37:00+00:00 exited with status queued for try_number 1 2024-05-10T23:38:01.393459572Z [2024-05-10T23:38:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:37:00+00:00 exited with status queued for try_number 1 2024-05-10T23:38:01.402051235Z [2024-05-10T23:38:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0852f56d-ea03-464c-9837-801f063ad0c0 2024-05-10T23:38:01.402242285Z [2024-05-10T23:38:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40eee5b8-a485-443b-b1b0-d9b6c44a0ac1 2024-05-10T23:38:01.402394599Z [2024-05-10T23:38:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66535848-f10c-4d2b-aa01-4f448c9a5b2e 2024-05-10T23:38:01.402549811Z [2024-05-10T23:38:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ae0924a-dfe0-4157-b560-62c280ee74e6 2024-05-10T23:38:02.578841979Z [2024-05-10T23:38:02.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:38:02.579929657Z [2024-05-10T23:38:02.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:36:00+00:00, run_id=scheduled__2024-05-10T23:36:00+00:00, run_start_date=2024-05-10 23:38:00.955445+00:00, run_end_date=2024-05-10 23:38:02.579440+00:00, run_duration=1.623995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:36:00+00:00, data_interval_end=2024-05-10 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:38:02.587243677Z [2024-05-10T23:38:02.586+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:38:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:38:02.634452659Z [2024-05-10T23:38:02.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:36:00+00:00 exited with status success for try_number 1 2024-05-10T23:38:02.634537264Z [2024-05-10T23:38:02.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:37:00+00:00 exited with status success for try_number 1 2024-05-10T23:38:02.644943356Z [2024-05-10T23:38:02.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:36:00+00:00, map_index=-1, run_start_date=2024-05-10 23:38:01.939586+00:00, run_end_date=2024-05-10 23:38:02.361610+00:00, run_duration=0.422024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:38:01.056479+00:00, queued_by_job_id=2, pid=4725 2024-05-10T23:38:02.645542563Z [2024-05-10T23:38:02.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:37:00+00:00, map_index=-1, run_start_date=2024-05-10 23:38:02.045572+00:00, run_end_date=2024-05-10 23:38:02.504942+00:00, run_duration=0.45937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:38:01.056479+00:00, queued_by_job_id=2, pid=4726 2024-05-10T23:38:02.768070557Z [2024-05-10T23:38:02.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:38:02.768698644Z [2024-05-10T23:38:02.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:37:00+00:00, run_id=scheduled__2024-05-10T23:37:00+00:00, run_start_date=2024-05-10 23:38:00.956904+00:00, run_end_date=2024-05-10 23:38:02.767980+00:00, run_duration=1.811076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:37:00+00:00, data_interval_end=2024-05-10 23:38:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:38:02.781656655Z [2024-05-10T23:38:02.781+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:38:00+00:00, run_after=2024-05-10T23:39:00+00:00 2024-05-10T23:38:05.044587183Z [2024-05-10T23:38:05.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:38:05.045140919Z [2024-05-10T23:38:05.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:37:00+00:00, run_id=scheduled__2024-05-10T23:37:00+00:00, run_start_date=2024-05-10 23:38:00.958271+00:00, run_end_date=2024-05-10 23:38:05.044739+00:00, run_duration=4.086468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:37:00+00:00, data_interval_end=2024-05-10 23:38:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:38:05.057309778Z [2024-05-10T23:38:05.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:38:00+00:00, run_after=2024-05-10T23:39:00+00:00 2024-05-10T23:38:05.110498088Z [2024-05-10T23:38:05.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:37:00+00:00 exited with status success for try_number 1 2024-05-10T23:38:05.118287384Z [2024-05-10T23:38:05.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:37:00+00:00, map_index=-1, run_start_date=2024-05-10 23:38:03.023980+00:00, run_end_date=2024-05-10 23:38:04.539492+00:00, run_duration=1.515512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:38:01.056479+00:00, queued_by_job_id=2, pid=4750 2024-05-10T23:38:06.169033582Z [2024-05-10T23:38:06.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:38:06.169436181Z [2024-05-10T23:38:06.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:37:00+00:00, run_id=scheduled__2024-05-10T23:37:00+00:00, run_start_date=2024-05-10 23:38:00.959474+00:00, run_end_date=2024-05-10 23:38:06.169035+00:00, run_duration=5.209561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:37:00+00:00, data_interval_end=2024-05-10 23:38:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:38:06.177158950Z [2024-05-10T23:38:06.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:38:00+00:00, run_after=2024-05-10T23:39:00+00:00 2024-05-10T23:38:06.205452090Z [2024-05-10T23:38:06.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:37:00+00:00 exited with status success for try_number 1 2024-05-10T23:38:06.210150947Z [2024-05-10T23:38:06.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:37:00+00:00, map_index=-1, run_start_date=2024-05-10 23:38:02.999266+00:00, run_end_date=2024-05-10 23:38:05.126951+00:00, run_duration=2.127685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:38:01.056479+00:00, queued_by_job_id=2, pid=4749 2024-05-10T23:39:00.773019131Z [2024-05-10T23:39:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:39:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:39:00.779128544Z [2024-05-10T23:39:00.778+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:39:00.789489802Z [2024-05-10T23:39:00.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:39:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:39:00.891347983Z [2024-05-10T23:39:00.890+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:39:00.891386543Z 2024-05-10T23:39:00.891395263Z 2024-05-10T23:39:00.891402388Z 2024-05-10T23:39:00.892447464Z [2024-05-10T23:39:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:39:00.894404456Z [2024-05-10T23:39:00.893+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:39:00.894665663Z [2024-05-10T23:39:00.894+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:39:00.896078424Z [2024-05-10T23:39:00.895+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:39:00.896148451Z 2024-05-10T23:39:00.896157815Z 2024-05-10T23:39:00.896169312Z 2024-05-10T23:39:00.901628663Z [2024-05-10T23:39:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:39:00.901992510Z [2024-05-10T23:39:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:39:00.902461943Z [2024-05-10T23:39:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:39:00.902755920Z [2024-05-10T23:39:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:39:00.903204229Z [2024-05-10T23:39:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:39:00.903422272Z [2024-05-10T23:39:00.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:39:01.268586326Z [2024-05-10T23:39:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status queued for try_number 1 2024-05-10T23:39:01.268621528Z [2024-05-10T23:39:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status queued for try_number 1 2024-05-10T23:39:01.268631344Z [2024-05-10T23:39:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status queued for try_number 1 2024-05-10T23:39:01.277279151Z [2024-05-10T23:39:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3b51f14-2dd3-4ca0-a213-762fbc49486d 2024-05-10T23:39:01.277327151Z [2024-05-10T23:39:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19f57de0-8ea1-485e-a160-81fef2f81c15 2024-05-10T23:39:01.277453422Z [2024-05-10T23:39:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93982fa0-41bc-47da-a551-f36d2edce014 2024-05-10T23:39:02.403853843Z [2024-05-10T23:39:02.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:39:02.404606776Z [2024-05-10T23:39:02.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:38:00+00:00, run_id=scheduled__2024-05-10T23:38:00+00:00, run_start_date=2024-05-10 23:39:00.798306+00:00, run_end_date=2024-05-10 23:39:02.403693+00:00, run_duration=1.605387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:38:00+00:00, data_interval_end=2024-05-10 23:39:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:39:02.420297006Z [2024-05-10T23:39:02.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:39:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:39:02.490162234Z [2024-05-10T23:39:02.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status success for try_number 1 2024-05-10T23:39:02.500584932Z [2024-05-10T23:39:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:38:00+00:00, map_index=-1, run_start_date=2024-05-10 23:39:01.773653+00:00, run_end_date=2024-05-10 23:39:02.171192+00:00, run_duration=0.397539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:39:00.897480+00:00, queued_by_job_id=2, pid=4782 2024-05-10T23:39:04.840580624Z [2024-05-10T23:39:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:39:04.841015436Z [2024-05-10T23:39:04.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:38:00+00:00, run_id=scheduled__2024-05-10T23:38:00+00:00, run_start_date=2024-05-10 23:39:00.799279+00:00, run_end_date=2024-05-10 23:39:04.840382+00:00, run_duration=4.041103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:38:00+00:00, data_interval_end=2024-05-10 23:39:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:39:04.852985322Z [2024-05-10T23:39:04.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:39:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:39:04.910324840Z [2024-05-10T23:39:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status success for try_number 1 2024-05-10T23:39:04.919356460Z [2024-05-10T23:39:04.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:38:00+00:00, map_index=-1, run_start_date=2024-05-10 23:39:02.596215+00:00, run_end_date=2024-05-10 23:39:04.133645+00:00, run_duration=1.53743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:39:00.897480+00:00, queued_by_job_id=2, pid=4795 2024-05-10T23:39:05.973624953Z [2024-05-10T23:39:05.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:39:05.974115366Z [2024-05-10T23:39:05.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:38:00+00:00, run_id=scheduled__2024-05-10T23:38:00+00:00, run_start_date=2024-05-10 23:39:00.800192+00:00, run_end_date=2024-05-10 23:39:05.973487+00:00, run_duration=5.173295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:38:00+00:00, data_interval_end=2024-05-10 23:39:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:39:05.987368535Z [2024-05-10T23:39:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:39:00+00:00, run_after=2024-05-10T23:40:00+00:00 2024-05-10T23:39:06.030237345Z [2024-05-10T23:39:06.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status success for try_number 1 2024-05-10T23:39:06.039199214Z [2024-05-10T23:39:06.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:38:00+00:00, map_index=-1, run_start_date=2024-05-10 23:39:02.898902+00:00, run_end_date=2024-05-10 23:39:05.716837+00:00, run_duration=2.817935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:39:00.897480+00:00, queued_by_job_id=2, pid=4806 2024-05-10T23:40:00.710098805Z [2024-05-10T23:40:00.709+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:40:00.737262177Z [2024-05-10T23:40:00.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:40:00.753183388Z [2024-05-10T23:40:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:41:00+00:00 2024-05-10T23:40:00.761152948Z [2024-05-10T23:40:00.760+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:40:00.774200684Z [2024-05-10T23:40:00.773+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:41:00+00:00 2024-05-10T23:40:00.932053745Z [2024-05-10T23:40:00.931+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T23:40:00.932126941Z 2024-05-10T23:40:00.932145906Z 2024-05-10T23:40:00.932185728Z 2024-05-10T23:40:00.932194620Z 2024-05-10T23:40:00.932203488Z 2024-05-10T23:40:00.932228085Z [2024-05-10T23:40:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:40:00.932357796Z [2024-05-10T23:40:00.932+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:40:00.932477303Z [2024-05-10T23:40:00.932+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:40:00.932645502Z [2024-05-10T23:40:00.932+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:40:00.932878154Z [2024-05-10T23:40:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:40:00.934004178Z [2024-05-10T23:40:00.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:40:00.934027023Z 2024-05-10T23:40:00.934034814Z 2024-05-10T23:40:00.934045640Z 2024-05-10T23:40:00.934053237Z 2024-05-10T23:40:00.934060366Z 2024-05-10T23:40:00.941298584Z [2024-05-10T23:40:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:40:00.941396758Z [2024-05-10T23:40:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:40:00.941822143Z [2024-05-10T23:40:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:40:00.942096709Z [2024-05-10T23:40:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:40:00.942349264Z [2024-05-10T23:40:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:40:00.942508850Z [2024-05-10T23:40:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:40:00.942728505Z [2024-05-10T23:40:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:40:00.942877739Z [2024-05-10T23:40:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:40:00.943131459Z [2024-05-10T23:40:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:40:00.943269656Z [2024-05-10T23:40:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:40:01.695097564Z [2024-05-10T23:40:01.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:01.695730192Z [2024-05-10T23:40:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:01.696099937Z [2024-05-10T23:40:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:39:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:01.696535172Z [2024-05-10T23:40:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:39:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:01.696761091Z [2024-05-10T23:40:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:39:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:01.716173437Z [2024-05-10T23:40:01.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02a69925-3cef-4492-a08f-dacab31ed972 2024-05-10T23:40:01.716560461Z [2024-05-10T23:40:01.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6bc41cf-2716-4f8f-9b9a-042be987954e 2024-05-10T23:40:01.716814905Z [2024-05-10T23:40:01.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab6b74d8-993a-4c0e-83a5-cbc9da977860 2024-05-10T23:40:01.717066813Z [2024-05-10T23:40:01.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to baef19d7-087c-463d-bff9-33cba50d9e0b 2024-05-10T23:40:01.717294811Z [2024-05-10T23:40:01.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdcb6e80-a3ba-4144-b2f3-8fadf7d97025 2024-05-10T23:40:03.067319369Z [2024-05-10T23:40:03.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:40:03.067626870Z [2024-05-10T23:40:03.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:38:00+00:00, run_id=scheduled__2024-05-10T23:38:00+00:00, run_start_date=2024-05-10 23:40:00.787942+00:00, run_end_date=2024-05-10 23:40:03.067236+00:00, run_duration=2.279294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:38:00+00:00, data_interval_end=2024-05-10 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:40:03.078082508Z [2024-05-10T23:40:03.077+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:42:00+00:00 2024-05-10T23:40:03.101885147Z [2024-05-10T23:40:03.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:40:03.102078754Z [2024-05-10T23:40:03.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:39:00+00:00, run_id=scheduled__2024-05-10T23:39:00+00:00, run_start_date=2024-05-10 23:40:00.789039+00:00, run_end_date=2024-05-10 23:40:03.101782+00:00, run_duration=2.312743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:39:00+00:00, data_interval_end=2024-05-10 23:40:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:40:03.121178252Z [2024-05-10T23:40:03.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:41:00+00:00 2024-05-10T23:40:03.198879571Z [2024-05-10T23:40:03.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:38:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:03.198904716Z [2024-05-10T23:40:03.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:39:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:03.212105745Z [2024-05-10T23:40:03.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:39:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:02.202055+00:00, run_end_date=2024-05-10 23:40:02.709374+00:00, run_duration=0.507319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:00.936101+00:00, queued_by_job_id=2, pid=4836 2024-05-10T23:40:03.212190644Z [2024-05-10T23:40:03.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:38:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:02.165593+00:00, run_end_date=2024-05-10 23:40:02.564572+00:00, run_duration=0.398979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:00.936101+00:00, queued_by_job_id=2, pid=4835 2024-05-10T23:40:04.329478136Z [2024-05-10T23:40:04.329+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:40:04.329510230Z 2024-05-10T23:40:04.329789034Z [2024-05-10T23:40:04.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:40:04.330646993Z [2024-05-10T23:40:04.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:40:04.330665174Z 2024-05-10T23:40:04.333829458Z [2024-05-10T23:40:04.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:40:04.334063517Z [2024-05-10T23:40:04.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:40:04.397180117Z [2024-05-10T23:40:04.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:04.397349714Z [2024-05-10T23:40:04.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:04.404351292Z [2024-05-10T23:40:04.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40cf4fc3-26f7-4171-b3b2-22af51472a6d 2024-05-10T23:40:04.410727837Z [2024-05-10T23:40:04.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:03.335429+00:00, run_end_date=2024-05-10 23:40:03.731201+00:00, run_duration=0.395772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:00.936101+00:00, queued_by_job_id=2, pid=4861 2024-05-10T23:40:05.902404027Z [2024-05-10T23:40:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:40:05.902774630Z [2024-05-10T23:40:05.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:39:00+00:00, run_id=scheduled__2024-05-10T23:39:00+00:00, run_start_date=2024-05-10 23:40:00.791192+00:00, run_end_date=2024-05-10 23:40:05.902310+00:00, run_duration=5.111118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:39:00+00:00, data_interval_end=2024-05-10 23:40:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:40:05.913216510Z [2024-05-10T23:40:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:41:00+00:00 2024-05-10T23:40:06.006070859Z [2024-05-10T23:40:06.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:39:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:06.016858758Z [2024-05-10T23:40:06.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:39:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:03.321040+00:00, run_end_date=2024-05-10 23:40:05.672668+00:00, run_duration=2.351628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:00.936101+00:00, queued_by_job_id=2, pid=4860 2024-05-10T23:40:07.069046952Z [2024-05-10T23:40:07.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:40:07.069586882Z [2024-05-10T23:40:07.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:39:00+00:00, run_id=scheduled__2024-05-10T23:39:00+00:00, run_start_date=2024-05-10 23:40:00.790041+00:00, run_end_date=2024-05-10 23:40:07.068900+00:00, run_duration=6.278859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:39:00+00:00, data_interval_end=2024-05-10 23:40:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:40:07.085630758Z [2024-05-10T23:40:07.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:41:00+00:00 2024-05-10T23:40:07.118952678Z [2024-05-10T23:40:07.118+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:40:07.118986482Z 2024-05-10T23:40:07.119180221Z [2024-05-10T23:40:07.118+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:40:07.119763868Z [2024-05-10T23:40:07.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:40:07.119776154Z 2024-05-10T23:40:07.121840094Z [2024-05-10T23:40:07.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:40:07.122024607Z [2024-05-10T23:40:07.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:40:07.172479011Z [2024-05-10T23:40:07.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:07.174460043Z [2024-05-10T23:40:07.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:39:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:07.174694853Z [2024-05-10T23:40:07.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:07.191034524Z [2024-05-10T23:40:07.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:05.964204+00:00, run_end_date=2024-05-10 23:40:06.348315+00:00, run_duration=0.384111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:04.331161+00:00, queued_by_job_id=2, pid=4901 2024-05-10T23:40:07.191373938Z [2024-05-10T23:40:07.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f5cea96-486d-4a87-9929-1145b65c058c 2024-05-10T23:40:07.191633525Z [2024-05-10T23:40:07.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:39:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:03.621931+00:00, run_end_date=2024-05-10 23:40:06.404508+00:00, run_duration=2.782577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:00.936101+00:00, queued_by_job_id=2, pid=4867 2024-05-10T23:40:09.891119007Z [2024-05-10T23:40:09.890+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:40:09.891180214Z 2024-05-10T23:40:09.891237543Z [2024-05-10T23:40:09.891+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:40:09.891874451Z [2024-05-10T23:40:09.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:40:09.891894322Z 2024-05-10T23:40:09.894000589Z [2024-05-10T23:40:09.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:40:09.894167542Z [2024-05-10T23:40:09.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:40:09.982579392Z [2024-05-10T23:40:09.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status queued for try_number 1 2024-05-10T23:40:09.982849007Z [2024-05-10T23:40:09.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:09.990815409Z [2024-05-10T23:40:09.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4468920b-d3a1-44a7-a635-ec3e4a0b7b52 2024-05-10T23:40:09.990937480Z [2024-05-10T23:40:09.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=0, run_start_date=2024-05-10 23:40:08.743500+00:00, run_end_date=2024-05-10 23:40:09.112043+00:00, run_duration=0.368543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:07.120162+00:00, queued_by_job_id=2, pid=4912 2024-05-10T23:40:12.247668893Z [2024-05-10T23:40:12.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:40:12.248697574Z [2024-05-10T23:40:12.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:35:00+00:00, run_id=scheduled__2024-05-10T23:35:00+00:00, run_start_date=2024-05-10 23:40:00.786141+00:00, run_end_date=2024-05-10 23:40:12.248348+00:00, run_duration=11.462207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:35:00+00:00, data_interval_end=2024-05-10 23:40:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:40:12.277086867Z [2024-05-10T23:40:12.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:40:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:40:12.306086385Z [2024-05-10T23:40:12.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:35:00+00:00 exited with status success for try_number 1 2024-05-10T23:40:12.314289097Z [2024-05-10T23:40:12.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:35:00+00:00, map_index=-1, run_start_date=2024-05-10 23:40:11.663327+00:00, run_end_date=2024-05-10 23:40:12.035279+00:00, run_duration=0.371952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:40:09.892231+00:00, queued_by_job_id=2, pid=4920 2024-05-10T23:40:34.059024764Z [2024-05-10T23:40:34.058+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:41:00.089926766Z [2024-05-10T23:41:00.088+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:41:00+00:00, run_after=2024-05-10T23:42:00+00:00 2024-05-10T23:41:00.126692124Z [2024-05-10T23:41:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:41:00.166380433Z [2024-05-10T23:41:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:41:00+00:00, run_after=2024-05-10T23:42:00+00:00 2024-05-10T23:41:00.237958906Z [2024-05-10T23:41:00.237+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:41:00.237992954Z 2024-05-10T23:41:00.237996718Z 2024-05-10T23:41:00.237999668Z 2024-05-10T23:41:00.238022293Z [2024-05-10T23:41:00.237+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:41:00.238104178Z [2024-05-10T23:41:00.237+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:41:00.238222840Z [2024-05-10T23:41:00.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:41:00.238763925Z [2024-05-10T23:41:00.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:41:00.238773802Z 2024-05-10T23:41:00.238776824Z 2024-05-10T23:41:00.238779537Z 2024-05-10T23:41:00.242242822Z [2024-05-10T23:41:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:41:00.242596215Z [2024-05-10T23:41:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:41:00.242904833Z [2024-05-10T23:41:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:41:00.242998560Z [2024-05-10T23:41:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:41:00.243184740Z [2024-05-10T23:41:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:41:00.243281374Z [2024-05-10T23:41:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:41:00.965274507Z [2024-05-10T23:41:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:41:00.965316235Z [2024-05-10T23:41:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:41:00.965583017Z [2024-05-10T23:41:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:41:00.982217949Z [2024-05-10T23:41:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to e984b9ed-04f6-4245-8986-b9c83ba8b0e6 2024-05-10T23:41:00.982451527Z [2024-05-10T23:41:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9648d895-5577-4fd6-aed2-4dee18e61b30 2024-05-10T23:41:00.982582464Z [2024-05-10T23:41:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcde91b6-c8e2-42d5-9744-ce66da728663 2024-05-10T23:41:02.372587636Z [2024-05-10T23:41:02.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:41:02.372837821Z [2024-05-10T23:41:02.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:40:00+00:00, run_id=scheduled__2024-05-10T23:40:00+00:00, run_start_date=2024-05-10 23:41:00.176307+00:00, run_end_date=2024-05-10 23:41:02.372489+00:00, run_duration=2.196182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:40:00+00:00, data_interval_end=2024-05-10 23:41:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:41:02.396039514Z [2024-05-10T23:41:02.395+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:41:00+00:00, run_after=2024-05-10T23:42:00+00:00 2024-05-10T23:41:02.486847940Z [2024-05-10T23:41:02.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:41:02.492440731Z [2024-05-10T23:41:02.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:41:01.743427+00:00, run_end_date=2024-05-10 23:41:02.318415+00:00, run_duration=0.574988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:41:00.239496+00:00, queued_by_job_id=2, pid=4929 2024-05-10T23:41:05.722391235Z [2024-05-10T23:41:05.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:41:05.722656034Z [2024-05-10T23:41:05.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:40:00+00:00, run_id=scheduled__2024-05-10T23:40:00+00:00, run_start_date=2024-05-10 23:41:00.177458+00:00, run_end_date=2024-05-10 23:41:05.722412+00:00, run_duration=5.544954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:40:00+00:00, data_interval_end=2024-05-10 23:41:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:41:05.731391791Z [2024-05-10T23:41:05.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:41:00+00:00, run_after=2024-05-10T23:42:00+00:00 2024-05-10T23:41:05.737986256Z [2024-05-10T23:41:05.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:41:05.738568657Z [2024-05-10T23:41:05.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:40:00+00:00, run_id=scheduled__2024-05-10T23:40:00+00:00, run_start_date=2024-05-10 23:41:00.178498+00:00, run_end_date=2024-05-10 23:41:05.738303+00:00, run_duration=5.559805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:40:00+00:00, data_interval_end=2024-05-10 23:41:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:41:05.747100443Z [2024-05-10T23:41:05.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:41:00+00:00, run_after=2024-05-10T23:42:00+00:00 2024-05-10T23:41:05.776174273Z [2024-05-10T23:41:05.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:41:05.776267235Z [2024-05-10T23:41:05.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:41:05.787718384Z [2024-05-10T23:41:05.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:41:02.915204+00:00, run_end_date=2024-05-10 23:41:04.902377+00:00, run_duration=1.987173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:41:00.239496+00:00, queued_by_job_id=2, pid=4948 2024-05-10T23:41:05.788125245Z [2024-05-10T23:41:05.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:41:02.824488+00:00, run_end_date=2024-05-10 23:41:05.252987+00:00, run_duration=2.428499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:41:00.239496+00:00, queued_by_job_id=2, pid=4947 2024-05-10T23:42:00.415859497Z [2024-05-10T23:42:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:42:00+00:00, run_after=2024-05-10T23:43:00+00:00 2024-05-10T23:42:00.422240694Z [2024-05-10T23:42:00.421+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:42:00.427618612Z [2024-05-10T23:42:00.427+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:42:00.438129055Z [2024-05-10T23:42:00.437+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:42:00+00:00, run_after=2024-05-10T23:43:00+00:00 2024-05-10T23:42:00.507065133Z [2024-05-10T23:42:00.506+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:42:00.507093799Z 2024-05-10T23:42:00.507101572Z 2024-05-10T23:42:00.507104759Z 2024-05-10T23:42:00.507107796Z 2024-05-10T23:42:00.507125845Z [2024-05-10T23:42:00.506+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:42:00.507439176Z [2024-05-10T23:42:00.507+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:42:00.507549137Z [2024-05-10T23:42:00.507+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:42:00.507623738Z [2024-05-10T23:42:00.507+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:42:00.508444212Z [2024-05-10T23:42:00.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:42:00.508456891Z 2024-05-10T23:42:00.508460749Z 2024-05-10T23:42:00.508464106Z 2024-05-10T23:42:00.508468102Z 2024-05-10T23:42:00.513397434Z [2024-05-10T23:42:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:42:00.513482495Z [2024-05-10T23:42:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:42:00.513715397Z [2024-05-10T23:42:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:42:00.513837494Z [2024-05-10T23:42:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:42:00.514004204Z [2024-05-10T23:42:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:42:00.514134651Z [2024-05-10T23:42:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:42:00.514482739Z [2024-05-10T23:42:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:42:00.514656087Z [2024-05-10T23:42:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:42:00.887376746Z [2024-05-10T23:42:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:42:00.887544752Z [2024-05-10T23:42:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:41:00+00:00 exited with status queued for try_number 1 2024-05-10T23:42:00.887731796Z [2024-05-10T23:42:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:41:00+00:00 exited with status queued for try_number 1 2024-05-10T23:42:00.887911281Z [2024-05-10T23:42:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:41:00+00:00 exited with status queued for try_number 1 2024-05-10T23:42:00.898879978Z [2024-05-10T23:42:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to f15f19f1-e09e-476b-b565-939e5bba19f4 2024-05-10T23:42:00.899093895Z [2024-05-10T23:42:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4501a24-5f6d-482a-8b83-c7554acd0b54 2024-05-10T23:42:00.899263446Z [2024-05-10T23:42:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5a9e832-56ce-4da9-b2ac-3fdf350ef390 2024-05-10T23:42:00.899441512Z [2024-05-10T23:42:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5076c10-2667-4ba7-8e68-f9f5321a5bdc 2024-05-10T23:42:03.380668594Z [2024-05-10T23:42:03.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:42:03.381024844Z [2024-05-10T23:42:03.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:41:00+00:00, run_id=scheduled__2024-05-10T23:41:00+00:00, run_start_date=2024-05-10 23:42:00.447873+00:00, run_end_date=2024-05-10 23:42:03.380600+00:00, run_duration=2.932727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:41:00+00:00, data_interval_end=2024-05-10 23:42:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:42:03.396737028Z [2024-05-10T23:42:03.396+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:42:00+00:00, run_after=2024-05-10T23:43:00+00:00 2024-05-10T23:42:03.426716995Z [2024-05-10T23:42:03.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:42:03.434674428Z [2024-05-10T23:42:03.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:40:00+00:00, run_id=scheduled__2024-05-10T23:40:00+00:00, run_start_date=2024-05-10 23:42:00.446836+00:00, run_end_date=2024-05-10 23:42:03.426627+00:00, run_duration=2.979791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:40:00+00:00, data_interval_end=2024-05-10 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:42:03.454895201Z [2024-05-10T23:42:03.454+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:42:00+00:00, run_after=2024-05-10T23:44:00+00:00 2024-05-10T23:42:03.528739749Z [2024-05-10T23:42:03.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:42:03.528763598Z [2024-05-10T23:42:03.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:41:00+00:00 exited with status success for try_number 1 2024-05-10T23:42:03.573795286Z [2024-05-10T23:42:03.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:42:01.490708+00:00, run_end_date=2024-05-10 23:42:02.059163+00:00, run_duration=0.568455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:42:00.510275+00:00, queued_by_job_id=2, pid=4981 2024-05-10T23:42:03.573829924Z [2024-05-10T23:42:03.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:41:00+00:00, map_index=-1, run_start_date=2024-05-10 23:42:02.087165+00:00, run_end_date=2024-05-10 23:42:03.040236+00:00, run_duration=0.953071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:42:00.510275+00:00, queued_by_job_id=2, pid=4987 2024-05-10T23:42:05.816492080Z [2024-05-10T23:42:05.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:42:05.816815308Z [2024-05-10T23:42:05.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:41:00+00:00, run_id=scheduled__2024-05-10T23:41:00+00:00, run_start_date=2024-05-10 23:42:00.448823+00:00, run_end_date=2024-05-10 23:42:05.816420+00:00, run_duration=5.367597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:41:00+00:00, data_interval_end=2024-05-10 23:42:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:42:05.827196271Z [2024-05-10T23:42:05.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:42:00+00:00, run_after=2024-05-10T23:43:00+00:00 2024-05-10T23:42:06.942786767Z [2024-05-10T23:42:06.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:42:06.943871636Z [2024-05-10T23:42:06.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:41:00+00:00, run_id=scheduled__2024-05-10T23:41:00+00:00, run_start_date=2024-05-10 23:42:00.451842+00:00, run_end_date=2024-05-10 23:42:06.942920+00:00, run_duration=6.491078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:41:00+00:00, data_interval_end=2024-05-10 23:42:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:42:06.957327328Z [2024-05-10T23:42:06.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:42:00+00:00, run_after=2024-05-10T23:43:00+00:00 2024-05-10T23:42:07.005850267Z [2024-05-10T23:42:07.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:41:00+00:00 exited with status success for try_number 1 2024-05-10T23:42:07.006102837Z [2024-05-10T23:42:07.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:41:00+00:00 exited with status success for try_number 1 2024-05-10T23:42:07.014732938Z [2024-05-10T23:42:07.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:41:00+00:00, map_index=-1, run_start_date=2024-05-10 23:42:04.243330+00:00, run_end_date=2024-05-10 23:42:05.785168+00:00, run_duration=1.541838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:42:00.510275+00:00, queued_by_job_id=2, pid=5005 2024-05-10T23:42:07.015025363Z [2024-05-10T23:42:07.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:41:00+00:00, map_index=-1, run_start_date=2024-05-10 23:42:04.529747+00:00, run_end_date=2024-05-10 23:42:06.565575+00:00, run_duration=2.035828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:42:00.510275+00:00, queued_by_job_id=2, pid=5006 2024-05-10T23:43:00.874834909Z [2024-05-10T23:43:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:43:00+00:00, run_after=2024-05-10T23:44:00+00:00 2024-05-10T23:43:00.891012897Z [2024-05-10T23:43:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:43:00+00:00, run_after=2024-05-10T23:44:00+00:00 2024-05-10T23:43:00.902081268Z [2024-05-10T23:43:00.899+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:43:00.996120226Z [2024-05-10T23:43:00.995+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:43:00.996150896Z 2024-05-10T23:43:00.996155088Z 2024-05-10T23:43:00.996158659Z 2024-05-10T23:43:00.996510222Z [2024-05-10T23:43:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:43:00.998389559Z [2024-05-10T23:43:00.998+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:43:00.998590445Z [2024-05-10T23:43:00.998+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:43:01.010170696Z [2024-05-10T23:43:01.000+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:43:01.010197007Z 2024-05-10T23:43:01.010202414Z 2024-05-10T23:43:01.010207296Z 2024-05-10T23:43:01.019232516Z [2024-05-10T23:43:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:43:01.019245663Z [2024-05-10T23:43:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:43:01.019249316Z [2024-05-10T23:43:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:43:01.019252505Z [2024-05-10T23:43:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:43:01.019268112Z [2024-05-10T23:43:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:43:01.019271267Z [2024-05-10T23:43:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:43:01.481097707Z [2024-05-10T23:43:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status queued for try_number 1 2024-05-10T23:43:01.481245180Z [2024-05-10T23:43:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status queued for try_number 1 2024-05-10T23:43:01.481376793Z [2024-05-10T23:43:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status queued for try_number 1 2024-05-10T23:43:01.491797086Z [2024-05-10T23:43:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c83bd01-9d05-4369-8904-5130bcdcaeea 2024-05-10T23:43:01.492012235Z [2024-05-10T23:43:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 610c29d4-8c0e-49cd-90b6-3be047134ffc 2024-05-10T23:43:01.492213285Z [2024-05-10T23:43:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to e75ad150-9534-4efa-b7fc-f9bd6b20489b 2024-05-10T23:43:03.373988631Z [2024-05-10T23:43:03.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:43:03.374838362Z [2024-05-10T23:43:03.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:42:00+00:00, run_id=scheduled__2024-05-10T23:42:00+00:00, run_start_date=2024-05-10 23:43:00.912327+00:00, run_end_date=2024-05-10 23:43:03.374301+00:00, run_duration=2.461974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:42:00+00:00, data_interval_end=2024-05-10 23:43:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:43:03.389287940Z [2024-05-10T23:43:03.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:43:00+00:00, run_after=2024-05-10T23:44:00+00:00 2024-05-10T23:43:03.440305185Z [2024-05-10T23:43:03.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status success for try_number 1 2024-05-10T23:43:03.450232942Z [2024-05-10T23:43:03.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:42:00+00:00, map_index=-1, run_start_date=2024-05-10 23:43:02.133322+00:00, run_end_date=2024-05-10 23:43:02.975990+00:00, run_duration=0.842668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:43:01.003061+00:00, queued_by_job_id=2, pid=5038 2024-05-10T23:43:05.629289151Z [2024-05-10T23:43:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:43:05.629655608Z [2024-05-10T23:43:05.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:42:00+00:00, run_id=scheduled__2024-05-10T23:42:00+00:00, run_start_date=2024-05-10 23:43:00.914905+00:00, run_end_date=2024-05-10 23:43:05.629370+00:00, run_duration=4.714465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:42:00+00:00, data_interval_end=2024-05-10 23:43:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:43:05.640140625Z [2024-05-10T23:43:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:43:00+00:00, run_after=2024-05-10T23:44:00+00:00 2024-05-10T23:43:05.698180063Z [2024-05-10T23:43:05.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status success for try_number 1 2024-05-10T23:43:05.707343639Z [2024-05-10T23:43:05.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:42:00+00:00, map_index=-1, run_start_date=2024-05-10 23:43:03.588410+00:00, run_end_date=2024-05-10 23:43:04.918081+00:00, run_duration=1.329671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:43:01.003061+00:00, queued_by_job_id=2, pid=5051 2024-05-10T23:43:06.772634544Z [2024-05-10T23:43:06.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:43:06.772679070Z [2024-05-10T23:43:06.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:42:00+00:00, run_id=scheduled__2024-05-10T23:42:00+00:00, run_start_date=2024-05-10 23:43:00.915989+00:00, run_end_date=2024-05-10 23:43:06.771401+00:00, run_duration=5.855412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:42:00+00:00, data_interval_end=2024-05-10 23:43:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:43:06.792497632Z [2024-05-10T23:43:06.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:43:00+00:00, run_after=2024-05-10T23:44:00+00:00 2024-05-10T23:43:06.858840983Z [2024-05-10T23:43:06.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status success for try_number 1 2024-05-10T23:43:06.877413944Z [2024-05-10T23:43:06.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:42:00+00:00, map_index=-1, run_start_date=2024-05-10 23:43:04.056219+00:00, run_end_date=2024-05-10 23:43:05.626955+00:00, run_duration=1.570736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:43:01.003061+00:00, queued_by_job_id=2, pid=5062 2024-05-10T23:44:00.208728492Z [2024-05-10T23:44:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:44:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:44:00.228690702Z [2024-05-10T23:44:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:44:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:44:00.238633045Z [2024-05-10T23:44:00.238+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:44:00.245273159Z [2024-05-10T23:44:00.244+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:44:00.356617246Z [2024-05-10T23:44:00.356+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:44:00.356642509Z 2024-05-10T23:44:00.356647416Z 2024-05-10T23:44:00.356650625Z 2024-05-10T23:44:00.356653845Z 2024-05-10T23:44:00.356832419Z [2024-05-10T23:44:00.356+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:44:00.357032342Z [2024-05-10T23:44:00.356+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:44:00.357207380Z [2024-05-10T23:44:00.357+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:44:00.357391028Z [2024-05-10T23:44:00.357+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:44:00.358047742Z [2024-05-10T23:44:00.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:44:00.358059814Z 2024-05-10T23:44:00.358063216Z 2024-05-10T23:44:00.358066290Z 2024-05-10T23:44:00.358069495Z 2024-05-10T23:44:00.361740416Z [2024-05-10T23:44:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:44:00.361778796Z [2024-05-10T23:44:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:44:00.362069191Z [2024-05-10T23:44:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:44:00.362300327Z [2024-05-10T23:44:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:44:00.362633913Z [2024-05-10T23:44:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:44:00.362842562Z [2024-05-10T23:44:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:44:00.363166188Z [2024-05-10T23:44:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:44:00.363343766Z [2024-05-10T23:44:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:44:00.606106765Z [2024-05-10T23:44:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status queued for try_number 1 2024-05-10T23:44:00.606206621Z [2024-05-10T23:44:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:43:00+00:00 exited with status queued for try_number 1 2024-05-10T23:44:00.606317837Z [2024-05-10T23:44:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:43:00+00:00 exited with status queued for try_number 1 2024-05-10T23:44:00.606421928Z [2024-05-10T23:44:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:43:00+00:00 exited with status queued for try_number 1 2024-05-10T23:44:00.615040302Z [2024-05-10T23:44:00.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dba8ffe-e66d-4373-90b3-2ffd39955d6a 2024-05-10T23:44:00.615183731Z [2024-05-10T23:44:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfdc6e42-9dba-4209-afa3-ff38ef4c0820 2024-05-10T23:44:00.615351904Z [2024-05-10T23:44:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7680187-aba6-475e-979a-12588ff0020f 2024-05-10T23:44:00.615495952Z [2024-05-10T23:44:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b29d4f9-7348-4fb7-a943-311ee6a90a97 2024-05-10T23:44:01.951404569Z [2024-05-10T23:44:01.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:44:01.951705361Z [2024-05-10T23:44:01.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:42:00+00:00, run_id=scheduled__2024-05-10T23:42:00+00:00, run_start_date=2024-05-10 23:44:00.254382+00:00, run_end_date=2024-05-10 23:44:01.951394+00:00, run_duration=1.697012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:42:00+00:00, data_interval_end=2024-05-10 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:44:01.963883703Z [2024-05-10T23:44:01.963+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:44:00+00:00, run_after=2024-05-10T23:46:00+00:00 2024-05-10T23:44:01.970411529Z [2024-05-10T23:44:01.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:44:01.970705756Z [2024-05-10T23:44:01.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:43:00+00:00, run_id=scheduled__2024-05-10T23:43:00+00:00, run_start_date=2024-05-10 23:44:00.257476+00:00, run_end_date=2024-05-10 23:44:01.970435+00:00, run_duration=1.712959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:43:00+00:00, data_interval_end=2024-05-10 23:44:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:44:01.980759815Z [2024-05-10T23:44:01.980+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:44:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:44:02.056094211Z [2024-05-10T23:44:02.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:42:00+00:00 exited with status success for try_number 1 2024-05-10T23:44:02.056193967Z [2024-05-10T23:44:02.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:43:00+00:00 exited with status success for try_number 1 2024-05-10T23:44:02.063462070Z [2024-05-10T23:44:02.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:42:00+00:00, map_index=-1, run_start_date=2024-05-10 23:44:01.294804+00:00, run_end_date=2024-05-10 23:44:01.642045+00:00, run_duration=0.347241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:44:00.358853+00:00, queued_by_job_id=2, pid=5090 2024-05-10T23:44:02.063677523Z [2024-05-10T23:44:02.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:43:00+00:00, map_index=-1, run_start_date=2024-05-10 23:44:01.372072+00:00, run_end_date=2024-05-10 23:44:01.866381+00:00, run_duration=0.494309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:44:00.358853+00:00, queued_by_job_id=2, pid=5091 2024-05-10T23:44:04.237417677Z [2024-05-10T23:44:04.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:44:04.237722690Z [2024-05-10T23:44:04.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:43:00+00:00, run_id=scheduled__2024-05-10T23:43:00+00:00, run_start_date=2024-05-10 23:44:00.258547+00:00, run_end_date=2024-05-10 23:44:04.237409+00:00, run_duration=3.978862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:43:00+00:00, data_interval_end=2024-05-10 23:44:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:44:04.258706475Z [2024-05-10T23:44:04.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:44:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:44:04.303790476Z [2024-05-10T23:44:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:43:00+00:00 exited with status success for try_number 1 2024-05-10T23:44:04.311000689Z [2024-05-10T23:44:04.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:43:00+00:00, map_index=-1, run_start_date=2024-05-10 23:44:02.505623+00:00, run_end_date=2024-05-10 23:44:04.092871+00:00, run_duration=1.587248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:44:00.358853+00:00, queued_by_job_id=2, pid=5115 2024-05-10T23:44:04.421686046Z [2024-05-10T23:44:04.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:44:04.422257481Z [2024-05-10T23:44:04.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:43:00+00:00, run_id=scheduled__2024-05-10T23:43:00+00:00, run_start_date=2024-05-10 23:44:00.259527+00:00, run_end_date=2024-05-10 23:44:04.421483+00:00, run_duration=4.161956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:43:00+00:00, data_interval_end=2024-05-10 23:44:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:44:04.433644726Z [2024-05-10T23:44:04.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:44:00+00:00, run_after=2024-05-10T23:45:00+00:00 2024-05-10T23:44:05.564493672Z [2024-05-10T23:44:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:43:00+00:00 exited with status success for try_number 1 2024-05-10T23:44:05.570867072Z [2024-05-10T23:44:05.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:43:00+00:00, map_index=-1, run_start_date=2024-05-10 23:44:02.460435+00:00, run_end_date=2024-05-10 23:44:04.345641+00:00, run_duration=1.885206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:44:00.358853+00:00, queued_by_job_id=2, pid=5114 2024-05-10T23:45:00.310033021Z [2024-05-10T23:45:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:46:00+00:00 2024-05-10T23:45:00.329943164Z [2024-05-10T23:45:00.327+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:45:00.341083419Z [2024-05-10T23:45:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:46:00+00:00 2024-05-10T23:45:00.357716336Z [2024-05-10T23:45:00.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:45:00.455998042Z [2024-05-10T23:45:00.455+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:45:00.456042725Z 2024-05-10T23:45:00.456057120Z 2024-05-10T23:45:00.456066535Z 2024-05-10T23:45:00.456075134Z 2024-05-10T23:45:00.456083459Z [2024-05-10T23:45:00.455+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:45:00.457393085Z [2024-05-10T23:45:00.456+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:45:00.457415099Z [2024-05-10T23:45:00.456+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:45:00.457424378Z [2024-05-10T23:45:00.456+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:45:00.457985443Z [2024-05-10T23:45:00.457+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:45:00.458022938Z 2024-05-10T23:45:00.458032106Z 2024-05-10T23:45:00.458040455Z 2024-05-10T23:45:00.458077317Z 2024-05-10T23:45:00.464377182Z [2024-05-10T23:45:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:45:00.464621322Z [2024-05-10T23:45:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:45:00.465071263Z [2024-05-10T23:45:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:45:00.465386479Z [2024-05-10T23:45:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:45:00.466022740Z [2024-05-10T23:45:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:45:00.466171316Z [2024-05-10T23:45:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:45:00.466686625Z [2024-05-10T23:45:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:45:00.466755862Z [2024-05-10T23:45:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:45:00.883071338Z [2024-05-10T23:45:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:00.884843598Z [2024-05-10T23:45:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:00.884996947Z [2024-05-10T23:45:00.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:00.885094671Z [2024-05-10T23:45:00.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:00.905313462Z [2024-05-10T23:45:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 520e015d-831b-4231-8dad-279ab9cb6810 2024-05-10T23:45:00.906451228Z [2024-05-10T23:45:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 970807a3-7cea-41b4-a51c-e9dc1680fe67 2024-05-10T23:45:00.907775463Z [2024-05-10T23:45:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8d6b129-99ea-4315-8f30-44509c8d6c49 2024-05-10T23:45:00.908033489Z [2024-05-10T23:45:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 685ba323-8d13-43fc-924b-65afd2b9318b 2024-05-10T23:45:02.375333736Z [2024-05-10T23:45:02.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:45:02.375784024Z [2024-05-10T23:45:02.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:44:00+00:00, run_id=scheduled__2024-05-10T23:44:00+00:00, run_start_date=2024-05-10 23:45:00.375875+00:00, run_end_date=2024-05-10 23:45:02.375258+00:00, run_duration=1.999383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:44:00+00:00, data_interval_end=2024-05-10 23:45:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:45:02.403640711Z [2024-05-10T23:45:02.403+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:46:00+00:00 2024-05-10T23:45:02.452813852Z [2024-05-10T23:45:02.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:02.459811691Z [2024-05-10T23:45:02.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:44:00+00:00, map_index=-1, run_start_date=2024-05-10 23:45:01.668091+00:00, run_end_date=2024-05-10 23:45:02.066603+00:00, run_duration=0.398512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:00.459523+00:00, queued_by_job_id=2, pid=5148 2024-05-10T23:45:03.559680748Z [2024-05-10T23:45:03.557+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:45:03.559719371Z 2024-05-10T23:45:03.564261966Z [2024-05-10T23:45:03.562+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:45:03.564294661Z [2024-05-10T23:45:03.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:45:03.564313928Z 2024-05-10T23:45:03.572292768Z [2024-05-10T23:45:03.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:45:03.572330938Z [2024-05-10T23:45:03.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:45:03.628901320Z [2024-05-10T23:45:03.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:03.629181793Z [2024-05-10T23:45:03.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:03.635308290Z [2024-05-10T23:45:03.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to babef933-513d-4e0e-bcea-8e0625238582 2024-05-10T23:45:03.635790732Z [2024-05-10T23:45:03.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:45:02.871550+00:00, run_end_date=2024-05-10 23:45:03.272847+00:00, run_duration=0.401297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:00.459523+00:00, queued_by_job_id=2, pid=5173 2024-05-10T23:45:04.794360870Z [2024-05-10T23:45:04.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:45:04.794741897Z [2024-05-10T23:45:04.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:44:00+00:00, run_id=scheduled__2024-05-10T23:44:00+00:00, run_start_date=2024-05-10 23:45:00.376858+00:00, run_end_date=2024-05-10 23:45:04.794122+00:00, run_duration=4.417264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:44:00+00:00, data_interval_end=2024-05-10 23:45:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:45:04.807547848Z [2024-05-10T23:45:04.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:46:00+00:00 2024-05-10T23:45:04.876640877Z [2024-05-10T23:45:04.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:04.884186585Z [2024-05-10T23:45:04.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:44:00+00:00, map_index=-1, run_start_date=2024-05-10 23:45:02.610030+00:00, run_end_date=2024-05-10 23:45:04.167559+00:00, run_duration=1.557529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:00.459523+00:00, queued_by_job_id=2, pid=5162 2024-05-10T23:45:05.957960991Z [2024-05-10T23:45:05.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:45:05.958031045Z [2024-05-10T23:45:05.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:44:00+00:00, run_id=scheduled__2024-05-10T23:44:00+00:00, run_start_date=2024-05-10 23:45:00.377777+00:00, run_end_date=2024-05-10 23:45:05.957709+00:00, run_duration=5.579932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:44:00+00:00, data_interval_end=2024-05-10 23:45:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:45:05.967374508Z [2024-05-10T23:45:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:46:00+00:00 2024-05-10T23:45:06.013489393Z [2024-05-10T23:45:06.013+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:45:06.013515025Z 2024-05-10T23:45:06.013526119Z [2024-05-10T23:45:06.013+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:45:06.014009059Z [2024-05-10T23:45:06.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:45:06.014021835Z 2024-05-10T23:45:06.016020033Z [2024-05-10T23:45:06.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:45:06.016072968Z [2024-05-10T23:45:06.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:45:06.061685137Z [2024-05-10T23:45:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:06.061716726Z [2024-05-10T23:45:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:06.061727324Z [2024-05-10T23:45:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:06.072187627Z [2024-05-10T23:45:06.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:45:05.151953+00:00, run_end_date=2024-05-10 23:45:05.460191+00:00, run_duration=0.308238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:03.568181+00:00, queued_by_job_id=2, pid=5204 2024-05-10T23:45:06.072279001Z [2024-05-10T23:45:06.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c33a3f8-0c44-4fd2-9859-64b74a49371a 2024-05-10T23:45:06.072405732Z [2024-05-10T23:45:06.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:44:00+00:00, map_index=-1, run_start_date=2024-05-10 23:45:02.948153+00:00, run_end_date=2024-05-10 23:45:05.201879+00:00, run_duration=2.253726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:00.459523+00:00, queued_by_job_id=2, pid=5179 2024-05-10T23:45:08.307226312Z [2024-05-10T23:45:08.306+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:45:08.307252792Z 2024-05-10T23:45:08.307349253Z [2024-05-10T23:45:08.307+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:45:08.307927881Z [2024-05-10T23:45:08.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:45:08.307932892Z 2024-05-10T23:45:08.311288956Z [2024-05-10T23:45:08.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:45:08.311535370Z [2024-05-10T23:45:08.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:45:08.388332415Z [2024-05-10T23:45:08.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status queued for try_number 1 2024-05-10T23:45:08.388354961Z [2024-05-10T23:45:08.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:08.395609145Z [2024-05-10T23:45:08.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d2ad5a5-038f-4b8a-a02c-b90eee82a371 2024-05-10T23:45:08.395837744Z [2024-05-10T23:45:08.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=0, run_start_date=2024-05-10 23:45:07.706343+00:00, run_end_date=2024-05-10 23:45:08.057458+00:00, run_duration=0.351115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:06.014285+00:00, queued_by_job_id=2, pid=5219 2024-05-10T23:45:11.137678206Z [2024-05-10T23:45:11.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:45:11.138074019Z [2024-05-10T23:45:11.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:40:00+00:00, run_id=scheduled__2024-05-10T23:40:00+00:00, run_start_date=2024-05-10 23:45:00.374676+00:00, run_end_date=2024-05-10 23:45:11.137558+00:00, run_duration=10.762882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:40:00+00:00, data_interval_end=2024-05-10 23:45:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:45:11.144856738Z [2024-05-10T23:45:11.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:45:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:45:11.189411329Z [2024-05-10T23:45:11.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:40:00+00:00 exited with status success for try_number 1 2024-05-10T23:45:11.197077978Z [2024-05-10T23:45:11.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:40:00+00:00, map_index=-1, run_start_date=2024-05-10 23:45:09.986307+00:00, run_end_date=2024-05-10 23:45:10.399838+00:00, run_duration=0.413531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:45:08.308267+00:00, queued_by_job_id=2, pid=5227 2024-05-10T23:45:34.139691504Z [2024-05-10T23:45:34.138+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:46:01.005962089Z [2024-05-10T23:46:01.005+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:46:01.034018874Z [2024-05-10T23:46:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:46:00+00:00, run_after=2024-05-10T23:47:00+00:00 2024-05-10T23:46:01.047454394Z [2024-05-10T23:46:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:46:00+00:00, run_after=2024-05-10T23:47:00+00:00 2024-05-10T23:46:01.058027650Z [2024-05-10T23:46:01.055+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:46:01.158184933Z [2024-05-10T23:46:01.157+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:46:01.158257129Z 2024-05-10T23:46:01.158268161Z 2024-05-10T23:46:01.158277225Z 2024-05-10T23:46:01.158285928Z 2024-05-10T23:46:01.158401375Z [2024-05-10T23:46:01.158+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:46:01.158426363Z [2024-05-10T23:46:01.158+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:46:01.158564906Z [2024-05-10T23:46:01.158+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:46:01.158614676Z [2024-05-10T23:46:01.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:46:01.159775715Z [2024-05-10T23:46:01.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:46:01.159789591Z 2024-05-10T23:46:01.159795525Z 2024-05-10T23:46:01.159801312Z 2024-05-10T23:46:01.159807551Z 2024-05-10T23:46:01.163055116Z [2024-05-10T23:46:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:46:01.163082957Z [2024-05-10T23:46:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:46:01.163297533Z [2024-05-10T23:46:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:46:01.163356858Z [2024-05-10T23:46:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:46:01.163524076Z [2024-05-10T23:46:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:46:01.163586975Z [2024-05-10T23:46:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:46:01.163743923Z [2024-05-10T23:46:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:46:01.163836356Z [2024-05-10T23:46:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:46:01.558108918Z [2024-05-10T23:46:01.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status queued for try_number 1 2024-05-10T23:46:01.558178741Z [2024-05-10T23:46:01.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:46:01.558184144Z [2024-05-10T23:46:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:46:01.558252760Z [2024-05-10T23:46:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:46:01.578908727Z [2024-05-10T23:46:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 210eedf8-b283-4be7-9aa7-8f5eabb2e897 2024-05-10T23:46:01.578994629Z [2024-05-10T23:46:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to c52627e5-3cdc-4b37-ad9d-0c452e0782c3 2024-05-10T23:46:01.579097656Z [2024-05-10T23:46:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01e40832-1aa8-4150-b777-855b1732569c 2024-05-10T23:46:01.579177329Z [2024-05-10T23:46:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7eec0ee-7416-4110-89cb-5c75127ef67d 2024-05-10T23:46:03.063286086Z [2024-05-10T23:46:03.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:46:03.063578278Z [2024-05-10T23:46:03.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:44:00+00:00, run_id=scheduled__2024-05-10T23:44:00+00:00, run_start_date=2024-05-10 23:46:01.068802+00:00, run_end_date=2024-05-10 23:46:03.063193+00:00, run_duration=1.994391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:44:00+00:00, data_interval_end=2024-05-10 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:46:03.070833689Z [2024-05-10T23:46:03.070+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:46:00+00:00, run_after=2024-05-10T23:48:00+00:00 2024-05-10T23:46:03.083120073Z [2024-05-10T23:46:03.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:46:03.083427307Z [2024-05-10T23:46:03.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:45:00+00:00, run_id=scheduled__2024-05-10T23:45:00+00:00, run_start_date=2024-05-10 23:46:01.072398+00:00, run_end_date=2024-05-10 23:46:03.083035+00:00, run_duration=2.010637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:45:00+00:00, data_interval_end=2024-05-10 23:46:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:46:03.100320579Z [2024-05-10T23:46:03.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:46:00+00:00, run_after=2024-05-10T23:47:00+00:00 2024-05-10T23:46:03.150057379Z [2024-05-10T23:46:03.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:44:00+00:00 exited with status success for try_number 1 2024-05-10T23:46:03.151065188Z [2024-05-10T23:46:03.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:46:03.161115192Z [2024-05-10T23:46:03.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:44:00+00:00, map_index=-1, run_start_date=2024-05-10 23:46:01.914386+00:00, run_end_date=2024-05-10 23:46:02.384885+00:00, run_duration=0.470499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:46:01.160590+00:00, queued_by_job_id=2, pid=5236 2024-05-10T23:46:03.161512348Z [2024-05-10T23:46:03.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=-1, run_start_date=2024-05-10 23:46:02.276300+00:00, run_end_date=2024-05-10 23:46:02.729563+00:00, run_duration=0.453263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:46:01.160590+00:00, queued_by_job_id=2, pid=5239 2024-05-10T23:46:05.309196372Z [2024-05-10T23:46:05.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:46:05.309580942Z [2024-05-10T23:46:05.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:45:00+00:00, run_id=scheduled__2024-05-10T23:45:00+00:00, run_start_date=2024-05-10 23:46:01.075837+00:00, run_end_date=2024-05-10 23:46:05.309214+00:00, run_duration=4.233377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:45:00+00:00, data_interval_end=2024-05-10 23:46:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:46:05.318568994Z [2024-05-10T23:46:05.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:46:00+00:00, run_after=2024-05-10T23:47:00+00:00 2024-05-10T23:46:05.324161083Z [2024-05-10T23:46:05.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:46:05.324439967Z [2024-05-10T23:46:05.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:45:00+00:00, run_id=scheduled__2024-05-10T23:45:00+00:00, run_start_date=2024-05-10 23:46:01.074363+00:00, run_end_date=2024-05-10 23:46:05.324168+00:00, run_duration=4.249805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:45:00+00:00, data_interval_end=2024-05-10 23:46:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:46:05.333097336Z [2024-05-10T23:46:05.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:46:00+00:00, run_after=2024-05-10T23:47:00+00:00 2024-05-10T23:46:05.367208639Z [2024-05-10T23:46:05.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:46:05.367466909Z [2024-05-10T23:46:05.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:46:05.375804587Z [2024-05-10T23:46:05.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=-1, run_start_date=2024-05-10 23:46:03.139550+00:00, run_end_date=2024-05-10 23:46:05.047319+00:00, run_duration=1.907769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:46:01.160590+00:00, queued_by_job_id=2, pid=5261 2024-05-10T23:46:05.376254434Z [2024-05-10T23:46:05.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=-1, run_start_date=2024-05-10 23:46:03.353703+00:00, run_end_date=2024-05-10 23:46:04.841053+00:00, run_duration=1.48735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:46:01.160590+00:00, queued_by_job_id=2, pid=5262 2024-05-10T23:47:01.149015373Z [2024-05-10T23:47:01.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:47:00+00:00, run_after=2024-05-10T23:48:00+00:00 2024-05-10T23:47:01.181309804Z [2024-05-10T23:47:01.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:47:00+00:00, run_after=2024-05-10T23:48:00+00:00 2024-05-10T23:47:01.194412148Z [2024-05-10T23:47:01.194+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:47:01.273579344Z [2024-05-10T23:47:01.272+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:47:01.273615115Z 2024-05-10T23:47:01.273621989Z 2024-05-10T23:47:01.273627976Z 2024-05-10T23:47:01.274607786Z [2024-05-10T23:47:01.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:47:01.275079359Z [2024-05-10T23:47:01.274+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:47:01.275375971Z [2024-05-10T23:47:01.275+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:47:01.276851056Z [2024-05-10T23:47:01.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:47:01.276862854Z 2024-05-10T23:47:01.276868386Z 2024-05-10T23:47:01.276873965Z 2024-05-10T23:47:01.283284390Z [2024-05-10T23:47:01.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:47:01.284114891Z [2024-05-10T23:47:01.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:47:01.284535717Z [2024-05-10T23:47:01.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:47:01.284717828Z [2024-05-10T23:47:01.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:47:01.285065653Z [2024-05-10T23:47:01.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:47:01.285224937Z [2024-05-10T23:47:01.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:47:01.618099752Z [2024-05-10T23:47:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status queued for try_number 1 2024-05-10T23:47:01.618203834Z [2024-05-10T23:47:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status queued for try_number 1 2024-05-10T23:47:01.618213923Z [2024-05-10T23:47:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status queued for try_number 1 2024-05-10T23:47:01.625347317Z [2024-05-10T23:47:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 536d57c1-6bf6-4537-8afe-adc5f9850728 2024-05-10T23:47:01.625378798Z [2024-05-10T23:47:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c1213dd-e0a4-46b1-82f0-3136a1f1e518 2024-05-10T23:47:01.625504830Z [2024-05-10T23:47:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f720aea-ca2c-4c78-8aa5-44feda45d82f 2024-05-10T23:47:02.995956267Z [2024-05-10T23:47:02.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:47:02.996181104Z [2024-05-10T23:47:02.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:46:00+00:00, run_id=scheduled__2024-05-10T23:46:00+00:00, run_start_date=2024-05-10 23:47:01.208715+00:00, run_end_date=2024-05-10 23:47:02.995857+00:00, run_duration=1.787142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:46:00+00:00, data_interval_end=2024-05-10 23:47:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:47:03.015064563Z [2024-05-10T23:47:03.014+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:47:00+00:00, run_after=2024-05-10T23:48:00+00:00 2024-05-10T23:47:03.127307894Z [2024-05-10T23:47:03.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status success for try_number 1 2024-05-10T23:47:03.141390481Z [2024-05-10T23:47:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:46:00+00:00, map_index=-1, run_start_date=2024-05-10 23:47:02.358074+00:00, run_end_date=2024-05-10 23:47:02.844814+00:00, run_duration=0.48674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:47:01.279022+00:00, queued_by_job_id=2, pid=5294 2024-05-10T23:47:05.392145010Z [2024-05-10T23:47:05.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:47:05.396115351Z [2024-05-10T23:47:05.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:46:00+00:00, run_id=scheduled__2024-05-10T23:46:00+00:00, run_start_date=2024-05-10 23:47:01.210298+00:00, run_end_date=2024-05-10 23:47:05.395708+00:00, run_duration=4.18541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:46:00+00:00, data_interval_end=2024-05-10 23:47:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:47:05.412902104Z [2024-05-10T23:47:05.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:47:00+00:00, run_after=2024-05-10T23:48:00+00:00 2024-05-10T23:47:05.451646587Z [2024-05-10T23:47:05.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status success for try_number 1 2024-05-10T23:47:05.456267303Z [2024-05-10T23:47:05.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:46:00+00:00, map_index=-1, run_start_date=2024-05-10 23:47:03.717750+00:00, run_end_date=2024-05-10 23:47:05.148660+00:00, run_duration=1.43091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:47:01.279022+00:00, queued_by_job_id=2, pid=5313 2024-05-10T23:47:06.534204356Z [2024-05-10T23:47:06.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:47:06.534651042Z [2024-05-10T23:47:06.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:46:00+00:00, run_id=scheduled__2024-05-10T23:46:00+00:00, run_start_date=2024-05-10 23:47:01.211344+00:00, run_end_date=2024-05-10 23:47:06.534117+00:00, run_duration=5.322773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:46:00+00:00, data_interval_end=2024-05-10 23:47:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:47:06.543167454Z [2024-05-10T23:47:06.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:47:00+00:00, run_after=2024-05-10T23:48:00+00:00 2024-05-10T23:47:06.580395832Z [2024-05-10T23:47:06.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status success for try_number 1 2024-05-10T23:47:06.587995839Z [2024-05-10T23:47:06.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:46:00+00:00, map_index=-1, run_start_date=2024-05-10 23:47:03.585717+00:00, run_end_date=2024-05-10 23:47:05.515251+00:00, run_duration=1.929534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:47:01.279022+00:00, queued_by_job_id=2, pid=5312 2024-05-10T23:48:00.104842480Z [2024-05-10T23:48:00.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:48:00.117789330Z [2024-05-10T23:48:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:48:00+00:00, run_after=2024-05-10T23:49:00+00:00 2024-05-10T23:48:00.134481369Z [2024-05-10T23:48:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:48:00+00:00, run_after=2024-05-10T23:49:00+00:00 2024-05-10T23:48:00.142762660Z [2024-05-10T23:48:00.142+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:48:00.210974140Z [2024-05-10T23:48:00.210+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:48:00.211008745Z 2024-05-10T23:48:00.211013258Z 2024-05-10T23:48:00.211016306Z 2024-05-10T23:48:00.211019526Z 2024-05-10T23:48:00.211223332Z [2024-05-10T23:48:00.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:48:00.211475216Z [2024-05-10T23:48:00.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:48:00.211705091Z [2024-05-10T23:48:00.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:48:00.211956984Z [2024-05-10T23:48:00.211+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:48:00.212726465Z [2024-05-10T23:48:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:48:00.212740827Z 2024-05-10T23:48:00.212744544Z 2024-05-10T23:48:00.212747794Z 2024-05-10T23:48:00.212750834Z 2024-05-10T23:48:00.216220436Z [2024-05-10T23:48:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:48:00.216522296Z [2024-05-10T23:48:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:48:00.216862315Z [2024-05-10T23:48:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:48:00.217073003Z [2024-05-10T23:48:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:48:00.217323228Z [2024-05-10T23:48:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:48:00.217502139Z [2024-05-10T23:48:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:48:00.217773960Z [2024-05-10T23:48:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:48:00.218130000Z [2024-05-10T23:48:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:48:00.828663107Z [2024-05-10T23:48:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status queued for try_number 1 2024-05-10T23:48:00.828920424Z [2024-05-10T23:48:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:47:00+00:00 exited with status queued for try_number 1 2024-05-10T23:48:00.829142953Z [2024-05-10T23:48:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:47:00+00:00 exited with status queued for try_number 1 2024-05-10T23:48:00.829323599Z [2024-05-10T23:48:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:47:00+00:00 exited with status queued for try_number 1 2024-05-10T23:48:00.865186517Z [2024-05-10T23:48:00.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to a86f54fd-af9f-424a-a6ec-733326a67893 2024-05-10T23:48:00.870532015Z [2024-05-10T23:48:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6faed34e-e9f1-424c-ac32-86f186a52b2b 2024-05-10T23:48:00.871300249Z [2024-05-10T23:48:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89a7f0fc-913c-4cf7-aa19-c4eefd9c5066 2024-05-10T23:48:00.871555439Z [2024-05-10T23:48:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9356a8c3-8dca-400a-ada6-4800c0300d85 2024-05-10T23:48:02.275893790Z [2024-05-10T23:48:02.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:48:02.276577896Z [2024-05-10T23:48:02.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:47:00+00:00, run_id=scheduled__2024-05-10T23:47:00+00:00, run_start_date=2024-05-10 23:48:00.153262+00:00, run_end_date=2024-05-10 23:48:02.275829+00:00, run_duration=2.122567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:47:00+00:00, data_interval_end=2024-05-10 23:48:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:48:02.292049782Z [2024-05-10T23:48:02.291+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:48:00+00:00, run_after=2024-05-10T23:49:00+00:00 2024-05-10T23:48:02.684253162Z [2024-05-10T23:48:02.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:48:02.684863289Z [2024-05-10T23:48:02.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:46:00+00:00, run_id=scheduled__2024-05-10T23:46:00+00:00, run_start_date=2024-05-10 23:48:00.151992+00:00, run_end_date=2024-05-10 23:48:02.684317+00:00, run_duration=2.532325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:46:00+00:00, data_interval_end=2024-05-10 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:48:02.695142391Z [2024-05-10T23:48:02.694+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:48:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:48:02.756136121Z [2024-05-10T23:48:02.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:47:00+00:00 exited with status success for try_number 1 2024-05-10T23:48:02.761789704Z [2024-05-10T23:48:02.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:47:00+00:00, map_index=-1, run_start_date=2024-05-10 23:48:01.762330+00:00, run_end_date=2024-05-10 23:48:02.210849+00:00, run_duration=0.448519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:48:00.213625+00:00, queued_by_job_id=2, pid=5346 2024-05-10T23:48:03.856484790Z [2024-05-10T23:48:03.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:46:00+00:00 exited with status success for try_number 1 2024-05-10T23:48:03.862055338Z [2024-05-10T23:48:03.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:46:00+00:00, map_index=-1, run_start_date=2024-05-10 23:48:02.229466+00:00, run_end_date=2024-05-10 23:48:02.662694+00:00, run_duration=0.433228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:48:00.213625+00:00, queued_by_job_id=2, pid=5353 2024-05-10T23:48:05.213028564Z [2024-05-10T23:48:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:48:05.213551356Z [2024-05-10T23:48:05.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:47:00+00:00, run_id=scheduled__2024-05-10T23:47:00+00:00, run_start_date=2024-05-10 23:48:00.154236+00:00, run_end_date=2024-05-10 23:48:05.213155+00:00, run_duration=5.058919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:47:00+00:00, data_interval_end=2024-05-10 23:48:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:48:05.223637115Z [2024-05-10T23:48:05.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:48:00+00:00, run_after=2024-05-10T23:49:00+00:00 2024-05-10T23:48:05.231136876Z [2024-05-10T23:48:05.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:48:05.231512112Z [2024-05-10T23:48:05.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:47:00+00:00, run_id=scheduled__2024-05-10T23:47:00+00:00, run_start_date=2024-05-10 23:48:00.155252+00:00, run_end_date=2024-05-10 23:48:05.231242+00:00, run_duration=5.07599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:47:00+00:00, data_interval_end=2024-05-10 23:48:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:48:05.248976256Z [2024-05-10T23:48:05.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:48:00+00:00, run_after=2024-05-10T23:49:00+00:00 2024-05-10T23:48:05.279668518Z [2024-05-10T23:48:05.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:47:00+00:00 exited with status success for try_number 1 2024-05-10T23:48:05.280044332Z [2024-05-10T23:48:05.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:47:00+00:00 exited with status success for try_number 1 2024-05-10T23:48:05.286935549Z [2024-05-10T23:48:05.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:47:00+00:00, map_index=-1, run_start_date=2024-05-10 23:48:03.260162+00:00, run_end_date=2024-05-10 23:48:04.455007+00:00, run_duration=1.194845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:48:00.213625+00:00, queued_by_job_id=2, pid=5376 2024-05-10T23:48:05.287297519Z [2024-05-10T23:48:05.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:47:00+00:00, map_index=-1, run_start_date=2024-05-10 23:48:02.864778+00:00, run_end_date=2024-05-10 23:48:04.407969+00:00, run_duration=1.543191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:48:00.213625+00:00, queued_by_job_id=2, pid=5365 2024-05-10T23:49:01.090223399Z [2024-05-10T23:49:01.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:49:01.105178292Z [2024-05-10T23:49:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:49:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:49:01.118250090Z [2024-05-10T23:49:01.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:49:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:49:01.212258452Z [2024-05-10T23:49:01.211+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:49:01.212283582Z 2024-05-10T23:49:01.212304675Z 2024-05-10T23:49:01.212308194Z 2024-05-10T23:49:01.215561999Z [2024-05-10T23:49:01.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:49:01.215810067Z [2024-05-10T23:49:01.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:49:01.215991969Z [2024-05-10T23:49:01.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:49:01.216733525Z [2024-05-10T23:49:01.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:49:01.216745813Z 2024-05-10T23:49:01.216749559Z 2024-05-10T23:49:01.216753236Z 2024-05-10T23:49:01.225701766Z [2024-05-10T23:49:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:49:01.227788392Z [2024-05-10T23:49:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:49:01.227804802Z [2024-05-10T23:49:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:49:01.227808640Z [2024-05-10T23:49:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:49:01.227811987Z [2024-05-10T23:49:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:49:01.227815496Z [2024-05-10T23:49:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:49:01.548981130Z [2024-05-10T23:49:01.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status queued for try_number 1 2024-05-10T23:49:01.549025639Z [2024-05-10T23:49:01.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status queued for try_number 1 2024-05-10T23:49:01.549139856Z [2024-05-10T23:49:01.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status queued for try_number 1 2024-05-10T23:49:01.559248263Z [2024-05-10T23:49:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 680c3b1e-9626-4162-8a7e-ebe994a85a21 2024-05-10T23:49:01.559286462Z [2024-05-10T23:49:01.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21fc9f1f-8a4e-43ad-8c11-06301e614235 2024-05-10T23:49:01.559484666Z [2024-05-10T23:49:01.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30656816-4240-4fee-8173-4dbc944ffffb 2024-05-10T23:49:02.759273759Z [2024-05-10T23:49:02.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:49:02.759805910Z [2024-05-10T23:49:02.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:48:00+00:00, run_id=scheduled__2024-05-10T23:48:00+00:00, run_start_date=2024-05-10 23:49:01.128932+00:00, run_end_date=2024-05-10 23:49:02.759262+00:00, run_duration=1.63033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:48:00+00:00, data_interval_end=2024-05-10 23:49:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:49:02.771364462Z [2024-05-10T23:49:02.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:49:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:49:02.815304052Z [2024-05-10T23:49:02.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status success for try_number 1 2024-05-10T23:49:02.822730564Z [2024-05-10T23:49:02.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:48:00+00:00, map_index=-1, run_start_date=2024-05-10 23:49:02.049636+00:00, run_end_date=2024-05-10 23:49:02.418464+00:00, run_duration=0.368828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:49:01.218980+00:00, queued_by_job_id=2, pid=5404 2024-05-10T23:49:05.091540274Z [2024-05-10T23:49:05.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:49:05.094214875Z [2024-05-10T23:49:05.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:48:00+00:00, run_id=scheduled__2024-05-10T23:48:00+00:00, run_start_date=2024-05-10 23:49:01.130261+00:00, run_end_date=2024-05-10 23:49:05.091458+00:00, run_duration=3.961197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:48:00+00:00, data_interval_end=2024-05-10 23:49:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:49:05.105506427Z [2024-05-10T23:49:05.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:49:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:49:06.224814061Z [2024-05-10T23:49:06.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:49:06.225184488Z [2024-05-10T23:49:06.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:48:00+00:00, run_id=scheduled__2024-05-10T23:48:00+00:00, run_start_date=2024-05-10 23:49:01.131388+00:00, run_end_date=2024-05-10 23:49:06.224704+00:00, run_duration=5.093316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:48:00+00:00, data_interval_end=2024-05-10 23:49:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:49:06.236310898Z [2024-05-10T23:49:06.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:49:00+00:00, run_after=2024-05-10T23:50:00+00:00 2024-05-10T23:49:06.285275770Z [2024-05-10T23:49:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status success for try_number 1 2024-05-10T23:49:06.285326961Z [2024-05-10T23:49:06.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status success for try_number 1 2024-05-10T23:49:06.295784558Z [2024-05-10T23:49:06.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:48:00+00:00, map_index=-1, run_start_date=2024-05-10 23:49:03.102891+00:00, run_end_date=2024-05-10 23:49:05.047340+00:00, run_duration=1.944449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:49:01.218980+00:00, queued_by_job_id=2, pid=5422 2024-05-10T23:49:06.295823399Z [2024-05-10T23:49:06.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:48:00+00:00, map_index=-1, run_start_date=2024-05-10 23:49:03.180709+00:00, run_end_date=2024-05-10 23:49:05.380582+00:00, run_duration=2.199873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:49:01.218980+00:00, queued_by_job_id=2, pid=5423 2024-05-10T23:50:00.547840215Z [2024-05-10T23:50:00.547+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:50:00.607201567Z [2024-05-10T23:50:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:51:00+00:00 2024-05-10T23:50:00.635231962Z [2024-05-10T23:50:00.634+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:50:00.668118724Z [2024-05-10T23:50:00.667+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:51:00+00:00 2024-05-10T23:50:00.681947987Z [2024-05-10T23:50:00.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:50:00.788091905Z [2024-05-10T23:50:00.787+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-10T23:50:00.788113437Z 2024-05-10T23:50:00.788118774Z 2024-05-10T23:50:00.788158142Z 2024-05-10T23:50:00.788165419Z 2024-05-10T23:50:00.788170356Z 2024-05-10T23:50:00.788202381Z [2024-05-10T23:50:00.787+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:50:00.788401192Z [2024-05-10T23:50:00.788+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:50:00.788594940Z [2024-05-10T23:50:00.788+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:50:00.788790501Z [2024-05-10T23:50:00.788+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:50:00.788987263Z [2024-05-10T23:50:00.788+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:50:00.789587165Z [2024-05-10T23:50:00.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:50:00.789598002Z 2024-05-10T23:50:00.789601700Z 2024-05-10T23:50:00.789605079Z 2024-05-10T23:50:00.789608200Z 2024-05-10T23:50:00.789611260Z 2024-05-10T23:50:00.793848106Z [2024-05-10T23:50:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:50:00.794108921Z [2024-05-10T23:50:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:50:00.794532868Z [2024-05-10T23:50:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:50:00.794744284Z [2024-05-10T23:50:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:50:00.795029158Z [2024-05-10T23:50:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:50:00.795203556Z [2024-05-10T23:50:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:50:00.795498142Z [2024-05-10T23:50:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:50:00.795663207Z [2024-05-10T23:50:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:50:00.795967221Z [2024-05-10T23:50:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:50:00.796208486Z [2024-05-10T23:50:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:50:01.316264051Z [2024-05-10T23:50:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:01.316454490Z [2024-05-10T23:50:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:01.316523501Z [2024-05-10T23:50:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:49:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:01.316591035Z [2024-05-10T23:50:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:49:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:01.316647237Z [2024-05-10T23:50:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:49:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:01.337719336Z [2024-05-10T23:50:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b5e1b59-a21a-43c0-b41c-8c6624a99932 2024-05-10T23:50:01.337749742Z [2024-05-10T23:50:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3851691f-277b-4a4f-aea7-5cbfcbbc36fd 2024-05-10T23:50:01.337826793Z [2024-05-10T23:50:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd69a0a5-a0ca-47d6-b6e6-00a4e71727ce 2024-05-10T23:50:01.337930622Z [2024-05-10T23:50:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1eec20c7-a549-416f-94cd-5d203a92de52 2024-05-10T23:50:01.338023043Z [2024-05-10T23:50:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22f1a573-b650-4011-8455-231c84c8e147 2024-05-10T23:50:02.719757062Z [2024-05-10T23:50:02.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:50:02.720253292Z [2024-05-10T23:50:02.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:48:00+00:00, run_id=scheduled__2024-05-10T23:48:00+00:00, run_start_date=2024-05-10 23:50:00.703701+00:00, run_end_date=2024-05-10 23:50:02.719670+00:00, run_duration=2.015969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:48:00+00:00, data_interval_end=2024-05-10 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:50:02.729350778Z [2024-05-10T23:50:02.729+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:52:00+00:00 2024-05-10T23:50:02.743384198Z [2024-05-10T23:50:02.742+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:50:02.743673517Z [2024-05-10T23:50:02.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:49:00+00:00, run_id=scheduled__2024-05-10T23:49:00+00:00, run_start_date=2024-05-10 23:50:00.705196+00:00, run_end_date=2024-05-10 23:50:02.743267+00:00, run_duration=2.038071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:49:00+00:00, data_interval_end=2024-05-10 23:50:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:50:02.755107672Z [2024-05-10T23:50:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:51:00+00:00 2024-05-10T23:50:02.837175543Z [2024-05-10T23:50:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:48:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:02.837289313Z [2024-05-10T23:50:02.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:49:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:02.849179970Z [2024-05-10T23:50:02.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:49:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:01.841039+00:00, run_end_date=2024-05-10 23:50:02.327558+00:00, run_duration=0.486519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:00.790782+00:00, queued_by_job_id=2, pid=5457 2024-05-10T23:50:02.850846814Z [2024-05-10T23:50:02.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:48:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:02.121580+00:00, run_end_date=2024-05-10 23:50:02.584328+00:00, run_duration=0.462748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:00.790782+00:00, queued_by_job_id=2, pid=5458 2024-05-10T23:50:04.718605321Z [2024-05-10T23:50:04.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:50:04.718696934Z [2024-05-10T23:50:04.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:49:00+00:00, run_id=scheduled__2024-05-10T23:49:00+00:00, run_start_date=2024-05-10 23:50:00.706266+00:00, run_end_date=2024-05-10 23:50:04.718324+00:00, run_duration=4.012058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:49:00+00:00, data_interval_end=2024-05-10 23:50:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:50:04.729084144Z [2024-05-10T23:50:04.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:51:00+00:00 2024-05-10T23:50:04.757921177Z [2024-05-10T23:50:04.757+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:50:04.757948269Z 2024-05-10T23:50:04.758443727Z [2024-05-10T23:50:04.757+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:50:04.759307136Z [2024-05-10T23:50:04.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:50:04.759319752Z 2024-05-10T23:50:04.762702040Z [2024-05-10T23:50:04.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:50:04.762968025Z [2024-05-10T23:50:04.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:50:04.832369759Z [2024-05-10T23:50:04.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:04.832448846Z [2024-05-10T23:50:04.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:04.832453774Z [2024-05-10T23:50:04.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:49:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:04.841600565Z [2024-05-10T23:50:04.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59e80a5f-6521-4860-ba73-22e069c6cf1b 2024-05-10T23:50:04.841690501Z [2024-05-10T23:50:04.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:03.325713+00:00, run_end_date=2024-05-10 23:50:03.826528+00:00, run_duration=0.500815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:00.790782+00:00, queued_by_job_id=2, pid=5489 2024-05-10T23:50:04.841844180Z [2024-05-10T23:50:04.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:49:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:03.090576+00:00, run_end_date=2024-05-10 23:50:04.358997+00:00, run_duration=1.268421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:00.790782+00:00, queued_by_job_id=2, pid=5482 2024-05-10T23:50:06.019944069Z [2024-05-10T23:50:06.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:50:06.020507264Z [2024-05-10T23:50:06.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:49:00+00:00, run_id=scheduled__2024-05-10T23:49:00+00:00, run_start_date=2024-05-10 23:50:00.707187+00:00, run_end_date=2024-05-10 23:50:06.019847+00:00, run_duration=5.31266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:49:00+00:00, data_interval_end=2024-05-10 23:50:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:50:06.033086457Z [2024-05-10T23:50:06.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:51:00+00:00 2024-05-10T23:50:06.101101915Z [2024-05-10T23:50:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:49:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:06.107685299Z [2024-05-10T23:50:06.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:49:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:03.252083+00:00, run_end_date=2024-05-10 23:50:04.974744+00:00, run_duration=1.722661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:00.790782+00:00, queued_by_job_id=2, pid=5488 2024-05-10T23:50:07.602859883Z [2024-05-10T23:50:07.602+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:50:07.602888270Z 2024-05-10T23:50:07.603221611Z [2024-05-10T23:50:07.602+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:50:07.604014248Z [2024-05-10T23:50:07.603+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:50:07.604025509Z 2024-05-10T23:50:07.606530357Z [2024-05-10T23:50:07.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:50:07.606714763Z [2024-05-10T23:50:07.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:50:07.678913573Z [2024-05-10T23:50:07.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:07.680866609Z [2024-05-10T23:50:07.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:07.685951794Z [2024-05-10T23:50:07.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 622cce72-40d8-4fe7-81ae-b5d40172199d 2024-05-10T23:50:07.686205439Z [2024-05-10T23:50:07.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:06.495563+00:00, run_end_date=2024-05-10 23:50:06.871159+00:00, run_duration=0.375596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:04.760011+00:00, queued_by_job_id=2, pid=5522 2024-05-10T23:50:09.897010173Z [2024-05-10T23:50:09.896+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:50:09.897037469Z 2024-05-10T23:50:09.897058839Z [2024-05-10T23:50:09.896+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:50:09.897696336Z [2024-05-10T23:50:09.897+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:50:09.897712146Z 2024-05-10T23:50:09.899840541Z [2024-05-10T23:50:09.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:50:09.900048191Z [2024-05-10T23:50:09.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:50:09.945238013Z [2024-05-10T23:50:09.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status queued for try_number 1 2024-05-10T23:50:09.945384567Z [2024-05-10T23:50:09.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:09.953398338Z [2024-05-10T23:50:09.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1f0c99f-5a26-463e-a23a-cedaf0ae78a9 2024-05-10T23:50:09.953670094Z [2024-05-10T23:50:09.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=0, run_start_date=2024-05-10 23:50:09.339560+00:00, run_end_date=2024-05-10 23:50:09.696466+00:00, run_duration=0.356906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:07.604473+00:00, queued_by_job_id=2, pid=5533 2024-05-10T23:50:12.664296552Z [2024-05-10T23:50:12.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:50:12.664515985Z [2024-05-10T23:50:12.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:45:00+00:00, run_id=scheduled__2024-05-10T23:45:00+00:00, run_start_date=2024-05-10 23:50:00.702477+00:00, run_end_date=2024-05-10 23:50:12.664090+00:00, run_duration=11.961613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:45:00+00:00, data_interval_end=2024-05-10 23:50:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:50:12.671244600Z [2024-05-10T23:50:12.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:50:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:50:12.702064098Z [2024-05-10T23:50:12.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:45:00+00:00 exited with status success for try_number 1 2024-05-10T23:50:12.708834523Z [2024-05-10T23:50:12.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:45:00+00:00, map_index=-1, run_start_date=2024-05-10 23:50:11.554938+00:00, run_end_date=2024-05-10 23:50:11.905031+00:00, run_duration=0.350093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:50:09.898078+00:00, queued_by_job_id=2, pid=5541 2024-05-10T23:50:34.214908407Z [2024-05-10T23:50:34.214+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:51:00.437579717Z [2024-05-10T23:51:00.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:51:00+00:00, run_after=2024-05-10T23:52:00+00:00 2024-05-10T23:51:00.451885533Z [2024-05-10T23:51:00.451+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:51:00.481121924Z [2024-05-10T23:51:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:51:00+00:00, run_after=2024-05-10T23:52:00+00:00 2024-05-10T23:51:00.555477332Z [2024-05-10T23:51:00.554+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:51:00.555528483Z 2024-05-10T23:51:00.555533740Z 2024-05-10T23:51:00.555539159Z 2024-05-10T23:51:00.555990944Z [2024-05-10T23:51:00.555+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:51:00.556294063Z [2024-05-10T23:51:00.556+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:51:00.556579407Z [2024-05-10T23:51:00.556+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:51:00.557485194Z [2024-05-10T23:51:00.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:51:00.557500643Z 2024-05-10T23:51:00.557505097Z 2024-05-10T23:51:00.557509348Z 2024-05-10T23:51:00.561771999Z [2024-05-10T23:51:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:51:00.562194903Z [2024-05-10T23:51:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:51:00.562924119Z [2024-05-10T23:51:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:51:00.563206756Z [2024-05-10T23:51:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:51:00.563544462Z [2024-05-10T23:51:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:51:00.563792686Z [2024-05-10T23:51:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:51:00.862292537Z [2024-05-10T23:51:00.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:51:00.862585791Z [2024-05-10T23:51:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:51:00.862797670Z [2024-05-10T23:51:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:51:00.871737738Z [2024-05-10T23:51:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 984a4986-7bfe-45d2-a94a-248aba2f35d7 2024-05-10T23:51:00.871959623Z [2024-05-10T23:51:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53d2f616-6dfb-4899-920f-df9d9a61fd9b 2024-05-10T23:51:00.872156443Z [2024-05-10T23:51:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 322978c9-c0ff-444a-b28e-3ef233e1fc1d 2024-05-10T23:51:02.329570817Z [2024-05-10T23:51:02.328+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:51:02.330025634Z [2024-05-10T23:51:02.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:50:00+00:00, run_id=scheduled__2024-05-10T23:50:00+00:00, run_start_date=2024-05-10 23:51:00.495117+00:00, run_end_date=2024-05-10 23:51:02.329461+00:00, run_duration=1.834344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:50:00+00:00, data_interval_end=2024-05-10 23:51:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:51:02.340265152Z [2024-05-10T23:51:02.339+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:51:00+00:00, run_after=2024-05-10T23:52:00+00:00 2024-05-10T23:51:02.391455541Z [2024-05-10T23:51:02.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:51:02.401786789Z [2024-05-10T23:51:02.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:51:01.558795+00:00, run_end_date=2024-05-10 23:51:02.091812+00:00, run_duration=0.533017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:51:00.558680+00:00, queued_by_job_id=2, pid=5551 2024-05-10T23:51:05.204557242Z [2024-05-10T23:51:05.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:51:05.204591852Z [2024-05-10T23:51:05.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:50:00+00:00, run_id=scheduled__2024-05-10T23:50:00+00:00, run_start_date=2024-05-10 23:51:00.496525+00:00, run_end_date=2024-05-10 23:51:05.198961+00:00, run_duration=4.702436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:50:00+00:00, data_interval_end=2024-05-10 23:51:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:51:05.215800841Z [2024-05-10T23:51:05.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:51:00+00:00, run_after=2024-05-10T23:52:00+00:00 2024-05-10T23:51:05.224076659Z [2024-05-10T23:51:05.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:51:05.224346328Z [2024-05-10T23:51:05.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:50:00+00:00, run_id=scheduled__2024-05-10T23:50:00+00:00, run_start_date=2024-05-10 23:51:00.497572+00:00, run_end_date=2024-05-10 23:51:05.224011+00:00, run_duration=4.726439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:50:00+00:00, data_interval_end=2024-05-10 23:51:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:51:05.233322189Z [2024-05-10T23:51:05.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:51:00+00:00, run_after=2024-05-10T23:52:00+00:00 2024-05-10T23:51:05.269497653Z [2024-05-10T23:51:05.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:51:05.269670453Z [2024-05-10T23:51:05.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:51:05.278313836Z [2024-05-10T23:51:05.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:51:03.115580+00:00, run_end_date=2024-05-10 23:51:04.713558+00:00, run_duration=1.597978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:51:00.558680+00:00, queued_by_job_id=2, pid=5573 2024-05-10T23:51:05.279090957Z [2024-05-10T23:51:05.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:51:02.732028+00:00, run_end_date=2024-05-10 23:51:04.559039+00:00, run_duration=1.827011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:51:00.558680+00:00, queued_by_job_id=2, pid=5563 2024-05-10T23:52:00.343903504Z [2024-05-10T23:52:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:52:00+00:00, run_after=2024-05-10T23:53:00+00:00 2024-05-10T23:52:00.360130573Z [2024-05-10T23:52:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:52:00+00:00, run_after=2024-05-10T23:53:00+00:00 2024-05-10T23:52:00.369244400Z [2024-05-10T23:52:00.368+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:52:00.380744543Z [2024-05-10T23:52:00.380+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:52:00.517032485Z [2024-05-10T23:52:00.516+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:52:00.517066743Z 2024-05-10T23:52:00.517076798Z 2024-05-10T23:52:00.517082465Z 2024-05-10T23:52:00.517088337Z 2024-05-10T23:52:00.517435721Z [2024-05-10T23:52:00.516+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:52:00.517756533Z [2024-05-10T23:52:00.517+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:52:00.518198771Z [2024-05-10T23:52:00.517+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:52:00.518484383Z [2024-05-10T23:52:00.518+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:52:00.519513586Z [2024-05-10T23:52:00.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:52:00.519531770Z 2024-05-10T23:52:00.519538201Z 2024-05-10T23:52:00.519564651Z 2024-05-10T23:52:00.519574585Z 2024-05-10T23:52:00.525586511Z [2024-05-10T23:52:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:52:00.526329699Z [2024-05-10T23:52:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:52:00.527641079Z [2024-05-10T23:52:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:52:00.528430397Z [2024-05-10T23:52:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:52:00.529489074Z [2024-05-10T23:52:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:52:00.530191067Z [2024-05-10T23:52:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:52:00.531021779Z [2024-05-10T23:52:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:52:00.531536339Z [2024-05-10T23:52:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:52:00.909824100Z [2024-05-10T23:52:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:52:00.912338543Z [2024-05-10T23:52:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:51:00+00:00 exited with status queued for try_number 1 2024-05-10T23:52:00.912560902Z [2024-05-10T23:52:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:51:00+00:00 exited with status queued for try_number 1 2024-05-10T23:52:00.912724540Z [2024-05-10T23:52:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:51:00+00:00 exited with status queued for try_number 1 2024-05-10T23:52:00.921351488Z [2024-05-10T23:52:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 508fadc5-363f-4798-8d3c-6255bc6acc45 2024-05-10T23:52:00.921587451Z [2024-05-10T23:52:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 567199b3-442b-4dc9-8a74-fca91fc04534 2024-05-10T23:52:00.921781926Z [2024-05-10T23:52:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed879429-809b-4d55-8aa1-67ee126cff11 2024-05-10T23:52:00.922016314Z [2024-05-10T23:52:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3613e0d9-53d8-4e3c-913a-20891cfb8e26 2024-05-10T23:52:02.052684787Z [2024-05-10T23:52:02.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:52:02.052873765Z [2024-05-10T23:52:02.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:50:00+00:00, run_id=scheduled__2024-05-10T23:50:00+00:00, run_start_date=2024-05-10 23:52:00.403427+00:00, run_end_date=2024-05-10 23:52:02.052580+00:00, run_duration=1.649153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:50:00+00:00, data_interval_end=2024-05-10 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:52:02.061086619Z [2024-05-10T23:52:02.060+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:52:00+00:00, run_after=2024-05-10T23:54:00+00:00 2024-05-10T23:52:02.068895953Z [2024-05-10T23:52:02.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:52:02.069036217Z [2024-05-10T23:52:02.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:51:00+00:00, run_id=scheduled__2024-05-10T23:51:00+00:00, run_start_date=2024-05-10 23:52:00.407092+00:00, run_end_date=2024-05-10 23:52:02.068800+00:00, run_duration=1.661708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:51:00+00:00, data_interval_end=2024-05-10 23:52:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:52:02.080027764Z [2024-05-10T23:52:02.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:52:00+00:00, run_after=2024-05-10T23:53:00+00:00 2024-05-10T23:52:02.143253135Z [2024-05-10T23:52:02.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:52:02.143659857Z [2024-05-10T23:52:02.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:51:00+00:00 exited with status success for try_number 1 2024-05-10T23:52:02.156008260Z [2024-05-10T23:52:02.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:51:00+00:00, map_index=-1, run_start_date=2024-05-10 23:52:01.397361+00:00, run_end_date=2024-05-10 23:52:01.749168+00:00, run_duration=0.351807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:52:00.521180+00:00, queued_by_job_id=2, pid=5603 2024-05-10T23:52:02.156315446Z [2024-05-10T23:52:02.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:52:01.459499+00:00, run_end_date=2024-05-10 23:52:01.797352+00:00, run_duration=0.337853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:52:00.521180+00:00, queued_by_job_id=2, pid=5604 2024-05-10T23:52:04.316748306Z [2024-05-10T23:52:04.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:52:04.317367145Z [2024-05-10T23:52:04.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:51:00+00:00, run_id=scheduled__2024-05-10T23:51:00+00:00, run_start_date=2024-05-10 23:52:00.411050+00:00, run_end_date=2024-05-10 23:52:04.316593+00:00, run_duration=3.905543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:51:00+00:00, data_interval_end=2024-05-10 23:52:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:52:04.332226245Z [2024-05-10T23:52:04.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:52:00+00:00, run_after=2024-05-10T23:53:00+00:00 2024-05-10T23:52:04.340732328Z [2024-05-10T23:52:04.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:52:04.341553718Z [2024-05-10T23:52:04.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:51:00+00:00, run_id=scheduled__2024-05-10T23:51:00+00:00, run_start_date=2024-05-10 23:52:00.413624+00:00, run_end_date=2024-05-10 23:52:04.340952+00:00, run_duration=3.927328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:51:00+00:00, data_interval_end=2024-05-10 23:52:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:52:04.363357497Z [2024-05-10T23:52:04.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:52:00+00:00, run_after=2024-05-10T23:53:00+00:00 2024-05-10T23:52:04.407711416Z [2024-05-10T23:52:04.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:51:00+00:00 exited with status success for try_number 1 2024-05-10T23:52:04.407928921Z [2024-05-10T23:52:04.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:51:00+00:00 exited with status success for try_number 1 2024-05-10T23:52:04.420754619Z [2024-05-10T23:52:04.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:51:00+00:00, map_index=-1, run_start_date=2024-05-10 23:52:02.568865+00:00, run_end_date=2024-05-10 23:52:03.817804+00:00, run_duration=1.248939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:52:00.521180+00:00, queued_by_job_id=2, pid=5627 2024-05-10T23:52:04.422143912Z [2024-05-10T23:52:04.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:51:00+00:00, map_index=-1, run_start_date=2024-05-10 23:52:02.582803+00:00, run_end_date=2024-05-10 23:52:04.106178+00:00, run_duration=1.523375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:52:00.521180+00:00, queued_by_job_id=2, pid=5628 2024-05-10T23:53:00.070025053Z [2024-05-10T23:53:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:53:00.081191889Z [2024-05-10T23:53:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:53:00+00:00, run_after=2024-05-10T23:54:00+00:00 2024-05-10T23:53:00.100280254Z [2024-05-10T23:53:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:53:00+00:00, run_after=2024-05-10T23:54:00+00:00 2024-05-10T23:53:00.167801056Z [2024-05-10T23:53:00.167+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:53:00.167830020Z 2024-05-10T23:53:00.167834828Z 2024-05-10T23:53:00.167839519Z 2024-05-10T23:53:00.168223134Z [2024-05-10T23:53:00.167+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:53:00.168559081Z [2024-05-10T23:53:00.168+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:53:00.168869092Z [2024-05-10T23:53:00.168+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:53:00.170320219Z [2024-05-10T23:53:00.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:53:00.170373782Z 2024-05-10T23:53:00.170379369Z 2024-05-10T23:53:00.170383700Z 2024-05-10T23:53:00.176953575Z [2024-05-10T23:53:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:53:00.177305894Z [2024-05-10T23:53:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:53:00.177762906Z [2024-05-10T23:53:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:53:00.178022897Z [2024-05-10T23:53:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:53:00.178450152Z [2024-05-10T23:53:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:53:00.178732711Z [2024-05-10T23:53:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:53:00.762262358Z [2024-05-10T23:53:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status queued for try_number 1 2024-05-10T23:53:00.762641928Z [2024-05-10T23:53:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status queued for try_number 1 2024-05-10T23:53:00.762842247Z [2024-05-10T23:53:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status queued for try_number 1 2024-05-10T23:53:00.770774568Z [2024-05-10T23:53:00.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29a66907-34be-401f-8770-9dac21144543 2024-05-10T23:53:00.771089789Z [2024-05-10T23:53:00.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e24cc0c-d542-4841-a88a-844aef623e2a 2024-05-10T23:53:00.771318428Z [2024-05-10T23:53:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11156ed9-86fb-4398-9896-aa2cfc21e94f 2024-05-10T23:53:01.930164839Z [2024-05-10T23:53:01.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:53:01.930420746Z [2024-05-10T23:53:01.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:52:00+00:00, run_id=scheduled__2024-05-10T23:52:00+00:00, run_start_date=2024-05-10 23:53:00.115828+00:00, run_end_date=2024-05-10 23:53:01.930085+00:00, run_duration=1.814257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:52:00+00:00, data_interval_end=2024-05-10 23:53:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:53:01.942385798Z [2024-05-10T23:53:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:53:00+00:00, run_after=2024-05-10T23:54:00+00:00 2024-05-10T23:53:01.991388989Z [2024-05-10T23:53:01.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status success for try_number 1 2024-05-10T23:53:02.002006524Z [2024-05-10T23:53:02.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:52:00+00:00, map_index=-1, run_start_date=2024-05-10 23:53:01.212724+00:00, run_end_date=2024-05-10 23:53:01.621278+00:00, run_duration=0.408554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:53:00.172382+00:00, queued_by_job_id=2, pid=5660 2024-05-10T23:53:04.089982787Z [2024-05-10T23:53:04.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:53:04.090250785Z [2024-05-10T23:53:04.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:52:00+00:00, run_id=scheduled__2024-05-10T23:52:00+00:00, run_start_date=2024-05-10 23:53:00.117043+00:00, run_end_date=2024-05-10 23:53:04.089817+00:00, run_duration=3.972774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:52:00+00:00, data_interval_end=2024-05-10 23:53:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:53:04.101992890Z [2024-05-10T23:53:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:53:00+00:00, run_after=2024-05-10T23:54:00+00:00 2024-05-10T23:53:04.140035310Z [2024-05-10T23:53:04.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status success for try_number 1 2024-05-10T23:53:04.146894341Z [2024-05-10T23:53:04.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:52:00+00:00, map_index=-1, run_start_date=2024-05-10 23:53:02.383693+00:00, run_end_date=2024-05-10 23:53:03.666268+00:00, run_duration=1.282575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:53:00.172382+00:00, queued_by_job_id=2, pid=5673 2024-05-10T23:53:04.929972810Z [2024-05-10T23:53:04.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:53:04.930306068Z [2024-05-10T23:53:04.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:52:00+00:00, run_id=scheduled__2024-05-10T23:52:00+00:00, run_start_date=2024-05-10 23:53:00.118104+00:00, run_end_date=2024-05-10 23:53:04.929648+00:00, run_duration=4.811544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:52:00+00:00, data_interval_end=2024-05-10 23:53:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:53:04.942123164Z [2024-05-10T23:53:04.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:53:00+00:00, run_after=2024-05-10T23:54:00+00:00 2024-05-10T23:53:04.991331795Z [2024-05-10T23:53:04.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status success for try_number 1 2024-05-10T23:53:04.999368383Z [2024-05-10T23:53:04.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:52:00+00:00, map_index=-1, run_start_date=2024-05-10 23:53:02.605634+00:00, run_end_date=2024-05-10 23:53:04.178062+00:00, run_duration=1.572428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:53:00.172382+00:00, queued_by_job_id=2, pid=5679 2024-05-10T23:54:00.970191609Z [2024-05-10T23:54:00.969+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:54:00.987444557Z [2024-05-10T23:54:00.987+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:54:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:54:01.006618918Z [2024-05-10T23:54:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:54:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:54:01.019964820Z [2024-05-10T23:54:01.019+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:54:01.106243850Z [2024-05-10T23:54:01.105+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:54:01.106266112Z 2024-05-10T23:54:01.106278272Z 2024-05-10T23:54:01.106281623Z 2024-05-10T23:54:01.106284721Z 2024-05-10T23:54:01.106297735Z [2024-05-10T23:54:01.106+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:54:01.106351709Z [2024-05-10T23:54:01.106+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:54:01.106426417Z [2024-05-10T23:54:01.106+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:54:01.106498413Z [2024-05-10T23:54:01.106+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:54:01.107040089Z [2024-05-10T23:54:01.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:54:01.107046434Z 2024-05-10T23:54:01.107049819Z 2024-05-10T23:54:01.107064699Z 2024-05-10T23:54:01.107067754Z 2024-05-10T23:54:01.110695553Z [2024-05-10T23:54:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:54:01.110818116Z [2024-05-10T23:54:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:54:01.111009584Z [2024-05-10T23:54:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:54:01.111075161Z [2024-05-10T23:54:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:54:01.111243951Z [2024-05-10T23:54:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:54:01.111318920Z [2024-05-10T23:54:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:54:01.111454616Z [2024-05-10T23:54:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:54:01.111533964Z [2024-05-10T23:54:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:54:01.573229752Z [2024-05-10T23:54:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status queued for try_number 1 2024-05-10T23:54:01.573462479Z [2024-05-10T23:54:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:53:00+00:00 exited with status queued for try_number 1 2024-05-10T23:54:01.573596715Z [2024-05-10T23:54:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:53:00+00:00 exited with status queued for try_number 1 2024-05-10T23:54:01.573741091Z [2024-05-10T23:54:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:53:00+00:00 exited with status queued for try_number 1 2024-05-10T23:54:01.607479984Z [2024-05-10T23:54:01.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45f4c3ea-f805-41e2-9709-262e6b48d332 2024-05-10T23:54:01.607828611Z [2024-05-10T23:54:01.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c905c64-f35a-4022-8ec9-9b049c04e449 2024-05-10T23:54:01.608067452Z [2024-05-10T23:54:01.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46bd6c46-fd4c-491d-ae44-8b885e83da5e 2024-05-10T23:54:01.608317016Z [2024-05-10T23:54:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0c132ca-c933-4172-88c6-02e830e7c101 2024-05-10T23:54:02.888601906Z [2024-05-10T23:54:02.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:54:02.889033283Z [2024-05-10T23:54:02.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:52:00+00:00, run_id=scheduled__2024-05-10T23:52:00+00:00, run_start_date=2024-05-10 23:54:01.032961+00:00, run_end_date=2024-05-10 23:54:02.888480+00:00, run_duration=1.855519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:52:00+00:00, data_interval_end=2024-05-10 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:54:02.896513948Z [2024-05-10T23:54:02.896+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:54:00+00:00, run_after=2024-05-10T23:56:00+00:00 2024-05-10T23:54:02.903005406Z [2024-05-10T23:54:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:54:02.903388104Z [2024-05-10T23:54:02.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:53:00+00:00, run_id=scheduled__2024-05-10T23:53:00+00:00, run_start_date=2024-05-10 23:54:01.034314+00:00, run_end_date=2024-05-10 23:54:02.902880+00:00, run_duration=1.868566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:53:00+00:00, data_interval_end=2024-05-10 23:54:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:54:02.913957108Z [2024-05-10T23:54:02.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:54:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:54:02.963125788Z [2024-05-10T23:54:02.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:52:00+00:00 exited with status success for try_number 1 2024-05-10T23:54:02.963497686Z [2024-05-10T23:54:02.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:53:00+00:00 exited with status success for try_number 1 2024-05-10T23:54:02.973065613Z [2024-05-10T23:54:02.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:52:00+00:00, map_index=-1, run_start_date=2024-05-10 23:54:01.966517+00:00, run_end_date=2024-05-10 23:54:02.470752+00:00, run_duration=0.504235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:54:01.108028+00:00, queued_by_job_id=2, pid=5712 2024-05-10T23:54:02.973217264Z [2024-05-10T23:54:02.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:53:00+00:00, map_index=-1, run_start_date=2024-05-10 23:54:02.070634+00:00, run_end_date=2024-05-10 23:54:02.656005+00:00, run_duration=0.585371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:54:01.108028+00:00, queued_by_job_id=2, pid=5713 2024-05-10T23:54:04.982985366Z [2024-05-10T23:54:04.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:54:04.983357864Z [2024-05-10T23:54:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:53:00+00:00, run_id=scheduled__2024-05-10T23:53:00+00:00, run_start_date=2024-05-10 23:54:01.035395+00:00, run_end_date=2024-05-10 23:54:04.983008+00:00, run_duration=3.947613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:53:00+00:00, data_interval_end=2024-05-10 23:54:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:54:04.991449997Z [2024-05-10T23:54:04.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:54:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:54:05.357095880Z [2024-05-10T23:54:05.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:54:05.357419601Z [2024-05-10T23:54:05.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:53:00+00:00, run_id=scheduled__2024-05-10T23:53:00+00:00, run_start_date=2024-05-10 23:54:01.036417+00:00, run_end_date=2024-05-10 23:54:05.357004+00:00, run_duration=4.320587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:53:00+00:00, data_interval_end=2024-05-10 23:54:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:54:05.368468897Z [2024-05-10T23:54:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:54:00+00:00, run_after=2024-05-10T23:55:00+00:00 2024-05-10T23:54:05.410583112Z [2024-05-10T23:54:05.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:53:00+00:00 exited with status success for try_number 1 2024-05-10T23:54:05.410917066Z [2024-05-10T23:54:05.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:53:00+00:00 exited with status success for try_number 1 2024-05-10T23:54:05.419670642Z [2024-05-10T23:54:05.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:53:00+00:00, map_index=-1, run_start_date=2024-05-10 23:54:03.483164+00:00, run_end_date=2024-05-10 23:54:04.907787+00:00, run_duration=1.424623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:54:01.108028+00:00, queued_by_job_id=2, pid=5737 2024-05-10T23:54:05.420149821Z [2024-05-10T23:54:05.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:53:00+00:00, map_index=-1, run_start_date=2024-05-10 23:54:03.299110+00:00, run_end_date=2024-05-10 23:54:04.986951+00:00, run_duration=1.687841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:54:01.108028+00:00, queued_by_job_id=2, pid=5736 2024-05-10T23:55:00.567342960Z [2024-05-10T23:55:00.566+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:55:00+00:00, run_after=2024-05-10T23:56:00+00:00 2024-05-10T23:55:00.573319883Z [2024-05-10T23:55:00.573+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:55:00.584124652Z [2024-05-10T23:55:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:55:00+00:00, run_after=2024-05-10T23:56:00+00:00 2024-05-10T23:55:00.595998048Z [2024-05-10T23:55:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:55:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:55:00.694990523Z [2024-05-10T23:55:00.694+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:55:00.695022584Z 2024-05-10T23:55:00.695028227Z 2024-05-10T23:55:00.695031353Z 2024-05-10T23:55:00.695034462Z 2024-05-10T23:55:00.695044709Z [2024-05-10T23:55:00.694+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:55:00.695194862Z [2024-05-10T23:55:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:55:00.695340236Z [2024-05-10T23:55:00.695+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:55:00.695451604Z [2024-05-10T23:55:00.695+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:55:00.696370521Z [2024-05-10T23:55:00.696+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:55:00.696377843Z 2024-05-10T23:55:00.696381158Z 2024-05-10T23:55:00.696384161Z 2024-05-10T23:55:00.696387143Z 2024-05-10T23:55:00.702090137Z [2024-05-10T23:55:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-10T23:55:00.702357060Z [2024-05-10T23:55:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:55:00.702551374Z [2024-05-10T23:55:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:55:00.702621271Z [2024-05-10T23:55:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:55:00.702831731Z [2024-05-10T23:55:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:55:00.702922192Z [2024-05-10T23:55:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:55:00.703149376Z [2024-05-10T23:55:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:55:00.703404438Z [2024-05-10T23:55:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:55:00.991658513Z [2024-05-10T23:55:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:00.991700455Z [2024-05-10T23:55:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:00.991747001Z [2024-05-10T23:55:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:00.991815568Z [2024-05-10T23:55:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:01.009316384Z [2024-05-10T23:55:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9eeb45d-dd06-4c6f-9fb9-fe46b4478cf0 2024-05-10T23:55:01.009353121Z [2024-05-10T23:55:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a66c2aa-98ad-4207-86fc-58c09251fa18 2024-05-10T23:55:01.009470254Z [2024-05-10T23:55:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0cd19b2-31c6-4c64-a7f2-d2dbe412b6ea 2024-05-10T23:55:01.009657620Z [2024-05-10T23:55:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1051e20-094d-4231-b293-e1032f93f368 2024-05-10T23:55:02.400660150Z [2024-05-10T23:55:02.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:55:02.401057772Z [2024-05-10T23:55:02.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:54:00+00:00, run_id=scheduled__2024-05-10T23:54:00+00:00, run_start_date=2024-05-10 23:55:00.609017+00:00, run_end_date=2024-05-10 23:55:02.400572+00:00, run_duration=1.791555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:54:00+00:00, data_interval_end=2024-05-10 23:55:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:55:02.411904034Z [2024-05-10T23:55:02.411+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:55:00+00:00, run_after=2024-05-10T23:56:00+00:00 2024-05-10T23:55:02.461584502Z [2024-05-10T23:55:02.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:02.470507524Z [2024-05-10T23:55:02.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:54:00+00:00, map_index=-1, run_start_date=2024-05-10 23:55:01.701216+00:00, run_end_date=2024-05-10 23:55:02.162785+00:00, run_duration=0.461569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:00.697690+00:00, queued_by_job_id=2, pid=5771 2024-05-10T23:55:03.577584354Z [2024-05-10T23:55:03.577+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:55:03.577638692Z 2024-05-10T23:55:03.577646682Z [2024-05-10T23:55:03.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:55:03.578299127Z [2024-05-10T23:55:03.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:55:03.578319193Z 2024-05-10T23:55:03.581233782Z [2024-05-10T23:55:03.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-10T23:55:03.581264817Z [2024-05-10T23:55:03.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:55:03.637160698Z [2024-05-10T23:55:03.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:03.637467020Z [2024-05-10T23:55:03.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:03.646123464Z [2024-05-10T23:55:03.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00ba7e17-1a79-46e9-80e8-a772a1e71de3 2024-05-10T23:55:03.646715103Z [2024-05-10T23:55:03.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:55:02.620758+00:00, run_end_date=2024-05-10 23:55:02.985107+00:00, run_duration=0.364349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:00.697690+00:00, queued_by_job_id=2, pid=5795 2024-05-10T23:55:04.806985780Z [2024-05-10T23:55:04.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:55:04.807675581Z [2024-05-10T23:55:04.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:54:00+00:00, run_id=scheduled__2024-05-10T23:54:00+00:00, run_start_date=2024-05-10 23:55:00.611199+00:00, run_end_date=2024-05-10 23:55:04.807112+00:00, run_duration=4.195913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:54:00+00:00, data_interval_end=2024-05-10 23:55:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:55:04.818061771Z [2024-05-10T23:55:04.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:55:00+00:00, run_after=2024-05-10T23:56:00+00:00 2024-05-10T23:55:04.824986826Z [2024-05-10T23:55:04.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:55:04.825380775Z [2024-05-10T23:55:04.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:54:00+00:00, run_id=scheduled__2024-05-10T23:54:00+00:00, run_start_date=2024-05-10 23:55:00.612381+00:00, run_end_date=2024-05-10 23:55:04.825062+00:00, run_duration=4.212681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:54:00+00:00, data_interval_end=2024-05-10 23:55:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:55:04.834541007Z [2024-05-10T23:55:04.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:55:00+00:00, run_after=2024-05-10T23:56:00+00:00 2024-05-10T23:55:04.893249191Z [2024-05-10T23:55:04.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:04.893541754Z [2024-05-10T23:55:04.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:04.901396029Z [2024-05-10T23:55:04.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:54:00+00:00, map_index=-1, run_start_date=2024-05-10 23:55:02.779918+00:00, run_end_date=2024-05-10 23:55:04.131407+00:00, run_duration=1.351489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:00.697690+00:00, queued_by_job_id=2, pid=5797 2024-05-10T23:55:04.901789565Z [2024-05-10T23:55:04.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:54:00+00:00, map_index=-1, run_start_date=2024-05-10 23:55:02.738462+00:00, run_end_date=2024-05-10 23:55:04.475851+00:00, run_duration=1.737389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:00.697690+00:00, queued_by_job_id=2, pid=5796 2024-05-10T23:55:05.866669087Z [2024-05-10T23:55:05.866+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:55:05.866689245Z 2024-05-10T23:55:05.867021405Z [2024-05-10T23:55:05.866+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:55:05.867648715Z [2024-05-10T23:55:05.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:55:05.867660565Z 2024-05-10T23:55:05.870725362Z [2024-05-10T23:55:05.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-10T23:55:05.870948410Z [2024-05-10T23:55:05.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:55:05.924138232Z [2024-05-10T23:55:05.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:05.924405657Z [2024-05-10T23:55:05.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:05.931049031Z [2024-05-10T23:55:05.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6843c5ff-33f5-4cc8-b61c-3e3198a7738a 2024-05-10T23:55:05.931349541Z [2024-05-10T23:55:05.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:55:05.242812+00:00, run_end_date=2024-05-10 23:55:05.586523+00:00, run_duration=0.343711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:03.578623+00:00, queued_by_job_id=2, pid=5829 2024-05-10T23:55:08.315656228Z [2024-05-10T23:55:08.315+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-10T23:55:08.315732903Z 2024-05-10T23:55:08.315743569Z [2024-05-10T23:55:08.315+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:55:08.316309285Z [2024-05-10T23:55:08.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:55:08.316316059Z 2024-05-10T23:55:08.318773395Z [2024-05-10T23:55:08.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:55:08.318951061Z [2024-05-10T23:55:08.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:55:08.374579251Z [2024-05-10T23:55:08.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status queued for try_number 1 2024-05-10T23:55:08.374622469Z [2024-05-10T23:55:08.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:08.381829141Z [2024-05-10T23:55:08.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 228e3e93-80a4-4845-a4a8-810bb65faa53 2024-05-10T23:55:08.382075216Z [2024-05-10T23:55:08.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=0, run_start_date=2024-05-10 23:55:07.484318+00:00, run_end_date=2024-05-10 23:55:07.833058+00:00, run_duration=0.34874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:05.868206+00:00, queued_by_job_id=2, pid=5840 2024-05-10T23:55:10.608069796Z [2024-05-10T23:55:10.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:55:10.608662083Z [2024-05-10T23:55:10.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:50:00+00:00, run_id=scheduled__2024-05-10T23:50:00+00:00, run_start_date=2024-05-10 23:55:00.607505+00:00, run_end_date=2024-05-10 23:55:10.608176+00:00, run_duration=10.000671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:50:00+00:00, data_interval_end=2024-05-10 23:55:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-10T23:55:10.618961759Z [2024-05-10T23:55:10.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:55:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:55:10.653578535Z [2024-05-10T23:55:10.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:50:00+00:00 exited with status success for try_number 1 2024-05-10T23:55:10.660350058Z [2024-05-10T23:55:10.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:50:00+00:00, map_index=-1, run_start_date=2024-05-10 23:55:09.828533+00:00, run_end_date=2024-05-10 23:55:10.138110+00:00, run_duration=0.309577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:55:08.316501+00:00, queued_by_job_id=2, pid=5848 2024-05-10T23:55:34.282298223Z [2024-05-10T23:55:34.281+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-10T23:56:00.822261914Z [2024-05-10T23:56:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:56:00+00:00, run_after=2024-05-10T23:57:00+00:00 2024-05-10T23:56:00.837158634Z [2024-05-10T23:56:00.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:56:00+00:00, run_after=2024-05-10T23:57:00+00:00 2024-05-10T23:56:00.845983115Z [2024-05-10T23:56:00.845+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:56:00.852548752Z [2024-05-10T23:56:00.852+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:56:00.939024961Z [2024-05-10T23:56:00.938+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:56:00.939059976Z 2024-05-10T23:56:00.939064605Z 2024-05-10T23:56:00.939068138Z 2024-05-10T23:56:00.939071449Z 2024-05-10T23:56:00.939126415Z [2024-05-10T23:56:00.938+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:56:00.939131027Z [2024-05-10T23:56:00.939+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:56:00.939233399Z [2024-05-10T23:56:00.939+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:56:00.939268333Z [2024-05-10T23:56:00.939+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:56:00.939821717Z [2024-05-10T23:56:00.939+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:56:00.939833619Z 2024-05-10T23:56:00.939837547Z 2024-05-10T23:56:00.939840597Z 2024-05-10T23:56:00.939844478Z 2024-05-10T23:56:00.943460383Z [2024-05-10T23:56:00.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:56:00.943559042Z [2024-05-10T23:56:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:56:00.943769865Z [2024-05-10T23:56:00.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:56:00.943857258Z [2024-05-10T23:56:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:56:00.944030981Z [2024-05-10T23:56:00.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:56:00.944113453Z [2024-05-10T23:56:00.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:56:00.944256275Z [2024-05-10T23:56:00.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:56:00.944346884Z [2024-05-10T23:56:00.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:56:01.427213076Z [2024-05-10T23:56:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status queued for try_number 1 2024-05-10T23:56:01.427286924Z [2024-05-10T23:56:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:56:01.427356159Z [2024-05-10T23:56:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:56:01.427416473Z [2024-05-10T23:56:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-10T23:56:01.474896158Z [2024-05-10T23:56:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47c29578-34a7-44c0-a974-a28fc07f5d1f 2024-05-10T23:56:01.474968808Z [2024-05-10T23:56:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2a0d30d-510e-41aa-8613-f533b243a297 2024-05-10T23:56:01.475067966Z [2024-05-10T23:56:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b48407f-ae84-4b9c-8f67-62068c1b8a64 2024-05-10T23:56:01.475138780Z [2024-05-10T23:56:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to d252c7f8-6a08-4263-b1df-0d5508823564 2024-05-10T23:56:03.313189192Z [2024-05-10T23:56:03.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:56:03.313404593Z [2024-05-10T23:56:03.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:55:00+00:00, run_id=scheduled__2024-05-10T23:55:00+00:00, run_start_date=2024-05-10 23:56:00.865000+00:00, run_end_date=2024-05-10 23:56:03.313053+00:00, run_duration=2.448053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:55:00+00:00, data_interval_end=2024-05-10 23:56:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:56:03.323877903Z [2024-05-10T23:56:03.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:56:00+00:00, run_after=2024-05-10T23:57:00+00:00 2024-05-10T23:56:03.330941750Z [2024-05-10T23:56:03.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:56:03.331398015Z [2024-05-10T23:56:03.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:54:00+00:00, run_id=scheduled__2024-05-10T23:54:00+00:00, run_start_date=2024-05-10 23:56:00.862901+00:00, run_end_date=2024-05-10 23:56:03.330801+00:00, run_duration=2.4679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:54:00+00:00, data_interval_end=2024-05-10 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:56:03.339927269Z [2024-05-10T23:56:03.339+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:56:00+00:00, run_after=2024-05-10T23:58:00+00:00 2024-05-10T23:56:03.410313034Z [2024-05-10T23:56:03.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:54:00+00:00 exited with status success for try_number 1 2024-05-10T23:56:03.410578947Z [2024-05-10T23:56:03.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:56:03.417372983Z [2024-05-10T23:56:03.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=-1, run_start_date=2024-05-10 23:56:02.332907+00:00, run_end_date=2024-05-10 23:56:02.851254+00:00, run_duration=0.518347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:56:00.940588+00:00, queued_by_job_id=2, pid=5858 2024-05-10T23:56:03.417713841Z [2024-05-10T23:56:03.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:54:00+00:00, map_index=-1, run_start_date=2024-05-10 23:56:02.484980+00:00, run_end_date=2024-05-10 23:56:02.930860+00:00, run_duration=0.44588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:56:00.940588+00:00, queued_by_job_id=2, pid=5860 2024-05-10T23:56:05.565152350Z [2024-05-10T23:56:05.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:56:05.565556900Z [2024-05-10T23:56:05.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:55:00+00:00, run_id=scheduled__2024-05-10T23:55:00+00:00, run_start_date=2024-05-10 23:56:00.867147+00:00, run_end_date=2024-05-10 23:56:05.565050+00:00, run_duration=4.697903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:55:00+00:00, data_interval_end=2024-05-10 23:56:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:56:05.576598034Z [2024-05-10T23:56:05.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:56:00+00:00, run_after=2024-05-10T23:57:00+00:00 2024-05-10T23:56:05.585210393Z [2024-05-10T23:56:05.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:56:05.585619646Z [2024-05-10T23:56:05.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:55:00+00:00, run_id=scheduled__2024-05-10T23:55:00+00:00, run_start_date=2024-05-10 23:56:00.866037+00:00, run_end_date=2024-05-10 23:56:05.585128+00:00, run_duration=4.719091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:55:00+00:00, data_interval_end=2024-05-10 23:56:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:56:05.594879702Z [2024-05-10T23:56:05.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:56:00+00:00, run_after=2024-05-10T23:57:00+00:00 2024-05-10T23:56:05.623612474Z [2024-05-10T23:56:05.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:56:05.623800978Z [2024-05-10T23:56:05.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-10T23:56:05.631128705Z [2024-05-10T23:56:05.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=-1, run_start_date=2024-05-10 23:56:03.687177+00:00, run_end_date=2024-05-10 23:56:04.883864+00:00, run_duration=1.196687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:56:00.940588+00:00, queued_by_job_id=2, pid=5888 2024-05-10T23:56:05.631547318Z [2024-05-10T23:56:05.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=-1, run_start_date=2024-05-10 23:56:03.363305+00:00, run_end_date=2024-05-10 23:56:04.891004+00:00, run_duration=1.527699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:56:00.940588+00:00, queued_by_job_id=2, pid=5877 2024-05-10T23:57:00.065497797Z [2024-05-10T23:57:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:57:00+00:00, run_after=2024-05-10T23:58:00+00:00 2024-05-10T23:57:00.080352867Z [2024-05-10T23:57:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:57:00+00:00, run_after=2024-05-10T23:58:00+00:00 2024-05-10T23:57:00.087302469Z [2024-05-10T23:57:00.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:57:00.157395632Z [2024-05-10T23:57:00.157+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:57:00.157444768Z 2024-05-10T23:57:00.157449883Z 2024-05-10T23:57:00.157453795Z 2024-05-10T23:57:00.157515555Z [2024-05-10T23:57:00.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:57:00.157553616Z [2024-05-10T23:57:00.157+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:57:00.157714872Z [2024-05-10T23:57:00.157+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:57:00.158302389Z [2024-05-10T23:57:00.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:57:00.158312213Z 2024-05-10T23:57:00.158316368Z 2024-05-10T23:57:00.158320486Z 2024-05-10T23:57:00.162563318Z [2024-05-10T23:57:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:57:00.162682308Z [2024-05-10T23:57:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:57:00.163011635Z [2024-05-10T23:57:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:57:00.163118939Z [2024-05-10T23:57:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:57:00.163386649Z [2024-05-10T23:57:00.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:57:00.163492093Z [2024-05-10T23:57:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:57:00.596792079Z [2024-05-10T23:57:00.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status queued for try_number 1 2024-05-10T23:57:00.597351810Z [2024-05-10T23:57:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status queued for try_number 1 2024-05-10T23:57:00.597649035Z [2024-05-10T23:57:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status queued for try_number 1 2024-05-10T23:57:00.610740149Z [2024-05-10T23:57:00.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d164d05-3658-42a6-af61-4d5214cbb82c 2024-05-10T23:57:00.611091601Z [2024-05-10T23:57:00.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to b13e6625-1b51-48ab-a0b8-55fbf8f065cc 2024-05-10T23:57:00.611367135Z [2024-05-10T23:57:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70c58f24-727f-4d70-be52-2800e8776ed8 2024-05-10T23:57:01.779259763Z [2024-05-10T23:57:01.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:57:01.779811945Z [2024-05-10T23:57:01.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:56:00+00:00, run_id=scheduled__2024-05-10T23:56:00+00:00, run_start_date=2024-05-10 23:57:00.104638+00:00, run_end_date=2024-05-10 23:57:01.779429+00:00, run_duration=1.674791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:56:00+00:00, data_interval_end=2024-05-10 23:57:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:57:01.789691029Z [2024-05-10T23:57:01.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:57:00+00:00, run_after=2024-05-10T23:58:00+00:00 2024-05-10T23:57:01.840133573Z [2024-05-10T23:57:01.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status success for try_number 1 2024-05-10T23:57:01.846111353Z [2024-05-10T23:57:01.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:56:00+00:00, map_index=-1, run_start_date=2024-05-10 23:57:01.106136+00:00, run_end_date=2024-05-10 23:57:01.608115+00:00, run_duration=0.501979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:57:00.159717+00:00, queued_by_job_id=2, pid=5914 2024-05-10T23:57:04.086214081Z [2024-05-10T23:57:04.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:57:04.086259026Z [2024-05-10T23:57:04.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:56:00+00:00, run_id=scheduled__2024-05-10T23:56:00+00:00, run_start_date=2024-05-10 23:57:00.105802+00:00, run_end_date=2024-05-10 23:57:04.084479+00:00, run_duration=3.978677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:56:00+00:00, data_interval_end=2024-05-10 23:57:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:57:04.100723305Z [2024-05-10T23:57:04.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:57:00+00:00, run_after=2024-05-10T23:58:00+00:00 2024-05-10T23:57:04.150274672Z [2024-05-10T23:57:04.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status success for try_number 1 2024-05-10T23:57:04.155458452Z [2024-05-10T23:57:04.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:56:00+00:00, map_index=-1, run_start_date=2024-05-10 23:57:02.256742+00:00, run_end_date=2024-05-10 23:57:03.926743+00:00, run_duration=1.670001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:57:00.159717+00:00, queued_by_job_id=2, pid=5932 2024-05-10T23:57:05.214295073Z [2024-05-10T23:57:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:57:05.214575888Z [2024-05-10T23:57:05.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:56:00+00:00, run_id=scheduled__2024-05-10T23:56:00+00:00, run_start_date=2024-05-10 23:57:00.106817+00:00, run_end_date=2024-05-10 23:57:05.214181+00:00, run_duration=5.107364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:56:00+00:00, data_interval_end=2024-05-10 23:57:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:57:05.239873590Z [2024-05-10T23:57:05.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:57:00+00:00, run_after=2024-05-10T23:58:00+00:00 2024-05-10T23:57:05.268363029Z [2024-05-10T23:57:05.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status success for try_number 1 2024-05-10T23:57:05.278014006Z [2024-05-10T23:57:05.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:56:00+00:00, map_index=-1, run_start_date=2024-05-10 23:57:02.332845+00:00, run_end_date=2024-05-10 23:57:04.659864+00:00, run_duration=2.327019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:57:00.159717+00:00, queued_by_job_id=2, pid=5933 2024-05-10T23:58:00.927539567Z [2024-05-10T23:58:00.927+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:58:00.934408519Z [2024-05-10T23:58:00.934+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:58:00.949770328Z [2024-05-10T23:58:00.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:58:00+00:00, run_after=2024-05-10T23:59:00+00:00 2024-05-10T23:58:00.962653265Z [2024-05-10T23:58:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:58:00+00:00, run_after=2024-05-10T23:59:00+00:00 2024-05-10T23:58:01.065656486Z [2024-05-10T23:58:01.065+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-10T23:58:01.065690763Z 2024-05-10T23:58:01.065698022Z 2024-05-10T23:58:01.065704632Z 2024-05-10T23:58:01.065710523Z 2024-05-10T23:58:01.067021610Z [2024-05-10T23:58:01.065+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-10T23:58:01.067038915Z [2024-05-10T23:58:01.065+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:58:01.067042489Z [2024-05-10T23:58:01.066+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:58:01.067045602Z [2024-05-10T23:58:01.066+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:58:01.069029301Z [2024-05-10T23:58:01.068+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:58:01.069042867Z 2024-05-10T23:58:01.069049120Z 2024-05-10T23:58:01.069052411Z 2024-05-10T23:58:01.069055879Z 2024-05-10T23:58:01.111417523Z [2024-05-10T23:58:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:58:01.111899172Z [2024-05-10T23:58:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:58:01.112677243Z [2024-05-10T23:58:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:58:01.113016830Z [2024-05-10T23:58:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:58:01.113457841Z [2024-05-10T23:58:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:58:01.113698338Z [2024-05-10T23:58:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:58:01.114235745Z [2024-05-10T23:58:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:58:01.114512376Z [2024-05-10T23:58:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:58:01.707275616Z [2024-05-10T23:58:01.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status queued for try_number 1 2024-05-10T23:58:01.707427231Z [2024-05-10T23:58:01.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:57:00+00:00 exited with status queued for try_number 1 2024-05-10T23:58:01.707556677Z [2024-05-10T23:58:01.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:57:00+00:00 exited with status queued for try_number 1 2024-05-10T23:58:01.707656355Z [2024-05-10T23:58:01.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:57:00+00:00 exited with status queued for try_number 1 2024-05-10T23:58:01.730695411Z [2024-05-10T23:58:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13f1ff51-a8e9-4558-ad96-4203b93381ac 2024-05-10T23:58:01.730871161Z [2024-05-10T23:58:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc966809-c811-4ad5-b010-739d963331d0 2024-05-10T23:58:01.731089906Z [2024-05-10T23:58:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebd1786e-b175-40b3-985c-726a86a3a70d 2024-05-10T23:58:01.731235698Z [2024-05-10T23:58:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43916e80-12f2-47db-8e39-77e4f40b0668 2024-05-10T23:58:03.003761656Z [2024-05-10T23:58:03.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:58:03.004023548Z [2024-05-10T23:58:03.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:57:00+00:00, run_id=scheduled__2024-05-10T23:57:00+00:00, run_start_date=2024-05-10 23:58:00.976797+00:00, run_end_date=2024-05-10 23:58:03.003551+00:00, run_duration=2.026754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:57:00+00:00, data_interval_end=2024-05-10 23:58:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:58:03.017086981Z [2024-05-10T23:58:03.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:58:00+00:00, run_after=2024-05-10T23:59:00+00:00 2024-05-10T23:58:03.023911685Z [2024-05-10T23:58:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:58:03.024117266Z [2024-05-10T23:58:03.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:56:00+00:00, run_id=scheduled__2024-05-10T23:56:00+00:00, run_start_date=2024-05-10 23:58:00.975429+00:00, run_end_date=2024-05-10 23:58:03.023701+00:00, run_duration=2.048272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:56:00+00:00, data_interval_end=2024-05-10 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-10T23:58:03.031514571Z [2024-05-10T23:58:03.031+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-10T23:58:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:58:03.082774114Z [2024-05-10T23:58:03.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:56:00+00:00 exited with status success for try_number 1 2024-05-10T23:58:03.082799673Z [2024-05-10T23:58:03.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:57:00+00:00 exited with status success for try_number 1 2024-05-10T23:58:03.089516198Z [2024-05-10T23:58:03.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:56:00+00:00, map_index=-1, run_start_date=2024-05-10 23:58:02.094433+00:00, run_end_date=2024-05-10 23:58:02.455280+00:00, run_duration=0.360847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:58:01.098224+00:00, queued_by_job_id=2, pid=5967 2024-05-10T23:58:03.089813017Z [2024-05-10T23:58:03.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:57:00+00:00, map_index=-1, run_start_date=2024-05-10 23:58:02.013624+00:00, run_end_date=2024-05-10 23:58:02.461923+00:00, run_duration=0.448299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:58:01.098224+00:00, queued_by_job_id=2, pid=5966 2024-05-10T23:58:05.017061092Z [2024-05-10T23:58:05.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:58:05.017569769Z [2024-05-10T23:58:05.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:57:00+00:00, run_id=scheduled__2024-05-10T23:57:00+00:00, run_start_date=2024-05-10 23:58:00.978086+00:00, run_end_date=2024-05-10 23:58:05.017155+00:00, run_duration=4.039069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:57:00+00:00, data_interval_end=2024-05-10 23:58:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:58:05.028743729Z [2024-05-10T23:58:05.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:58:00+00:00, run_after=2024-05-10T23:59:00+00:00 2024-05-10T23:58:05.079985707Z [2024-05-10T23:58:05.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:57:00+00:00 exited with status success for try_number 1 2024-05-10T23:58:05.085747854Z [2024-05-10T23:58:05.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:57:00+00:00, map_index=-1, run_start_date=2024-05-10 23:58:03.115269+00:00, run_end_date=2024-05-10 23:58:04.674397+00:00, run_duration=1.559128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:58:01.098224+00:00, queued_by_job_id=2, pid=5991 2024-05-10T23:58:06.123947953Z [2024-05-10T23:58:06.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:58:06.124279126Z [2024-05-10T23:58:06.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:57:00+00:00, run_id=scheduled__2024-05-10T23:57:00+00:00, run_start_date=2024-05-10 23:58:00.979267+00:00, run_end_date=2024-05-10 23:58:06.123949+00:00, run_duration=5.144682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:57:00+00:00, data_interval_end=2024-05-10 23:58:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:58:06.132539706Z [2024-05-10T23:58:06.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:58:00+00:00, run_after=2024-05-10T23:59:00+00:00 2024-05-10T23:58:06.168718740Z [2024-05-10T23:58:06.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:57:00+00:00 exited with status success for try_number 1 2024-05-10T23:58:06.176940918Z [2024-05-10T23:58:06.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:57:00+00:00, map_index=-1, run_start_date=2024-05-10 23:58:03.058924+00:00, run_end_date=2024-05-10 23:58:05.275894+00:00, run_duration=2.21697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:58:01.098224+00:00, queued_by_job_id=2, pid=5990 2024-05-10T23:59:00.832773853Z [2024-05-10T23:59:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-10T23:59:00.854460813Z [2024-05-10T23:59:00.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:59:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:59:00.869032824Z [2024-05-10T23:59:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:59:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:59:00.932894755Z [2024-05-10T23:59:00.932+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-10T23:59:00.932925190Z 2024-05-10T23:59:00.932930517Z 2024-05-10T23:59:00.932935295Z 2024-05-10T23:59:00.933039636Z [2024-05-10T23:59:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:59:00.933166626Z [2024-05-10T23:59:00.933+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-10T23:59:00.933470797Z [2024-05-10T23:59:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-10T23:59:00.934289235Z [2024-05-10T23:59:00.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-10T23:59:00.934306256Z 2024-05-10T23:59:00.934312440Z 2024-05-10T23:59:00.934317684Z 2024-05-10T23:59:00.941392786Z [2024-05-10T23:59:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:59:00.941475304Z [2024-05-10T23:59:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:59:00.941661303Z [2024-05-10T23:59:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:59:00.941735854Z [2024-05-10T23:59:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:59:00.941926354Z [2024-05-10T23:59:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-10T23:59:00.942046078Z [2024-05-10T23:59:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:59:01.296917268Z [2024-05-10T23:59:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status queued for try_number 1 2024-05-10T23:59:01.297386580Z [2024-05-10T23:59:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status queued for try_number 1 2024-05-10T23:59:01.297663311Z [2024-05-10T23:59:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status queued for try_number 1 2024-05-10T23:59:01.306866751Z [2024-05-10T23:59:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3af2a528-1910-45e2-b1d1-dd4dd725bf8e 2024-05-10T23:59:01.307177961Z [2024-05-10T23:59:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24d41cb2-a6f9-49fc-9726-f148fd7d6779 2024-05-10T23:59:01.307485253Z [2024-05-10T23:59:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5253321b-9b2f-4a74-afa4-319c0833ddcd 2024-05-10T23:59:02.452314211Z [2024-05-10T23:59:02.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:59:02.452729976Z [2024-05-10T23:59:02.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:58:00+00:00, run_id=scheduled__2024-05-10T23:58:00+00:00, run_start_date=2024-05-10 23:59:00.878898+00:00, run_end_date=2024-05-10 23:59:02.452188+00:00, run_duration=1.57329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:58:00+00:00, data_interval_end=2024-05-10 23:59:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-10T23:59:02.463126798Z [2024-05-10T23:59:02.462+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-10T23:59:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:59:02.510817158Z [2024-05-10T23:59:02.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status success for try_number 1 2024-05-10T23:59:02.515544504Z [2024-05-10T23:59:02.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:58:00+00:00, map_index=-1, run_start_date=2024-05-10 23:59:01.921527+00:00, run_end_date=2024-05-10 23:59:02.289236+00:00, run_duration=0.367709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:59:00.935339+00:00, queued_by_job_id=2, pid=6023 2024-05-10T23:59:04.839034231Z [2024-05-10T23:59:04.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:59:04.839578467Z [2024-05-10T23:59:04.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:58:00+00:00, run_id=scheduled__2024-05-10T23:58:00+00:00, run_start_date=2024-05-10 23:59:00.880134+00:00, run_end_date=2024-05-10 23:59:04.838924+00:00, run_duration=3.95879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:58:00+00:00, data_interval_end=2024-05-10 23:59:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-10T23:59:04.851184233Z [2024-05-10T23:59:04.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:59:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:59:04.904560734Z [2024-05-10T23:59:04.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status success for try_number 1 2024-05-10T23:59:04.910373068Z [2024-05-10T23:59:04.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:58:00+00:00, map_index=-1, run_start_date=2024-05-10 23:59:02.970770+00:00, run_end_date=2024-05-10 23:59:04.647574+00:00, run_duration=1.676804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:59:00.935339+00:00, queued_by_job_id=2, pid=6041 2024-05-10T23:59:05.985176316Z [2024-05-10T23:59:05.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-10T23:59:05.985481769Z [2024-05-10T23:59:05.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:58:00+00:00, run_id=scheduled__2024-05-10T23:58:00+00:00, run_start_date=2024-05-10 23:59:00.881137+00:00, run_end_date=2024-05-10 23:59:05.985061+00:00, run_duration=5.103924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:58:00+00:00, data_interval_end=2024-05-10 23:59:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-10T23:59:05.994051219Z [2024-05-10T23:59:05.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-10T23:59:00+00:00, run_after=2024-05-11T00:00:00+00:00 2024-05-10T23:59:06.033956712Z [2024-05-10T23:59:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status success for try_number 1 2024-05-10T23:59:06.040298521Z [2024-05-10T23:59:06.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:58:00+00:00, map_index=-1, run_start_date=2024-05-10 23:59:03.116938+00:00, run_end_date=2024-05-10 23:59:05.873493+00:00, run_duration=2.756555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-10 23:59:00.935339+00:00, queued_by_job_id=2, pid=6042 2024-05-11T00:00:00.714995652Z [2024-05-11T00:00:00.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:00:00.722479855Z [2024-05-11T00:00:00.722+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:00:00.734020793Z [2024-05-11T00:00:00.733+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:01:00+00:00 2024-05-11T00:00:00.740299779Z [2024-05-11T00:00:00.739+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:00:00.754606026Z [2024-05-11T00:00:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:01:00+00:00 2024-05-11T00:00:00.856525571Z [2024-05-11T00:00:00.856+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:00:00.856561333Z 2024-05-11T00:00:00.856568873Z 2024-05-11T00:00:00.856575734Z 2024-05-11T00:00:00.856581696Z 2024-05-11T00:00:00.856587832Z 2024-05-11T00:00:00.856957092Z [2024-05-11T00:00:00.856+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:00:00.857301546Z [2024-05-11T00:00:00.857+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:00:00.857453564Z [2024-05-11T00:00:00.857+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:00:00.857643565Z [2024-05-11T00:00:00.857+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:00:00.858091690Z [2024-05-11T00:00:00.857+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:00:00.858817132Z [2024-05-11T00:00:00.858+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:00:00.858826018Z 2024-05-11T00:00:00.858845020Z 2024-05-11T00:00:00.858849166Z 2024-05-11T00:00:00.858853494Z 2024-05-11T00:00:00.858857499Z 2024-05-11T00:00:00.863698109Z [2024-05-11T00:00:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:00:00.863778683Z [2024-05-11T00:00:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:00:00.863992625Z [2024-05-11T00:00:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-10T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:00:00.864090415Z [2024-05-11T00:00:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:00:00.864225139Z [2024-05-11T00:00:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:00:00.864316575Z [2024-05-11T00:00:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:00:00.864467587Z [2024-05-11T00:00:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:00:00.864531329Z [2024-05-11T00:00:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:00:00.864693240Z [2024-05-11T00:00:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-10T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:00:00.864759658Z [2024-05-11T00:00:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:00:01.439890133Z [2024-05-11T00:00:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:01.442365229Z [2024-05-11T00:00:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:01.442974433Z [2024-05-11T00:00:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:59:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:01.444643314Z [2024-05-11T00:00:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:59:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:01.444871348Z [2024-05-11T00:00:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:59:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:01.461711724Z [2024-05-11T00:00:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea8c505c-cf65-4566-ba6c-43c8ae7e6477 2024-05-11T00:00:01.462190567Z [2024-05-11T00:00:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a3dfb26-7ce1-4e9b-be10-a2d879683bf8 2024-05-11T00:00:01.465580802Z [2024-05-11T00:00:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab1bd833-123a-4f15-9871-eb57c3a30098 2024-05-11T00:00:01.465938833Z [2024-05-11T00:00:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to f84c3b27-1829-47f5-be60-0e920f2d0a29 2024-05-11T00:00:01.466154150Z [2024-05-11T00:00:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8c2452a-6f9b-41c2-b2ed-3023089e1397 2024-05-11T00:00:02.922959718Z [2024-05-11T00:00:02.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:00:02.923159516Z [2024-05-11T00:00:02.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-10 23:58:00+00:00, run_id=scheduled__2024-05-10T23:58:00+00:00, run_start_date=2024-05-11 00:00:00.767033+00:00, run_end_date=2024-05-11 00:00:02.922849+00:00, run_duration=2.155816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:58:00+00:00, data_interval_end=2024-05-11 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:00:02.930950222Z [2024-05-11T00:00:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:02:00+00:00 2024-05-11T00:00:02.937053688Z [2024-05-11T00:00:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:00:02.937193059Z [2024-05-11T00:00:02.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-10 23:59:00+00:00, run_id=scheduled__2024-05-10T23:59:00+00:00, run_start_date=2024-05-11 00:00:00.768208+00:00, run_end_date=2024-05-11 00:00:02.936965+00:00, run_duration=2.168757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:59:00+00:00, data_interval_end=2024-05-11 00:00:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:00:02.946914511Z [2024-05-11T00:00:02.946+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:01:00+00:00 2024-05-11T00:00:03.016667534Z [2024-05-11T00:00:03.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-10T23:58:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:03.016689744Z [2024-05-11T00:00:03.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:59:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:03.023148481Z [2024-05-11T00:00:03.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-10T23:58:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:01.896525+00:00, run_end_date=2024-05-11 00:00:02.366158+00:00, run_duration=0.469633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:00.860328+00:00, queued_by_job_id=2, pid=6072 2024-05-11T00:00:03.023252436Z [2024-05-11T00:00:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:59:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:02.376874+00:00, run_end_date=2024-05-11 00:00:02.759652+00:00, run_duration=0.382778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:00.860328+00:00, queued_by_job_id=2, pid=6084 2024-05-11T00:00:05.235835297Z [2024-05-11T00:00:05.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:00:05.236059426Z [2024-05-11T00:00:05.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:59:00+00:00, run_id=scheduled__2024-05-10T23:59:00+00:00, run_start_date=2024-05-11 00:00:00.769275+00:00, run_end_date=2024-05-11 00:00:05.235685+00:00, run_duration=4.46641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:59:00+00:00, data_interval_end=2024-05-11 00:00:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:00:05.255358146Z [2024-05-11T00:00:05.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:01:00+00:00 2024-05-11T00:00:05.263201056Z [2024-05-11T00:00:05.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:00:05.263447228Z [2024-05-11T00:00:05.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:59:00+00:00, run_id=scheduled__2024-05-10T23:59:00+00:00, run_start_date=2024-05-11 00:00:00.770413+00:00, run_end_date=2024-05-11 00:00:05.263053+00:00, run_duration=4.49264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:59:00+00:00, data_interval_end=2024-05-11 00:00:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:00:05.272598578Z [2024-05-11T00:00:05.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:01:00+00:00 2024-05-11T00:00:05.296814123Z [2024-05-11T00:00:05.296+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:00:05.296866519Z 2024-05-11T00:00:05.297065484Z [2024-05-11T00:00:05.296+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:00:05.298235740Z [2024-05-11T00:00:05.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:00:05.298273906Z 2024-05-11T00:00:05.303180872Z [2024-05-11T00:00:05.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:00:05.303510344Z [2024-05-11T00:00:05.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:00:05.366009285Z [2024-05-11T00:00:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:05.366151371Z [2024-05-11T00:00:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:05.366162782Z [2024-05-11T00:00:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:59:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:05.366167442Z [2024-05-11T00:00:05.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-10T23:59:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:05.387416322Z [2024-05-11T00:00:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:59:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:03.235463+00:00, run_end_date=2024-05-11 00:00:04.529245+00:00, run_duration=1.293782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:00.860328+00:00, queued_by_job_id=2, pid=6102 2024-05-11T00:00:05.387530907Z [2024-05-11T00:00:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-10T23:59:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:03.296101+00:00, run_end_date=2024-05-11 00:00:04.834864+00:00, run_duration=1.538763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:00.860328+00:00, queued_by_job_id=2, pid=6103 2024-05-11T00:00:05.387676353Z [2024-05-11T00:00:05.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 792512d5-8bb1-4ca8-8dcd-44be5c744e9d 2024-05-11T00:00:05.387829475Z [2024-05-11T00:00:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:03.819586+00:00, run_end_date=2024-05-11 00:00:04.215469+00:00, run_duration=0.395883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:00.860328+00:00, queued_by_job_id=2, pid=6119 2024-05-11T00:00:07.665630803Z [2024-05-11T00:00:07.665+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:00:07.665667500Z 2024-05-11T00:00:07.666015983Z [2024-05-11T00:00:07.665+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:00:07.666638422Z [2024-05-11T00:00:07.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:00:07.666649945Z 2024-05-11T00:00:07.669002782Z [2024-05-11T00:00:07.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:00:07.669283347Z [2024-05-11T00:00:07.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:00:07.785351526Z [2024-05-11T00:00:07.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:07.785774597Z [2024-05-11T00:00:07.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:07.806058032Z [2024-05-11T00:00:07.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27c8e830-1e30-48e9-9317-991fbc827bce 2024-05-11T00:00:07.806154885Z [2024-05-11T00:00:07.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:07.095904+00:00, run_end_date=2024-05-11 00:00:07.536909+00:00, run_duration=0.441005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:05.298899+00:00, queued_by_job_id=2, pid=6142 2024-05-11T00:00:10.153165109Z [2024-05-11T00:00:10.152+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:00:10.153200618Z 2024-05-11T00:00:10.153763204Z [2024-05-11T00:00:10.153+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:00:10.154822620Z [2024-05-11T00:00:10.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:00:10.154834843Z 2024-05-11T00:00:10.158308179Z [2024-05-11T00:00:10.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-10T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:00:10.158841581Z [2024-05-11T00:00:10.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:00:10.219631525Z [2024-05-11T00:00:10.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:00:10.220283540Z [2024-05-11T00:00:10.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:10.228990758Z [2024-05-11T00:00:10.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee9e9478-22d9-415b-a067-1a83dcd967af 2024-05-11T00:00:10.229612376Z [2024-05-11T00:00:10.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=0, run_start_date=2024-05-11 00:00:09.389786+00:00, run_end_date=2024-05-11 00:00:09.775144+00:00, run_duration=0.385358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:07.667134+00:00, queued_by_job_id=2, pid=6153 2024-05-11T00:00:12.741558488Z [2024-05-11T00:00:12.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:00:12.741624135Z [2024-05-11T00:00:12.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-10 23:55:00+00:00, run_id=scheduled__2024-05-10T23:55:00+00:00, run_start_date=2024-05-11 00:00:00.765701+00:00, run_end_date=2024-05-11 00:00:12.741369+00:00, run_duration=11.975668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-10 23:55:00+00:00, data_interval_end=2024-05-11 00:00:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:00:12.748475573Z [2024-05-11T00:00:12.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:00:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:00:12.808914136Z [2024-05-11T00:00:12.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-10T23:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:00:12.819399333Z [2024-05-11T00:00:12.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-10T23:55:00+00:00, map_index=-1, run_start_date=2024-05-11 00:00:11.876264+00:00, run_end_date=2024-05-11 00:00:12.241710+00:00, run_duration=0.365446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:00:10.155487+00:00, queued_by_job_id=2, pid=6161 2024-05-11T00:00:34.358147382Z [2024-05-11T00:00:34.356+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:01:01.009431666Z [2024-05-11T00:01:01.009+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:01:00+00:00, run_after=2024-05-11T00:02:00+00:00 2024-05-11T00:01:01.038192029Z [2024-05-11T00:01:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:01:01.058297317Z [2024-05-11T00:01:01.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:01:00+00:00, run_after=2024-05-11T00:02:00+00:00 2024-05-11T00:01:01.154175251Z [2024-05-11T00:01:01.153+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:01:01.154210120Z 2024-05-11T00:01:01.154216063Z 2024-05-11T00:01:01.154220597Z 2024-05-11T00:01:01.154413314Z [2024-05-11T00:01:01.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:01:01.154633568Z [2024-05-11T00:01:01.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:01:01.154832473Z [2024-05-11T00:01:01.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:01:01.155624826Z [2024-05-11T00:01:01.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:01:01.155636844Z 2024-05-11T00:01:01.155654685Z 2024-05-11T00:01:01.155671208Z 2024-05-11T00:01:01.159698979Z [2024-05-11T00:01:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:01:01.159985456Z [2024-05-11T00:01:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:01:01.160405293Z [2024-05-11T00:01:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:01:01.160750179Z [2024-05-11T00:01:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:01:01.161124422Z [2024-05-11T00:01:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:01:01.161335636Z [2024-05-11T00:01:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:01:01.407547278Z [2024-05-11T00:01:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:01:01.407643529Z [2024-05-11T00:01:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:01:01.407700509Z [2024-05-11T00:01:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:01:01.416471503Z [2024-05-11T00:01:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc636205-e84f-4b8d-b05e-c4f0edb26045 2024-05-11T00:01:01.416550117Z [2024-05-11T00:01:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d63dd11-6353-40fb-9dcb-4d0d3084c772 2024-05-11T00:01:01.416607393Z [2024-05-11T00:01:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2850b2e7-9bca-4808-b936-7462292e7563 2024-05-11T00:01:03.583639695Z [2024-05-11T00:01:03.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:01:03.584000785Z [2024-05-11T00:01:03.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:00:00+00:00, run_id=scheduled__2024-05-11T00:00:00+00:00, run_start_date=2024-05-11 00:01:01.083757+00:00, run_end_date=2024-05-11 00:01:03.583452+00:00, run_duration=2.499695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:00:00+00:00, data_interval_end=2024-05-11 00:01:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:01:03.592865035Z [2024-05-11T00:01:03.592+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:01:00+00:00, run_after=2024-05-11T00:02:00+00:00 2024-05-11T00:01:03.650349182Z [2024-05-11T00:01:03.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:01:03.659344202Z [2024-05-11T00:01:03.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:01:02.019967+00:00, run_end_date=2024-05-11 00:01:02.448896+00:00, run_duration=0.428929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:01:01.156544+00:00, queued_by_job_id=2, pid=6170 2024-05-11T00:01:06.900294960Z [2024-05-11T00:01:06.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:01:06.900491785Z [2024-05-11T00:01:06.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:00:00+00:00, run_id=scheduled__2024-05-11T00:00:00+00:00, run_start_date=2024-05-11 00:01:01.090977+00:00, run_end_date=2024-05-11 00:01:06.899832+00:00, run_duration=5.808855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:00:00+00:00, data_interval_end=2024-05-11 00:01:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:01:06.912000522Z [2024-05-11T00:01:06.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:01:00+00:00, run_after=2024-05-11T00:02:00+00:00 2024-05-11T00:01:06.920233648Z [2024-05-11T00:01:06.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:01:06.920597739Z [2024-05-11T00:01:06.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:00:00+00:00, run_id=scheduled__2024-05-11T00:00:00+00:00, run_start_date=2024-05-11 00:01:01.086276+00:00, run_end_date=2024-05-11 00:01:06.920062+00:00, run_duration=5.833786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:00:00+00:00, data_interval_end=2024-05-11 00:01:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:01:06.939324078Z [2024-05-11T00:01:06.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:01:00+00:00, run_after=2024-05-11T00:02:00+00:00 2024-05-11T00:01:06.981854377Z [2024-05-11T00:01:06.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:01:06.982304963Z [2024-05-11T00:01:06.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:01:06.991331492Z [2024-05-11T00:01:06.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:01:03.155229+00:00, run_end_date=2024-05-11 00:01:06.299422+00:00, run_duration=3.144193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:01:01.156544+00:00, queued_by_job_id=2, pid=6189 2024-05-11T00:01:06.991889766Z [2024-05-11T00:01:06.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:01:03.082087+00:00, run_end_date=2024-05-11 00:01:05.954244+00:00, run_duration=2.872157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:01:01.156544+00:00, queued_by_job_id=2, pid=6188 2024-05-11T00:02:00.124521571Z [2024-05-11T00:02:00.123+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:02:00.131164459Z [2024-05-11T00:02:00.130+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:02:00.144069741Z [2024-05-11T00:02:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:02:00+00:00, run_after=2024-05-11T00:03:00+00:00 2024-05-11T00:02:00.158297982Z [2024-05-11T00:02:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:02:00+00:00, run_after=2024-05-11T00:03:00+00:00 2024-05-11T00:02:00.245376529Z [2024-05-11T00:02:00.244+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:02:00.245406169Z 2024-05-11T00:02:00.245411810Z 2024-05-11T00:02:00.245416504Z 2024-05-11T00:02:00.245421486Z 2024-05-11T00:02:00.245618905Z [2024-05-11T00:02:00.245+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:02:00.245818900Z [2024-05-11T00:02:00.245+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:02:00.246128867Z [2024-05-11T00:02:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:02:00.246323590Z [2024-05-11T00:02:00.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:02:00.247109470Z [2024-05-11T00:02:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:02:00.247120297Z 2024-05-11T00:02:00.247125245Z 2024-05-11T00:02:00.247129725Z 2024-05-11T00:02:00.247134221Z 2024-05-11T00:02:00.251371274Z [2024-05-11T00:02:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:02:00.251616555Z [2024-05-11T00:02:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:02:00.251931727Z [2024-05-11T00:02:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:02:00.252118167Z [2024-05-11T00:02:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:02:00.252395439Z [2024-05-11T00:02:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:02:00.252586114Z [2024-05-11T00:02:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:02:00.252840158Z [2024-05-11T00:02:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:02:00.253013432Z [2024-05-11T00:02:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:02:00.758432771Z [2024-05-11T00:02:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:02:00.758980706Z [2024-05-11T00:02:00.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:01:00+00:00 exited with status queued for try_number 1 2024-05-11T00:02:00.770280855Z [2024-05-11T00:02:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:01:00+00:00 exited with status queued for try_number 1 2024-05-11T00:02:00.770582451Z [2024-05-11T00:02:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:01:00+00:00 exited with status queued for try_number 1 2024-05-11T00:02:00.785300063Z [2024-05-11T00:02:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02e89f58-e7cb-453e-98b2-8d51d65ab58c 2024-05-11T00:02:00.785610059Z [2024-05-11T00:02:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 111d7928-5a43-416d-a47b-5dd68dbafc43 2024-05-11T00:02:00.785841381Z [2024-05-11T00:02:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to be5961de-2705-4db0-a43d-6c5d2affabef 2024-05-11T00:02:00.786084794Z [2024-05-11T00:02:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62b8c174-8d40-42c3-90cc-019fe6d18cf1 2024-05-11T00:02:02.115289474Z [2024-05-11T00:02:02.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:02:02.115700258Z [2024-05-11T00:02:02.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:00:00+00:00, run_id=scheduled__2024-05-11T00:00:00+00:00, run_start_date=2024-05-11 00:02:00.169554+00:00, run_end_date=2024-05-11 00:02:02.115338+00:00, run_duration=1.945784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:00:00+00:00, data_interval_end=2024-05-11 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:02:02.123174350Z [2024-05-11T00:02:02.122+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:02:00+00:00, run_after=2024-05-11T00:04:00+00:00 2024-05-11T00:02:02.136985247Z [2024-05-11T00:02:02.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:02:02.137235171Z [2024-05-11T00:02:02.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:01:00+00:00, run_id=scheduled__2024-05-11T00:01:00+00:00, run_start_date=2024-05-11 00:02:00.170790+00:00, run_end_date=2024-05-11 00:02:02.136963+00:00, run_duration=1.966173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:01:00+00:00, data_interval_end=2024-05-11 00:02:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:02:02.147373252Z [2024-05-11T00:02:02.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:02:00+00:00, run_after=2024-05-11T00:03:00+00:00 2024-05-11T00:02:02.188479836Z [2024-05-11T00:02:02.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:02:02.188599183Z [2024-05-11T00:02:02.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:01:00+00:00 exited with status success for try_number 1 2024-05-11T00:02:02.195593503Z [2024-05-11T00:02:02.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:01:00+00:00, map_index=-1, run_start_date=2024-05-11 00:02:01.354630+00:00, run_end_date=2024-05-11 00:02:01.760920+00:00, run_duration=0.40629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:02:00.248273+00:00, queued_by_job_id=2, pid=6223 2024-05-11T00:02:02.195858605Z [2024-05-11T00:02:02.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:02:01.115364+00:00, run_end_date=2024-05-11 00:02:01.590578+00:00, run_duration=0.475214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:02:00.248273+00:00, queued_by_job_id=2, pid=6222 2024-05-11T00:02:04.348949202Z [2024-05-11T00:02:04.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:02:04.349386642Z [2024-05-11T00:02:04.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:01:00+00:00, run_id=scheduled__2024-05-11T00:01:00+00:00, run_start_date=2024-05-11 00:02:00.172769+00:00, run_end_date=2024-05-11 00:02:04.349011+00:00, run_duration=4.176242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:01:00+00:00, data_interval_end=2024-05-11 00:02:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:02:04.358739625Z [2024-05-11T00:02:04.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:02:00+00:00, run_after=2024-05-11T00:03:00+00:00 2024-05-11T00:02:04.366978637Z [2024-05-11T00:02:04.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:02:04.367334679Z [2024-05-11T00:02:04.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:01:00+00:00, run_id=scheduled__2024-05-11T00:01:00+00:00, run_start_date=2024-05-11 00:02:00.171768+00:00, run_end_date=2024-05-11 00:02:04.366870+00:00, run_duration=4.195102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:01:00+00:00, data_interval_end=2024-05-11 00:02:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:02:04.378317216Z [2024-05-11T00:02:04.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:02:00+00:00, run_after=2024-05-11T00:03:00+00:00 2024-05-11T00:02:04.439680036Z [2024-05-11T00:02:04.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:01:00+00:00 exited with status success for try_number 1 2024-05-11T00:02:04.440045210Z [2024-05-11T00:02:04.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:01:00+00:00 exited with status success for try_number 1 2024-05-11T00:02:04.452315958Z [2024-05-11T00:02:04.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:01:00+00:00, map_index=-1, run_start_date=2024-05-11 00:02:02.363597+00:00, run_end_date=2024-05-11 00:02:04.056375+00:00, run_duration=1.692778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:02:00.248273+00:00, queued_by_job_id=2, pid=6246 2024-05-11T00:02:04.452713555Z [2024-05-11T00:02:04.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:01:00+00:00, map_index=-1, run_start_date=2024-05-11 00:02:02.414877+00:00, run_end_date=2024-05-11 00:02:03.689053+00:00, run_duration=1.274176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:02:00.248273+00:00, queued_by_job_id=2, pid=6247 2024-05-11T00:03:00.404221315Z [2024-05-11T00:03:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:03:00+00:00, run_after=2024-05-11T00:04:00+00:00 2024-05-11T00:03:00.420132410Z [2024-05-11T00:03:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:03:00+00:00, run_after=2024-05-11T00:04:00+00:00 2024-05-11T00:03:00.426164698Z [2024-05-11T00:03:00.425+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:03:00.520365460Z [2024-05-11T00:03:00.519+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:03:00.520438457Z 2024-05-11T00:03:00.520447015Z 2024-05-11T00:03:00.520453430Z 2024-05-11T00:03:00.520533570Z [2024-05-11T00:03:00.520+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:03:00.520774336Z [2024-05-11T00:03:00.520+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:03:00.521002874Z [2024-05-11T00:03:00.520+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:03:00.522616146Z [2024-05-11T00:03:00.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:03:00.522633331Z 2024-05-11T00:03:00.522640256Z 2024-05-11T00:03:00.522645996Z 2024-05-11T00:03:00.532150134Z [2024-05-11T00:03:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:03:00.532211474Z [2024-05-11T00:03:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:03:00.532598332Z [2024-05-11T00:03:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:03:00.532750122Z [2024-05-11T00:03:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:03:00.533031499Z [2024-05-11T00:03:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:03:00.533250776Z [2024-05-11T00:03:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:03:00.846934379Z [2024-05-11T00:03:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status queued for try_number 1 2024-05-11T00:03:00.847173628Z [2024-05-11T00:03:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status queued for try_number 1 2024-05-11T00:03:00.847344073Z [2024-05-11T00:03:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status queued for try_number 1 2024-05-11T00:03:00.857424226Z [2024-05-11T00:03:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to efa4b79c-def8-4bf7-8f3a-d5c27aa48017 2024-05-11T00:03:00.857851911Z [2024-05-11T00:03:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8601ac2c-e52f-48ca-bac9-9055a2bbef91 2024-05-11T00:03:00.858266000Z [2024-05-11T00:03:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dc4c5de-881c-4ac6-beec-459e22cbf121 2024-05-11T00:03:02.093277979Z [2024-05-11T00:03:02.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:03:02.093631769Z [2024-05-11T00:03:02.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:02:00+00:00, run_id=scheduled__2024-05-11T00:02:00+00:00, run_start_date=2024-05-11 00:03:00.435777+00:00, run_end_date=2024-05-11 00:03:02.093170+00:00, run_duration=1.657393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:02:00+00:00, data_interval_end=2024-05-11 00:03:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:03:02.114535579Z [2024-05-11T00:03:02.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:03:00+00:00, run_after=2024-05-11T00:04:00+00:00 2024-05-11T00:03:02.186293569Z [2024-05-11T00:03:02.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status success for try_number 1 2024-05-11T00:03:02.194988033Z [2024-05-11T00:03:02.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:02:00+00:00, map_index=-1, run_start_date=2024-05-11 00:03:01.493949+00:00, run_end_date=2024-05-11 00:03:01.900195+00:00, run_duration=0.406246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:03:00.525937+00:00, queued_by_job_id=2, pid=6279 2024-05-11T00:03:04.250877764Z [2024-05-11T00:03:04.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:03:04.251239123Z [2024-05-11T00:03:04.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:02:00+00:00, run_id=scheduled__2024-05-11T00:02:00+00:00, run_start_date=2024-05-11 00:03:00.437034+00:00, run_end_date=2024-05-11 00:03:04.250865+00:00, run_duration=3.813831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:02:00+00:00, data_interval_end=2024-05-11 00:03:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:03:04.262051559Z [2024-05-11T00:03:04.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:03:00+00:00, run_after=2024-05-11T00:04:00+00:00 2024-05-11T00:03:04.309496630Z [2024-05-11T00:03:04.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status success for try_number 1 2024-05-11T00:03:04.321796149Z [2024-05-11T00:03:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:02:00+00:00, map_index=-1, run_start_date=2024-05-11 00:03:02.772384+00:00, run_end_date=2024-05-11 00:03:04.126291+00:00, run_duration=1.353907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:03:00.525937+00:00, queued_by_job_id=2, pid=6297 2024-05-11T00:03:05.386893635Z [2024-05-11T00:03:05.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:03:05.387301512Z [2024-05-11T00:03:05.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:02:00+00:00, run_id=scheduled__2024-05-11T00:02:00+00:00, run_start_date=2024-05-11 00:03:00.438024+00:00, run_end_date=2024-05-11 00:03:05.386799+00:00, run_duration=4.948775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:02:00+00:00, data_interval_end=2024-05-11 00:03:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:03:05.400818574Z [2024-05-11T00:03:05.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:03:00+00:00, run_after=2024-05-11T00:04:00+00:00 2024-05-11T00:03:05.441293544Z [2024-05-11T00:03:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status success for try_number 1 2024-05-11T00:03:05.446204233Z [2024-05-11T00:03:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:02:00+00:00, map_index=-1, run_start_date=2024-05-11 00:03:02.903141+00:00, run_end_date=2024-05-11 00:03:04.793329+00:00, run_duration=1.890188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:03:00.525937+00:00, queued_by_job_id=2, pid=6298 2024-05-11T00:04:00.066222666Z [2024-05-11T00:04:00.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:04:00.080912581Z [2024-05-11T00:04:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:04:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:04:00.088250033Z [2024-05-11T00:04:00.087+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:04:00.105989404Z [2024-05-11T00:04:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:04:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:04:00.187627302Z [2024-05-11T00:04:00.187+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:04:00.187670761Z 2024-05-11T00:04:00.187676656Z 2024-05-11T00:04:00.187679792Z 2024-05-11T00:04:00.187683035Z 2024-05-11T00:04:00.187859045Z [2024-05-11T00:04:00.187+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:04:00.188040481Z [2024-05-11T00:04:00.187+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:04:00.188196796Z [2024-05-11T00:04:00.188+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:04:00.188347718Z [2024-05-11T00:04:00.188+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:04:00.188986092Z [2024-05-11T00:04:00.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:04:00.188999339Z 2024-05-11T00:04:00.189003009Z 2024-05-11T00:04:00.189006222Z 2024-05-11T00:04:00.189009340Z 2024-05-11T00:04:00.192629741Z [2024-05-11T00:04:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:04:00.192854295Z [2024-05-11T00:04:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:04:00.193152726Z [2024-05-11T00:04:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:04:00.193324285Z [2024-05-11T00:04:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:04:00.193577267Z [2024-05-11T00:04:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:04:00.193741985Z [2024-05-11T00:04:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:04:00.194035750Z [2024-05-11T00:04:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:04:00.194203600Z [2024-05-11T00:04:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:04:00.570038878Z [2024-05-11T00:04:00.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status queued for try_number 1 2024-05-11T00:04:00.570287458Z [2024-05-11T00:04:00.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:03:00+00:00 exited with status queued for try_number 1 2024-05-11T00:04:00.570452700Z [2024-05-11T00:04:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:03:00+00:00 exited with status queued for try_number 1 2024-05-11T00:04:00.570586205Z [2024-05-11T00:04:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:03:00+00:00 exited with status queued for try_number 1 2024-05-11T00:04:00.579385690Z [2024-05-11T00:04:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03289c89-bebc-485f-93ab-3db5f7c3bb3b 2024-05-11T00:04:00.579594633Z [2024-05-11T00:04:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6fc1911-038f-4402-ad94-147eb3e4b3ea 2024-05-11T00:04:00.579780958Z [2024-05-11T00:04:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4211da2-34d4-40de-93bd-01754142e90d 2024-05-11T00:04:00.580010756Z [2024-05-11T00:04:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac58e42a-ade9-44de-962c-6225a7cd11d9 2024-05-11T00:04:01.739972651Z [2024-05-11T00:04:01.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:04:01.740298129Z [2024-05-11T00:04:01.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:02:00+00:00, run_id=scheduled__2024-05-11T00:02:00+00:00, run_start_date=2024-05-11 00:04:00.116986+00:00, run_end_date=2024-05-11 00:04:01.739971+00:00, run_duration=1.622985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:02:00+00:00, data_interval_end=2024-05-11 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:04:01.747722587Z [2024-05-11T00:04:01.747+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:04:00+00:00, run_after=2024-05-11T00:06:00+00:00 2024-05-11T00:04:01.757002991Z [2024-05-11T00:04:01.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:04:01.757266287Z [2024-05-11T00:04:01.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:03:00+00:00, run_id=scheduled__2024-05-11T00:03:00+00:00, run_start_date=2024-05-11 00:04:00.118647+00:00, run_end_date=2024-05-11 00:04:01.756988+00:00, run_duration=1.638341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:03:00+00:00, data_interval_end=2024-05-11 00:04:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:04:01.766902550Z [2024-05-11T00:04:01.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:04:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:04:01.812477164Z [2024-05-11T00:04:01.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:02:00+00:00 exited with status success for try_number 1 2024-05-11T00:04:01.812500743Z [2024-05-11T00:04:01.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:03:00+00:00 exited with status success for try_number 1 2024-05-11T00:04:01.820020938Z [2024-05-11T00:04:01.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:02:00+00:00, map_index=-1, run_start_date=2024-05-11 00:04:00.983582+00:00, run_end_date=2024-05-11 00:04:01.409577+00:00, run_duration=0.425995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:04:00.189861+00:00, queued_by_job_id=2, pid=6331 2024-05-11T00:04:01.820396686Z [2024-05-11T00:04:01.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:03:00+00:00, map_index=-1, run_start_date=2024-05-11 00:04:01.187756+00:00, run_end_date=2024-05-11 00:04:01.598618+00:00, run_duration=0.410862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:04:00.189861+00:00, queued_by_job_id=2, pid=6332 2024-05-11T00:04:03.988686790Z [2024-05-11T00:04:03.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:04:03.988983180Z [2024-05-11T00:04:03.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:03:00+00:00, run_id=scheduled__2024-05-11T00:03:00+00:00, run_start_date=2024-05-11 00:04:00.119716+00:00, run_end_date=2024-05-11 00:04:03.988581+00:00, run_duration=3.868865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:03:00+00:00, data_interval_end=2024-05-11 00:04:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:04:03.997770663Z [2024-05-11T00:04:03.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:04:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:04:04.057121246Z [2024-05-11T00:04:04.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:03:00+00:00 exited with status success for try_number 1 2024-05-11T00:04:04.064431981Z [2024-05-11T00:04:04.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:03:00+00:00, map_index=-1, run_start_date=2024-05-11 00:04:02.320864+00:00, run_end_date=2024-05-11 00:04:03.760095+00:00, run_duration=1.439231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:04:00.189861+00:00, queued_by_job_id=2, pid=6355 2024-05-11T00:04:05.114146851Z [2024-05-11T00:04:05.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:04:05.114437535Z [2024-05-11T00:04:05.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:03:00+00:00, run_id=scheduled__2024-05-11T00:03:00+00:00, run_start_date=2024-05-11 00:04:00.120737+00:00, run_end_date=2024-05-11 00:04:05.113683+00:00, run_duration=4.992946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:03:00+00:00, data_interval_end=2024-05-11 00:04:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:04:05.127405433Z [2024-05-11T00:04:05.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:04:00+00:00, run_after=2024-05-11T00:05:00+00:00 2024-05-11T00:04:05.172745704Z [2024-05-11T00:04:05.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:03:00+00:00 exited with status success for try_number 1 2024-05-11T00:04:05.186289927Z [2024-05-11T00:04:05.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:03:00+00:00, map_index=-1, run_start_date=2024-05-11 00:04:02.369728+00:00, run_end_date=2024-05-11 00:04:04.287741+00:00, run_duration=1.918013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:04:00.189861+00:00, queued_by_job_id=2, pid=6356 2024-05-11T00:05:00.911430138Z [2024-05-11T00:05:00.910+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:05:00.940867981Z [2024-05-11T00:05:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:06:00+00:00 2024-05-11T00:05:00.958129870Z [2024-05-11T00:05:00.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:05:00.975556662Z [2024-05-11T00:05:00.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:06:00+00:00 2024-05-11T00:05:01.068083769Z [2024-05-11T00:05:01.067+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:05:01.068102035Z 2024-05-11T00:05:01.068108283Z 2024-05-11T00:05:01.068111743Z 2024-05-11T00:05:01.068114951Z 2024-05-11T00:05:01.068540402Z [2024-05-11T00:05:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:05:01.068850492Z [2024-05-11T00:05:01.068+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:05:01.069227376Z [2024-05-11T00:05:01.068+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:05:01.069563014Z [2024-05-11T00:05:01.069+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:05:01.070971404Z [2024-05-11T00:05:01.070+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:05:01.070984926Z 2024-05-11T00:05:01.070988751Z 2024-05-11T00:05:01.070992133Z 2024-05-11T00:05:01.070995372Z 2024-05-11T00:05:01.079737152Z [2024-05-11T00:05:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:05:01.080081559Z [2024-05-11T00:05:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:05:01.080588317Z [2024-05-11T00:05:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:05:01.080900513Z [2024-05-11T00:05:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:05:01.081409234Z [2024-05-11T00:05:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:05:01.081668815Z [2024-05-11T00:05:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:05:01.082056076Z [2024-05-11T00:05:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:05:01.082293135Z [2024-05-11T00:05:01.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:05:01.429338346Z [2024-05-11T00:05:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:01.429371374Z [2024-05-11T00:05:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:01.429413614Z [2024-05-11T00:05:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:01.429470279Z [2024-05-11T00:05:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:01.439899027Z [2024-05-11T00:05:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75c3f760-580f-47b6-bc15-fceebefaaf03 2024-05-11T00:05:01.439939408Z [2024-05-11T00:05:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 882b4237-7ae1-44c5-8991-a96f14a72e66 2024-05-11T00:05:01.440057119Z [2024-05-11T00:05:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to db0e7515-9f87-4962-b14a-34cde01ac3bb 2024-05-11T00:05:01.440156386Z [2024-05-11T00:05:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09105df1-fc84-40dd-8061-846b4cf45f4e 2024-05-11T00:05:02.697749497Z [2024-05-11T00:05:02.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:05:02.697998422Z [2024-05-11T00:05:02.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:04:00+00:00, run_id=scheduled__2024-05-11T00:04:00+00:00, run_start_date=2024-05-11 00:05:00.988579+00:00, run_end_date=2024-05-11 00:05:02.697647+00:00, run_duration=1.709068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:04:00+00:00, data_interval_end=2024-05-11 00:05:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:05:02.710326066Z [2024-05-11T00:05:02.710+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:06:00+00:00 2024-05-11T00:05:02.762683064Z [2024-05-11T00:05:02.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:02.777893024Z [2024-05-11T00:05:02.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:04:00+00:00, map_index=-1, run_start_date=2024-05-11 00:05:01.965293+00:00, run_end_date=2024-05-11 00:05:02.320629+00:00, run_duration=0.355336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:01.072652+00:00, queued_by_job_id=2, pid=6388 2024-05-11T00:05:03.903051390Z [2024-05-11T00:05:03.902+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:05:03.903078401Z 2024-05-11T00:05:03.903082568Z [2024-05-11T00:05:03.902+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:05:03.903675861Z [2024-05-11T00:05:03.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:05:03.903687802Z 2024-05-11T00:05:03.906480468Z [2024-05-11T00:05:03.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:05:03.906581873Z [2024-05-11T00:05:03.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:05:03.966583961Z [2024-05-11T00:05:03.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:03.966653860Z [2024-05-11T00:05:03.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:03.975321446Z [2024-05-11T00:05:03.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1f0e1e6-6839-49fa-8f54-0900103c7b5f 2024-05-11T00:05:03.975419289Z [2024-05-11T00:05:03.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:05:03.102670+00:00, run_end_date=2024-05-11 00:05:03.530984+00:00, run_duration=0.428314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:01.072652+00:00, queued_by_job_id=2, pid=6414 2024-05-11T00:05:05.190362373Z [2024-05-11T00:05:05.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:05:05.190500282Z [2024-05-11T00:05:05.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:04:00+00:00, run_id=scheduled__2024-05-11T00:04:00+00:00, run_start_date=2024-05-11 00:05:00.989563+00:00, run_end_date=2024-05-11 00:05:05.187306+00:00, run_duration=4.197743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:04:00+00:00, data_interval_end=2024-05-11 00:05:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:05:05.201678717Z [2024-05-11T00:05:05.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:06:00+00:00 2024-05-11T00:05:05.210549701Z [2024-05-11T00:05:05.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:05:05.210809615Z [2024-05-11T00:05:05.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:04:00+00:00, run_id=scheduled__2024-05-11T00:04:00+00:00, run_start_date=2024-05-11 00:05:00.990428+00:00, run_end_date=2024-05-11 00:05:05.210464+00:00, run_duration=4.220036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:04:00+00:00, data_interval_end=2024-05-11 00:05:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:05:05.227180505Z [2024-05-11T00:05:05.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:06:00+00:00 2024-05-11T00:05:05.289545128Z [2024-05-11T00:05:05.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:05.290184963Z [2024-05-11T00:05:05.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:05.299059290Z [2024-05-11T00:05:05.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:04:00+00:00, map_index=-1, run_start_date=2024-05-11 00:05:02.967945+00:00, run_end_date=2024-05-11 00:05:04.276646+00:00, run_duration=1.308701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:01.072652+00:00, queued_by_job_id=2, pid=6412 2024-05-11T00:05:05.299555669Z [2024-05-11T00:05:05.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:04:00+00:00, map_index=-1, run_start_date=2024-05-11 00:05:03.036356+00:00, run_end_date=2024-05-11 00:05:04.799291+00:00, run_duration=1.762935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:01.072652+00:00, queued_by_job_id=2, pid=6413 2024-05-11T00:05:06.388770514Z [2024-05-11T00:05:06.388+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:05:06.388801754Z 2024-05-11T00:05:06.389198955Z [2024-05-11T00:05:06.388+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:05:06.390412365Z [2024-05-11T00:05:06.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:05:06.390433965Z 2024-05-11T00:05:06.393971821Z [2024-05-11T00:05:06.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:05:06.394365727Z [2024-05-11T00:05:06.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:05:06.436504622Z [2024-05-11T00:05:06.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:06.436771570Z [2024-05-11T00:05:06.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:06.442802658Z [2024-05-11T00:05:06.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8853c805-0ba7-4eee-a85f-cde7e085ae1b 2024-05-11T00:05:06.443154817Z [2024-05-11T00:05:06.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:05:05.539008+00:00, run_end_date=2024-05-11 00:05:05.918261+00:00, run_duration=0.379253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:03.904107+00:00, queued_by_job_id=2, pid=6447 2024-05-11T00:05:08.890444176Z [2024-05-11T00:05:08.889+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:05:08.890690445Z 2024-05-11T00:05:08.891023938Z [2024-05-11T00:05:08.890+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:05:08.891908898Z [2024-05-11T00:05:08.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:05:08.891922087Z 2024-05-11T00:05:08.894765277Z [2024-05-11T00:05:08.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:05:08.894973591Z [2024-05-11T00:05:08.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:05:08.954862785Z [2024-05-11T00:05:08.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status queued for try_number 1 2024-05-11T00:05:08.955136580Z [2024-05-11T00:05:08.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:08.960599321Z [2024-05-11T00:05:08.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c16602c-8f40-4186-a1a6-60481d779b64 2024-05-11T00:05:08.961619705Z [2024-05-11T00:05:08.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=0, run_start_date=2024-05-11 00:05:08.065840+00:00, run_end_date=2024-05-11 00:05:08.380542+00:00, run_duration=0.314702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:06.391082+00:00, queued_by_job_id=2, pid=6458 2024-05-11T00:05:11.769481903Z [2024-05-11T00:05:11.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:05:11.769750836Z [2024-05-11T00:05:11.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:00:00+00:00, run_id=scheduled__2024-05-11T00:00:00+00:00, run_start_date=2024-05-11 00:05:00.987411+00:00, run_end_date=2024-05-11 00:05:11.769291+00:00, run_duration=10.78188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:00:00+00:00, data_interval_end=2024-05-11 00:05:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:05:11.777525459Z [2024-05-11T00:05:11.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:05:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:05:11.831232219Z [2024-05-11T00:05:11.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:00:00+00:00 exited with status success for try_number 1 2024-05-11T00:05:11.838079844Z [2024-05-11T00:05:11.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:00:00+00:00, map_index=-1, run_start_date=2024-05-11 00:05:10.621758+00:00, run_end_date=2024-05-11 00:05:11.034616+00:00, run_duration=0.412858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:05:08.892428+00:00, queued_by_job_id=2, pid=6466 2024-05-11T00:05:34.432648440Z [2024-05-11T00:05:34.432+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:06:00.275878217Z [2024-05-11T00:06:00.275+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:06:00.284374819Z [2024-05-11T00:06:00.283+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:06:00.297994352Z [2024-05-11T00:06:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:06:00+00:00, run_after=2024-05-11T00:07:00+00:00 2024-05-11T00:06:00.310262907Z [2024-05-11T00:06:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:06:00+00:00, run_after=2024-05-11T00:07:00+00:00 2024-05-11T00:06:00.388519856Z [2024-05-11T00:06:00.388+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:06:00.388563593Z 2024-05-11T00:06:00.388574833Z 2024-05-11T00:06:00.388583391Z 2024-05-11T00:06:00.388591966Z 2024-05-11T00:06:00.388680694Z [2024-05-11T00:06:00.388+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:06:00.388967682Z [2024-05-11T00:06:00.388+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:06:00.389144068Z [2024-05-11T00:06:00.388+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:06:00.389344053Z [2024-05-11T00:06:00.389+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:06:00.390156138Z [2024-05-11T00:06:00.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:06:00.390171755Z 2024-05-11T00:06:00.390178605Z 2024-05-11T00:06:00.390182751Z 2024-05-11T00:06:00.390186508Z 2024-05-11T00:06:00.394778461Z [2024-05-11T00:06:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:06:00.395108250Z [2024-05-11T00:06:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:06:00.395572942Z [2024-05-11T00:06:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:06:00.395859089Z [2024-05-11T00:06:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:06:00.396229444Z [2024-05-11T00:06:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:06:00.396513358Z [2024-05-11T00:06:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:06:00.396895493Z [2024-05-11T00:06:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:06:00.397136453Z [2024-05-11T00:06:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:06:00.662827808Z [2024-05-11T00:06:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status queued for try_number 1 2024-05-11T00:06:00.662889968Z [2024-05-11T00:06:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:06:00.662904099Z [2024-05-11T00:06:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:06:00.663005754Z [2024-05-11T00:06:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:06:00.677458842Z [2024-05-11T00:06:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5add289a-4b19-48cf-ac9e-771881ca497a 2024-05-11T00:06:00.677576034Z [2024-05-11T00:06:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5141c3a-1e39-4137-821b-eed69be8d113 2024-05-11T00:06:00.677683015Z [2024-05-11T00:06:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7100813-8067-4df2-a997-599df59e92ab 2024-05-11T00:06:00.677780306Z [2024-05-11T00:06:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d2c7c9b-e0b4-4b7b-ba66-8681ee1a2900 2024-05-11T00:06:01.898404164Z [2024-05-11T00:06:01.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:06:01.898606960Z [2024-05-11T00:06:01.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:04:00+00:00, run_id=scheduled__2024-05-11T00:04:00+00:00, run_start_date=2024-05-11 00:06:00.318177+00:00, run_end_date=2024-05-11 00:06:01.898319+00:00, run_duration=1.580142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:04:00+00:00, data_interval_end=2024-05-11 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:06:01.906429232Z [2024-05-11T00:06:01.906+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:06:00+00:00, run_after=2024-05-11T00:08:00+00:00 2024-05-11T00:06:01.952684024Z [2024-05-11T00:06:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:04:00+00:00 exited with status success for try_number 1 2024-05-11T00:06:01.952772789Z [2024-05-11T00:06:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:06:01.959416582Z [2024-05-11T00:06:01.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:04:00+00:00, map_index=-1, run_start_date=2024-05-11 00:06:01.122698+00:00, run_end_date=2024-05-11 00:06:01.493592+00:00, run_duration=0.370894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:06:00.391338+00:00, queued_by_job_id=2, pid=6471 2024-05-11T00:06:01.959536413Z [2024-05-11T00:06:01.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=-1, run_start_date=2024-05-11 00:06:01.422241+00:00, run_end_date=2024-05-11 00:06:01.847399+00:00, run_duration=0.425158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:06:00.391338+00:00, queued_by_job_id=2, pid=6482 2024-05-11T00:06:02.519383135Z [2024-05-11T00:06:02.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:06:02.519799003Z [2024-05-11T00:06:02.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:05:00+00:00, run_id=scheduled__2024-05-11T00:05:00+00:00, run_start_date=2024-05-11 00:06:00.319451+00:00, run_end_date=2024-05-11 00:06:02.519475+00:00, run_duration=2.200024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:05:00+00:00, data_interval_end=2024-05-11 00:06:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:06:02.528337585Z [2024-05-11T00:06:02.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:06:00+00:00, run_after=2024-05-11T00:07:00+00:00 2024-05-11T00:06:04.755982015Z [2024-05-11T00:06:04.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:06:04.756471025Z [2024-05-11T00:06:04.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:05:00+00:00, run_id=scheduled__2024-05-11T00:05:00+00:00, run_start_date=2024-05-11 00:06:00.321466+00:00, run_end_date=2024-05-11 00:06:04.756004+00:00, run_duration=4.434538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:05:00+00:00, data_interval_end=2024-05-11 00:06:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:06:04.765672669Z [2024-05-11T00:06:04.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:06:00+00:00, run_after=2024-05-11T00:07:00+00:00 2024-05-11T00:06:04.772708270Z [2024-05-11T00:06:04.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:06:04.773067878Z [2024-05-11T00:06:04.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:05:00+00:00, run_id=scheduled__2024-05-11T00:05:00+00:00, run_start_date=2024-05-11 00:06:00.320468+00:00, run_end_date=2024-05-11 00:06:04.772792+00:00, run_duration=4.452324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:05:00+00:00, data_interval_end=2024-05-11 00:06:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:06:04.783134615Z [2024-05-11T00:06:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:06:00+00:00, run_after=2024-05-11T00:07:00+00:00 2024-05-11T00:06:04.838717421Z [2024-05-11T00:06:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:06:04.838788664Z [2024-05-11T00:06:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:06:04.847726062Z [2024-05-11T00:06:04.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=-1, run_start_date=2024-05-11 00:06:02.248694+00:00, run_end_date=2024-05-11 00:06:03.976615+00:00, run_duration=1.727921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:06:00.391338+00:00, queued_by_job_id=2, pid=6495 2024-05-11T00:06:04.847921606Z [2024-05-11T00:06:04.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=-1, run_start_date=2024-05-11 00:06:02.492856+00:00, run_end_date=2024-05-11 00:06:03.977058+00:00, run_duration=1.484202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:06:00.391338+00:00, queued_by_job_id=2, pid=6501 2024-05-11T00:07:00.281575504Z [2024-05-11T00:07:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:07:00+00:00, run_after=2024-05-11T00:08:00+00:00 2024-05-11T00:07:00.318308186Z [2024-05-11T00:07:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:07:00+00:00, run_after=2024-05-11T00:08:00+00:00 2024-05-11T00:07:00.330938653Z [2024-05-11T00:07:00.330+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:07:00.433150673Z [2024-05-11T00:07:00.432+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:07:00.433191921Z 2024-05-11T00:07:00.433197716Z 2024-05-11T00:07:00.433202618Z 2024-05-11T00:07:00.433400203Z [2024-05-11T00:07:00.433+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:07:00.433634763Z [2024-05-11T00:07:00.433+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:07:00.433827619Z [2024-05-11T00:07:00.433+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:07:00.434603628Z [2024-05-11T00:07:00.434+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:07:00.434618822Z 2024-05-11T00:07:00.434623888Z 2024-05-11T00:07:00.434628437Z 2024-05-11T00:07:00.438544124Z [2024-05-11T00:07:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:07:00.438757986Z [2024-05-11T00:07:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:07:00.439126615Z [2024-05-11T00:07:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:07:00.439320352Z [2024-05-11T00:07:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:07:00.439640088Z [2024-05-11T00:07:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:07:00.439869619Z [2024-05-11T00:07:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:07:00.761955142Z [2024-05-11T00:07:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status queued for try_number 1 2024-05-11T00:07:00.761986973Z [2024-05-11T00:07:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status queued for try_number 1 2024-05-11T00:07:00.762024779Z [2024-05-11T00:07:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status queued for try_number 1 2024-05-11T00:07:00.779002434Z [2024-05-11T00:07:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 036b04c6-e21e-4522-ac9a-5ed0d8a4c495 2024-05-11T00:07:00.779029176Z [2024-05-11T00:07:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76ca2a60-9eb4-44bd-bce7-f933cc414eb8 2024-05-11T00:07:00.779150327Z [2024-05-11T00:07:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to e231f820-12be-4a09-8e96-8b2cc8feb921 2024-05-11T00:07:02.315323251Z [2024-05-11T00:07:02.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:07:02.315770502Z [2024-05-11T00:07:02.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:06:00+00:00, run_id=scheduled__2024-05-11T00:06:00+00:00, run_start_date=2024-05-11 00:07:00.350785+00:00, run_end_date=2024-05-11 00:07:02.315425+00:00, run_duration=1.96464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:06:00+00:00, data_interval_end=2024-05-11 00:07:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:07:02.325514795Z [2024-05-11T00:07:02.325+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:07:00+00:00, run_after=2024-05-11T00:08:00+00:00 2024-05-11T00:07:02.407035258Z [2024-05-11T00:07:02.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status success for try_number 1 2024-05-11T00:07:02.417412636Z [2024-05-11T00:07:02.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:06:00+00:00, map_index=-1, run_start_date=2024-05-11 00:07:01.390832+00:00, run_end_date=2024-05-11 00:07:01.831118+00:00, run_duration=0.440286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:07:00.435520+00:00, queued_by_job_id=2, pid=6533 2024-05-11T00:07:04.591805162Z [2024-05-11T00:07:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:07:04.592112091Z [2024-05-11T00:07:04.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:06:00+00:00, run_id=scheduled__2024-05-11T00:06:00+00:00, run_start_date=2024-05-11 00:07:00.355897+00:00, run_end_date=2024-05-11 00:07:04.591512+00:00, run_duration=4.235615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:06:00+00:00, data_interval_end=2024-05-11 00:07:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:07:04.605138861Z [2024-05-11T00:07:04.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:07:00+00:00, run_after=2024-05-11T00:08:00+00:00 2024-05-11T00:07:04.659232309Z [2024-05-11T00:07:04.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status success for try_number 1 2024-05-11T00:07:04.666879070Z [2024-05-11T00:07:04.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:06:00+00:00, map_index=-1, run_start_date=2024-05-11 00:07:02.305620+00:00, run_end_date=2024-05-11 00:07:03.837438+00:00, run_duration=1.531818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:07:00.435520+00:00, queued_by_job_id=2, pid=6546 2024-05-11T00:07:05.714822214Z [2024-05-11T00:07:05.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:07:05.714963462Z [2024-05-11T00:07:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:06:00+00:00, run_id=scheduled__2024-05-11T00:06:00+00:00, run_start_date=2024-05-11 00:07:00.357856+00:00, run_end_date=2024-05-11 00:07:05.714658+00:00, run_duration=5.356802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:06:00+00:00, data_interval_end=2024-05-11 00:07:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:07:05.724069780Z [2024-05-11T00:07:05.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:07:00+00:00, run_after=2024-05-11T00:08:00+00:00 2024-05-11T00:07:05.763745961Z [2024-05-11T00:07:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status success for try_number 1 2024-05-11T00:07:05.771198673Z [2024-05-11T00:07:05.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:06:00+00:00, map_index=-1, run_start_date=2024-05-11 00:07:02.644811+00:00, run_end_date=2024-05-11 00:07:04.917349+00:00, run_duration=2.272538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:07:00.435520+00:00, queued_by_job_id=2, pid=6557 2024-05-11T00:08:00.404816131Z [2024-05-11T00:08:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:08:00.423976881Z [2024-05-11T00:08:00.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:08:00+00:00, run_after=2024-05-11T00:09:00+00:00 2024-05-11T00:08:00.433367714Z [2024-05-11T00:08:00.433+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:08:00.452682308Z [2024-05-11T00:08:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:08:00+00:00, run_after=2024-05-11T00:09:00+00:00 2024-05-11T00:08:00.545150927Z [2024-05-11T00:08:00.544+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:08:00.545185646Z 2024-05-11T00:08:00.545198445Z 2024-05-11T00:08:00.545204585Z 2024-05-11T00:08:00.545210313Z 2024-05-11T00:08:00.545475129Z [2024-05-11T00:08:00.545+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:08:00.545802054Z [2024-05-11T00:08:00.545+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:08:00.546057927Z [2024-05-11T00:08:00.545+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:08:00.546384170Z [2024-05-11T00:08:00.546+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:08:00.547397418Z [2024-05-11T00:08:00.547+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:08:00.547417368Z 2024-05-11T00:08:00.547424429Z 2024-05-11T00:08:00.547453311Z 2024-05-11T00:08:00.547459508Z 2024-05-11T00:08:00.553253512Z [2024-05-11T00:08:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:08:00.553312225Z [2024-05-11T00:08:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:08:00.553731769Z [2024-05-11T00:08:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:08:00.554050120Z [2024-05-11T00:08:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:08:00.554401738Z [2024-05-11T00:08:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:08:00.554641439Z [2024-05-11T00:08:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:08:00.555015832Z [2024-05-11T00:08:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:08:00.555198513Z [2024-05-11T00:08:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:08:00.900474573Z [2024-05-11T00:08:00.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status queued for try_number 1 2024-05-11T00:08:00.902741710Z [2024-05-11T00:08:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:07:00+00:00 exited with status queued for try_number 1 2024-05-11T00:08:00.902861683Z [2024-05-11T00:08:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:07:00+00:00 exited with status queued for try_number 1 2024-05-11T00:08:00.902977764Z [2024-05-11T00:08:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:07:00+00:00 exited with status queued for try_number 1 2024-05-11T00:08:00.919256345Z [2024-05-11T00:08:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa1d6d04-5a3f-43a6-b7c4-efd61788b8da 2024-05-11T00:08:00.919412810Z [2024-05-11T00:08:00.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to df67b4f3-50f6-40c1-b250-e62cd9146b85 2024-05-11T00:08:00.919581400Z [2024-05-11T00:08:00.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3a70cdf-bb77-4e2f-8f96-915a7513dbd3 2024-05-11T00:08:00.919721092Z [2024-05-11T00:08:00.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04cea3ba-33a6-4390-a4c7-fee03599e899 2024-05-11T00:08:02.875356149Z [2024-05-11T00:08:02.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:08:02.875831716Z [2024-05-11T00:08:02.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:06:00+00:00, run_id=scheduled__2024-05-11T00:06:00+00:00, run_start_date=2024-05-11 00:08:00.467836+00:00, run_end_date=2024-05-11 00:08:02.875267+00:00, run_duration=2.407431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:06:00+00:00, data_interval_end=2024-05-11 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:08:02.883704520Z [2024-05-11T00:08:02.883+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:08:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:08:02.891612238Z [2024-05-11T00:08:02.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:08:02.892074493Z [2024-05-11T00:08:02.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:07:00+00:00, run_id=scheduled__2024-05-11T00:07:00+00:00, run_start_date=2024-05-11 00:08:00.469418+00:00, run_end_date=2024-05-11 00:08:02.891521+00:00, run_duration=2.422103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:07:00+00:00, data_interval_end=2024-05-11 00:08:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:08:02.901614559Z [2024-05-11T00:08:02.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:08:00+00:00, run_after=2024-05-11T00:09:00+00:00 2024-05-11T00:08:02.963496619Z [2024-05-11T00:08:02.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:06:00+00:00 exited with status success for try_number 1 2024-05-11T00:08:02.963758684Z [2024-05-11T00:08:02.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:07:00+00:00 exited with status success for try_number 1 2024-05-11T00:08:02.972263962Z [2024-05-11T00:08:02.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:07:00+00:00, map_index=-1, run_start_date=2024-05-11 00:08:01.464733+00:00, run_end_date=2024-05-11 00:08:01.901773+00:00, run_duration=0.43704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:08:00.549027+00:00, queued_by_job_id=2, pid=6585 2024-05-11T00:08:02.972669004Z [2024-05-11T00:08:02.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:06:00+00:00, map_index=-1, run_start_date=2024-05-11 00:08:01.416196+00:00, run_end_date=2024-05-11 00:08:01.819401+00:00, run_duration=0.403205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:08:00.549027+00:00, queued_by_job_id=2, pid=6584 2024-05-11T00:08:04.011157556Z [2024-05-11T00:08:04.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:08:04.011445949Z [2024-05-11T00:08:04.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:07:00+00:00, run_id=scheduled__2024-05-11T00:07:00+00:00, run_start_date=2024-05-11 00:08:00.470685+00:00, run_end_date=2024-05-11 00:08:04.011008+00:00, run_duration=3.540323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:07:00+00:00, data_interval_end=2024-05-11 00:08:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:08:04.026228165Z [2024-05-11T00:08:04.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:08:00+00:00, run_after=2024-05-11T00:09:00+00:00 2024-05-11T00:08:04.093372600Z [2024-05-11T00:08:04.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:07:00+00:00 exited with status success for try_number 1 2024-05-11T00:08:04.102069350Z [2024-05-11T00:08:04.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:07:00+00:00, map_index=-1, run_start_date=2024-05-11 00:08:02.497346+00:00, run_end_date=2024-05-11 00:08:03.783045+00:00, run_duration=1.285699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:08:00.549027+00:00, queued_by_job_id=2, pid=6608 2024-05-11T00:08:05.523672321Z [2024-05-11T00:08:05.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:08:05.524280762Z [2024-05-11T00:08:05.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:07:00+00:00, run_id=scheduled__2024-05-11T00:07:00+00:00, run_start_date=2024-05-11 00:08:00.471972+00:00, run_end_date=2024-05-11 00:08:05.523623+00:00, run_duration=5.051651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:07:00+00:00, data_interval_end=2024-05-11 00:08:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:08:05.541131496Z [2024-05-11T00:08:05.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:08:00+00:00, run_after=2024-05-11T00:09:00+00:00 2024-05-11T00:08:05.573841155Z [2024-05-11T00:08:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:07:00+00:00 exited with status success for try_number 1 2024-05-11T00:08:05.582698995Z [2024-05-11T00:08:05.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:07:00+00:00, map_index=-1, run_start_date=2024-05-11 00:08:02.605484+00:00, run_end_date=2024-05-11 00:08:04.506151+00:00, run_duration=1.900667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:08:00.549027+00:00, queued_by_job_id=2, pid=6609 2024-05-11T00:09:00.336269929Z [2024-05-11T00:09:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:09:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:09:00.344795334Z [2024-05-11T00:09:00.344+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:09:00.364815930Z [2024-05-11T00:09:00.364+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:09:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:09:00.427610429Z [2024-05-11T00:09:00.426+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:09:00.427642743Z 2024-05-11T00:09:00.427647315Z 2024-05-11T00:09:00.427650587Z 2024-05-11T00:09:00.428174318Z [2024-05-11T00:09:00.427+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:09:00.428580650Z [2024-05-11T00:09:00.428+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:09:00.429037743Z [2024-05-11T00:09:00.428+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:09:00.430598924Z [2024-05-11T00:09:00.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:09:00.430617846Z 2024-05-11T00:09:00.430624274Z 2024-05-11T00:09:00.430630048Z 2024-05-11T00:09:00.437534654Z [2024-05-11T00:09:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:09:00.438021834Z [2024-05-11T00:09:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:09:00.438984640Z [2024-05-11T00:09:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:09:00.439263203Z [2024-05-11T00:09:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:09:00.439735315Z [2024-05-11T00:09:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:09:00.440082725Z [2024-05-11T00:09:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:09:00.768939964Z [2024-05-11T00:09:00.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status queued for try_number 1 2024-05-11T00:09:00.769316680Z [2024-05-11T00:09:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status queued for try_number 1 2024-05-11T00:09:00.769423545Z [2024-05-11T00:09:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status queued for try_number 1 2024-05-11T00:09:00.782013711Z [2024-05-11T00:09:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1461b163-fcd9-460c-84e5-f5760f1254b9 2024-05-11T00:09:00.782315060Z [2024-05-11T00:09:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f2b35ce-459c-446a-9f72-b62a1750339c 2024-05-11T00:09:00.782549799Z [2024-05-11T00:09:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fd67944-19e3-41c1-8bd4-f50c01f3de9f 2024-05-11T00:09:02.248297169Z [2024-05-11T00:09:02.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:09:02.248717483Z [2024-05-11T00:09:02.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:08:00+00:00, run_id=scheduled__2024-05-11T00:08:00+00:00, run_start_date=2024-05-11 00:09:00.378983+00:00, run_end_date=2024-05-11 00:09:02.248314+00:00, run_duration=1.869331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:08:00+00:00, data_interval_end=2024-05-11 00:09:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:09:02.263139039Z [2024-05-11T00:09:02.262+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:09:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:09:02.313702721Z [2024-05-11T00:09:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status success for try_number 1 2024-05-11T00:09:02.319194541Z [2024-05-11T00:09:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:08:00+00:00, map_index=-1, run_start_date=2024-05-11 00:09:01.364423+00:00, run_end_date=2024-05-11 00:09:01.847370+00:00, run_duration=0.482947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:09:00.433082+00:00, queued_by_job_id=2, pid=6641 2024-05-11T00:09:04.469038804Z [2024-05-11T00:09:04.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:09:04.469329059Z [2024-05-11T00:09:04.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:08:00+00:00, run_id=scheduled__2024-05-11T00:08:00+00:00, run_start_date=2024-05-11 00:09:00.381031+00:00, run_end_date=2024-05-11 00:09:04.468916+00:00, run_duration=4.087885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:08:00+00:00, data_interval_end=2024-05-11 00:09:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:09:04.479198272Z [2024-05-11T00:09:04.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:09:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:09:04.486822607Z [2024-05-11T00:09:04.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:09:04.486995552Z [2024-05-11T00:09:04.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:08:00+00:00, run_id=scheduled__2024-05-11T00:08:00+00:00, run_start_date=2024-05-11 00:09:00.380085+00:00, run_end_date=2024-05-11 00:09:04.486679+00:00, run_duration=4.106594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:08:00+00:00, data_interval_end=2024-05-11 00:09:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:09:04.497391809Z [2024-05-11T00:09:04.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:09:00+00:00, run_after=2024-05-11T00:10:00+00:00 2024-05-11T00:09:04.550070022Z [2024-05-11T00:09:04.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status success for try_number 1 2024-05-11T00:09:04.550441822Z [2024-05-11T00:09:04.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status success for try_number 1 2024-05-11T00:09:04.564831504Z [2024-05-11T00:09:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:08:00+00:00, map_index=-1, run_start_date=2024-05-11 00:09:02.403362+00:00, run_end_date=2024-05-11 00:09:03.994354+00:00, run_duration=1.590992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:09:00.433082+00:00, queued_by_job_id=2, pid=6659 2024-05-11T00:09:04.565283370Z [2024-05-11T00:09:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:08:00+00:00, map_index=-1, run_start_date=2024-05-11 00:09:02.525211+00:00, run_end_date=2024-05-11 00:09:03.719925+00:00, run_duration=1.194714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:09:00.433082+00:00, queued_by_job_id=2, pid=6660 2024-05-11T00:10:01.055486538Z [2024-05-11T00:10:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:11:00+00:00 2024-05-11T00:10:01.062636604Z [2024-05-11T00:10:01.062+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:10:01.077403406Z [2024-05-11T00:10:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:10:01.090511919Z [2024-05-11T00:10:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:11:00+00:00 2024-05-11T00:10:01.101369665Z [2024-05-11T00:10:01.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:10:01.244892711Z [2024-05-11T00:10:01.244+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:10:01.244938972Z 2024-05-11T00:10:01.244949157Z 2024-05-11T00:10:01.244958764Z 2024-05-11T00:10:01.244967353Z 2024-05-11T00:10:01.244975907Z 2024-05-11T00:10:01.245329501Z [2024-05-11T00:10:01.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:10:01.245751433Z [2024-05-11T00:10:01.245+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:10:01.246279762Z [2024-05-11T00:10:01.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:10:01.246723358Z [2024-05-11T00:10:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:10:01.247125158Z [2024-05-11T00:10:01.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:10:01.248904902Z [2024-05-11T00:10:01.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:10:01.248924452Z 2024-05-11T00:10:01.248933461Z 2024-05-11T00:10:01.248942184Z 2024-05-11T00:10:01.248950378Z 2024-05-11T00:10:01.248958639Z 2024-05-11T00:10:01.256336089Z [2024-05-11T00:10:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:10:01.257093423Z [2024-05-11T00:10:01.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:10:01.257613559Z [2024-05-11T00:10:01.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:10:01.258075334Z [2024-05-11T00:10:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:10:01.259140105Z [2024-05-11T00:10:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:10:01.259427983Z [2024-05-11T00:10:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:10:01.259984972Z [2024-05-11T00:10:01.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:10:01.260342671Z [2024-05-11T00:10:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:10:01.260837983Z [2024-05-11T00:10:01.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:10:01.261383047Z [2024-05-11T00:10:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:10:01.831158494Z [2024-05-11T00:10:01.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:01.831245062Z [2024-05-11T00:10:01.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:01.831268535Z [2024-05-11T00:10:01.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:09:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:01.831291271Z [2024-05-11T00:10:01.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:09:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:01.831370807Z [2024-05-11T00:10:01.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:09:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:01.850534578Z [2024-05-11T00:10:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to e726d705-c4cb-4921-b77d-f15775c4d056 2024-05-11T00:10:01.850590808Z [2024-05-11T00:10:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0461c240-0184-4117-9893-59ac407940b1 2024-05-11T00:10:01.850677159Z [2024-05-11T00:10:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 674e469b-ab67-4c8d-a5e7-90a3e3e1c0af 2024-05-11T00:10:01.850793096Z [2024-05-11T00:10:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9354ca51-7eca-4d69-9cac-9667fa28bd34 2024-05-11T00:10:01.850876700Z [2024-05-11T00:10:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e2cdd6f-e9bd-4a8f-86cb-36d8d89e1b24 2024-05-11T00:10:02.732030355Z [2024-05-11T00:10:02.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:10:02.732311863Z [2024-05-11T00:10:02.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:08:00+00:00, run_id=scheduled__2024-05-11T00:08:00+00:00, run_start_date=2024-05-11 00:10:01.124940+00:00, run_end_date=2024-05-11 00:10:02.731952+00:00, run_duration=1.607012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:08:00+00:00, data_interval_end=2024-05-11 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:10:02.741549668Z [2024-05-11T00:10:02.741+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:12:00+00:00 2024-05-11T00:10:02.748693318Z [2024-05-11T00:10:02.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:10:02.748923347Z [2024-05-11T00:10:02.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:09:00+00:00, run_id=scheduled__2024-05-11T00:09:00+00:00, run_start_date=2024-05-11 00:10:01.126252+00:00, run_end_date=2024-05-11 00:10:02.748598+00:00, run_duration=1.622346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:09:00+00:00, data_interval_end=2024-05-11 00:10:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:10:02.760600846Z [2024-05-11T00:10:02.760+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:11:00+00:00 2024-05-11T00:10:02.833306939Z [2024-05-11T00:10:02.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:08:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:02.833573393Z [2024-05-11T00:10:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:09:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:02.844952218Z [2024-05-11T00:10:02.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:08:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:02.156467+00:00, run_end_date=2024-05-11 00:10:02.570258+00:00, run_duration=0.413791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:01.251825+00:00, queued_by_job_id=2, pid=6695 2024-05-11T00:10:02.845148835Z [2024-05-11T00:10:02.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:09:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:02.057171+00:00, run_end_date=2024-05-11 00:10:02.591686+00:00, run_duration=0.534515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:01.251825+00:00, queued_by_job_id=2, pid=6694 2024-05-11T00:10:03.923492246Z [2024-05-11T00:10:03.923+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:10:03.923529683Z 2024-05-11T00:10:03.923542248Z [2024-05-11T00:10:03.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:10:03.924033308Z [2024-05-11T00:10:03.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:10:03.924042719Z 2024-05-11T00:10:03.926156047Z [2024-05-11T00:10:03.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:10:03.926230852Z [2024-05-11T00:10:03.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:10:03.983764007Z [2024-05-11T00:10:03.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:03.984219727Z [2024-05-11T00:10:03.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:03.991782319Z [2024-05-11T00:10:03.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed0c360f-b152-4fb8-9853-9ed18a76d69c 2024-05-11T00:10:03.991908598Z [2024-05-11T00:10:03.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:03.314491+00:00, run_end_date=2024-05-11 00:10:03.740458+00:00, run_duration=0.425967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:01.251825+00:00, queued_by_job_id=2, pid=6714 2024-05-11T00:10:06.365842980Z [2024-05-11T00:10:06.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:10:06.366066219Z [2024-05-11T00:10:06.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:09:00+00:00, run_id=scheduled__2024-05-11T00:09:00+00:00, run_start_date=2024-05-11 00:10:01.134363+00:00, run_end_date=2024-05-11 00:10:06.365657+00:00, run_duration=5.231294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:09:00+00:00, data_interval_end=2024-05-11 00:10:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:10:06.377636516Z [2024-05-11T00:10:06.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:11:00+00:00 2024-05-11T00:10:06.385421537Z [2024-05-11T00:10:06.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:10:06.385508613Z [2024-05-11T00:10:06.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:09:00+00:00, run_id=scheduled__2024-05-11T00:09:00+00:00, run_start_date=2024-05-11 00:10:01.130319+00:00, run_end_date=2024-05-11 00:10:06.385255+00:00, run_duration=5.254936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:09:00+00:00, data_interval_end=2024-05-11 00:10:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:10:06.395633078Z [2024-05-11T00:10:06.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:11:00+00:00 2024-05-11T00:10:06.441394316Z [2024-05-11T00:10:06.440+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:10:06.441446115Z 2024-05-11T00:10:06.441509877Z [2024-05-11T00:10:06.441+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:10:06.442320949Z [2024-05-11T00:10:06.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:10:06.442350825Z 2024-05-11T00:10:06.445941584Z [2024-05-11T00:10:06.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:10:06.446011182Z [2024-05-11T00:10:06.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:10:06.514953454Z [2024-05-11T00:10:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:06.515027444Z [2024-05-11T00:10:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:09:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:06.515123624Z [2024-05-11T00:10:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:09:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:06.515220278Z [2024-05-11T00:10:06.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:06.526133666Z [2024-05-11T00:10:06.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:05.671014+00:00, run_end_date=2024-05-11 00:10:06.060746+00:00, run_duration=0.389732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:03.924298+00:00, queued_by_job_id=2, pid=6759 2024-05-11T00:10:06.526323143Z [2024-05-11T00:10:06.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:09:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:03.829004+00:00, run_end_date=2024-05-11 00:10:05.254671+00:00, run_duration=1.425667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:01.251825+00:00, queued_by_job_id=2, pid=6731 2024-05-11T00:10:06.526472565Z [2024-05-11T00:10:06.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:09:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:03.647817+00:00, run_end_date=2024-05-11 00:10:05.613632+00:00, run_duration=1.965815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:01.251825+00:00, queued_by_job_id=2, pid=6727 2024-05-11T00:10:06.526633096Z [2024-05-11T00:10:06.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b169ff1-049f-4c17-9a16-05d038554651 2024-05-11T00:10:09.244029967Z [2024-05-11T00:10:09.243+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:10:09.244139543Z 2024-05-11T00:10:09.244467054Z [2024-05-11T00:10:09.243+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:10:09.246343853Z [2024-05-11T00:10:09.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:10:09.246386176Z 2024-05-11T00:10:09.250985678Z [2024-05-11T00:10:09.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:10:09.251152679Z [2024-05-11T00:10:09.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:10:09.328326495Z [2024-05-11T00:10:09.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status queued for try_number 1 2024-05-11T00:10:09.328377012Z [2024-05-11T00:10:09.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:09.338168901Z [2024-05-11T00:10:09.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18e6adeb-ab3b-4393-be30-e4c7e8e42b2b 2024-05-11T00:10:09.338565883Z [2024-05-11T00:10:09.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=0, run_start_date=2024-05-11 00:10:08.057199+00:00, run_end_date=2024-05-11 00:10:08.492104+00:00, run_duration=0.434905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:06.442812+00:00, queued_by_job_id=2, pid=6770 2024-05-11T00:10:11.562439001Z [2024-05-11T00:10:11.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:10:11.562772105Z [2024-05-11T00:10:11.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:05:00+00:00, run_id=scheduled__2024-05-11T00:05:00+00:00, run_start_date=2024-05-11 00:10:01.122481+00:00, run_end_date=2024-05-11 00:10:11.562405+00:00, run_duration=10.439924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:05:00+00:00, data_interval_end=2024-05-11 00:10:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:10:11.570725091Z [2024-05-11T00:10:11.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:10:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:10:11.621181311Z [2024-05-11T00:10:11.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:05:00+00:00 exited with status success for try_number 1 2024-05-11T00:10:11.626201643Z [2024-05-11T00:10:11.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:05:00+00:00, map_index=-1, run_start_date=2024-05-11 00:10:10.886696+00:00, run_end_date=2024-05-11 00:10:11.362585+00:00, run_duration=0.475889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:10:09.247117+00:00, queued_by_job_id=2, pid=6778 2024-05-11T00:10:34.509560390Z [2024-05-11T00:10:34.508+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:11:01.019954630Z [2024-05-11T00:11:01.019+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:11:01.036160622Z [2024-05-11T00:11:01.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:11:00+00:00, run_after=2024-05-11T00:12:00+00:00 2024-05-11T00:11:01.051074939Z [2024-05-11T00:11:01.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:11:00+00:00, run_after=2024-05-11T00:12:00+00:00 2024-05-11T00:11:01.128261587Z [2024-05-11T00:11:01.126+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:11:01.128294805Z 2024-05-11T00:11:01.128300096Z 2024-05-11T00:11:01.128318271Z 2024-05-11T00:11:01.128322594Z [2024-05-11T00:11:01.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:11:01.128326626Z [2024-05-11T00:11:01.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:11:01.128330693Z [2024-05-11T00:11:01.127+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:11:01.128335196Z [2024-05-11T00:11:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:11:01.128339192Z 2024-05-11T00:11:01.128343147Z 2024-05-11T00:11:01.128346987Z 2024-05-11T00:11:01.130875978Z [2024-05-11T00:11:01.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:11:01.130986900Z [2024-05-11T00:11:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:11:01.131220317Z [2024-05-11T00:11:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:11:01.131302907Z [2024-05-11T00:11:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:11:01.131464086Z [2024-05-11T00:11:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:11:01.131538251Z [2024-05-11T00:11:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:11:01.365517983Z [2024-05-11T00:11:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:11:01.365739934Z [2024-05-11T00:11:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:11:01.365932317Z [2024-05-11T00:11:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:11:01.375544200Z [2024-05-11T00:11:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e195e3d-c299-4494-a3ef-ef78793b6126 2024-05-11T00:11:01.375782514Z [2024-05-11T00:11:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdd582df-2149-42b1-be1f-baf500ad9269 2024-05-11T00:11:01.376031353Z [2024-05-11T00:11:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to c71e8e19-2021-408c-8ab5-c010faa61c7a 2024-05-11T00:11:02.925442892Z [2024-05-11T00:11:02.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:11:02.926014813Z [2024-05-11T00:11:02.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:10:00+00:00, run_id=scheduled__2024-05-11T00:10:00+00:00, run_start_date=2024-05-11 00:11:01.062695+00:00, run_end_date=2024-05-11 00:11:02.925529+00:00, run_duration=1.862834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:10:00+00:00, data_interval_end=2024-05-11 00:11:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:11:02.947543889Z [2024-05-11T00:11:02.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:11:00+00:00, run_after=2024-05-11T00:12:00+00:00 2024-05-11T00:11:03.018009748Z [2024-05-11T00:11:03.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:11:03.022570068Z [2024-05-11T00:11:03.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:11:01.886485+00:00, run_end_date=2024-05-11 00:11:02.285498+00:00, run_duration=0.399013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:11:01.128755+00:00, queued_by_job_id=2, pid=6787 2024-05-11T00:11:05.504513863Z [2024-05-11T00:11:05.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:11:05.504711771Z [2024-05-11T00:11:05.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:10:00+00:00, run_id=scheduled__2024-05-11T00:10:00+00:00, run_start_date=2024-05-11 00:11:01.064425+00:00, run_end_date=2024-05-11 00:11:05.504388+00:00, run_duration=4.439963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:10:00+00:00, data_interval_end=2024-05-11 00:11:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:11:05.513562814Z [2024-05-11T00:11:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:11:00+00:00, run_after=2024-05-11T00:12:00+00:00 2024-05-11T00:11:05.518834540Z [2024-05-11T00:11:05.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:11:05.519125048Z [2024-05-11T00:11:05.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:10:00+00:00, run_id=scheduled__2024-05-11T00:10:00+00:00, run_start_date=2024-05-11 00:11:01.065753+00:00, run_end_date=2024-05-11 00:11:05.518763+00:00, run_duration=4.45301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:10:00+00:00, data_interval_end=2024-05-11 00:11:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:11:05.527375535Z [2024-05-11T00:11:05.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:11:00+00:00, run_after=2024-05-11T00:12:00+00:00 2024-05-11T00:11:05.559591455Z [2024-05-11T00:11:05.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:11:05.559795977Z [2024-05-11T00:11:05.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:11:05.566448872Z [2024-05-11T00:11:05.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:11:02.987227+00:00, run_end_date=2024-05-11 00:11:04.784233+00:00, run_duration=1.797006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:11:01.128755+00:00, queued_by_job_id=2, pid=6806 2024-05-11T00:11:05.566817887Z [2024-05-11T00:11:05.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:11:02.854367+00:00, run_end_date=2024-05-11 00:11:05.124874+00:00, run_duration=2.270507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:11:01.128755+00:00, queued_by_job_id=2, pid=6805 2024-05-11T00:12:01.003296080Z [2024-05-11T00:12:01.002+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:12:01.023982849Z [2024-05-11T00:12:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:12:00+00:00, run_after=2024-05-11T00:13:00+00:00 2024-05-11T00:12:01.047492357Z [2024-05-11T00:12:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:12:00+00:00, run_after=2024-05-11T00:13:00+00:00 2024-05-11T00:12:01.056941808Z [2024-05-11T00:12:01.055+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:12:01.147152248Z [2024-05-11T00:12:01.146+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:12:01.147178096Z 2024-05-11T00:12:01.147182520Z 2024-05-11T00:12:01.147185832Z 2024-05-11T00:12:01.147189046Z 2024-05-11T00:12:01.147556694Z [2024-05-11T00:12:01.147+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:12:01.147775918Z [2024-05-11T00:12:01.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:12:01.147987868Z [2024-05-11T00:12:01.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:12:01.148173025Z [2024-05-11T00:12:01.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:12:01.148944542Z [2024-05-11T00:12:01.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:12:01.148959162Z 2024-05-11T00:12:01.148963104Z 2024-05-11T00:12:01.148966379Z 2024-05-11T00:12:01.148969844Z 2024-05-11T00:12:01.153411074Z [2024-05-11T00:12:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:12:01.153630725Z [2024-05-11T00:12:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:12:01.154006459Z [2024-05-11T00:12:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:12:01.154161593Z [2024-05-11T00:12:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:12:01.154417350Z [2024-05-11T00:12:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:12:01.154923881Z [2024-05-11T00:12:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:12:01.155188065Z [2024-05-11T00:12:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:12:01.155353306Z [2024-05-11T00:12:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:12:01.563093577Z [2024-05-11T00:12:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:12:01.563135443Z [2024-05-11T00:12:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:11:00+00:00 exited with status queued for try_number 1 2024-05-11T00:12:01.563366484Z [2024-05-11T00:12:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:11:00+00:00 exited with status queued for try_number 1 2024-05-11T00:12:01.563512808Z [2024-05-11T00:12:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:11:00+00:00 exited with status queued for try_number 1 2024-05-11T00:12:01.591586948Z [2024-05-11T00:12:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7cfb610-9887-4b8f-bb4a-e351411565b3 2024-05-11T00:12:01.591647851Z [2024-05-11T00:12:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99c6f845-15ef-45d3-a0ee-46a15914bcbe 2024-05-11T00:12:01.591773882Z [2024-05-11T00:12:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f546321-03a8-4a9a-b624-1fe1db4df618 2024-05-11T00:12:01.591880561Z [2024-05-11T00:12:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dc8ed35-124a-4300-bf78-e33b7585d64b 2024-05-11T00:12:02.514704832Z [2024-05-11T00:12:02.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:12:02.514941594Z [2024-05-11T00:12:02.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:10:00+00:00, run_id=scheduled__2024-05-11T00:10:00+00:00, run_start_date=2024-05-11 00:12:01.068853+00:00, run_end_date=2024-05-11 00:12:02.514623+00:00, run_duration=1.44577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:10:00+00:00, data_interval_end=2024-05-11 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:12:02.528747826Z [2024-05-11T00:12:02.528+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:12:00+00:00, run_after=2024-05-11T00:14:00+00:00 2024-05-11T00:12:02.539006278Z [2024-05-11T00:12:02.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:12:02.539413147Z [2024-05-11T00:12:02.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:11:00+00:00, run_id=scheduled__2024-05-11T00:11:00+00:00, run_start_date=2024-05-11 00:12:01.070109+00:00, run_end_date=2024-05-11 00:12:02.538954+00:00, run_duration=1.468845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:11:00+00:00, data_interval_end=2024-05-11 00:12:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:12:02.550786132Z [2024-05-11T00:12:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:12:00+00:00, run_after=2024-05-11T00:13:00+00:00 2024-05-11T00:12:02.591941056Z [2024-05-11T00:12:02.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:12:02.599368823Z [2024-05-11T00:12:02.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:12:01.921986+00:00, run_end_date=2024-05-11 00:12:02.319268+00:00, run_duration=0.397282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:12:01.150221+00:00, queued_by_job_id=2, pid=6839 2024-05-11T00:12:03.706303926Z [2024-05-11T00:12:03.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:11:00+00:00 exited with status success for try_number 1 2024-05-11T00:12:03.712490339Z [2024-05-11T00:12:03.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:11:00+00:00, map_index=-1, run_start_date=2024-05-11 00:12:02.087727+00:00, run_end_date=2024-05-11 00:12:02.500042+00:00, run_duration=0.412315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:12:01.150221+00:00, queued_by_job_id=2, pid=6840 2024-05-11T00:12:05.012387919Z [2024-05-11T00:12:05.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:12:05.012935448Z [2024-05-11T00:12:05.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:11:00+00:00, run_id=scheduled__2024-05-11T00:11:00+00:00, run_start_date=2024-05-11 00:12:01.075024+00:00, run_end_date=2024-05-11 00:12:05.012596+00:00, run_duration=3.937572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:11:00+00:00, data_interval_end=2024-05-11 00:12:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:12:05.023186815Z [2024-05-11T00:12:05.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:12:00+00:00, run_after=2024-05-11T00:13:00+00:00 2024-05-11T00:12:05.071704057Z [2024-05-11T00:12:05.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:11:00+00:00 exited with status success for try_number 1 2024-05-11T00:12:05.079056079Z [2024-05-11T00:12:05.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:11:00+00:00, map_index=-1, run_start_date=2024-05-11 00:12:03.084807+00:00, run_end_date=2024-05-11 00:12:04.603949+00:00, run_duration=1.519142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:12:01.150221+00:00, queued_by_job_id=2, pid=6864 2024-05-11T00:12:06.122654233Z [2024-05-11T00:12:06.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:12:06.123628542Z [2024-05-11T00:12:06.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:11:00+00:00, run_id=scheduled__2024-05-11T00:11:00+00:00, run_start_date=2024-05-11 00:12:01.076491+00:00, run_end_date=2024-05-11 00:12:06.123310+00:00, run_duration=5.046819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:11:00+00:00, data_interval_end=2024-05-11 00:12:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:12:06.132296809Z [2024-05-11T00:12:06.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:12:00+00:00, run_after=2024-05-11T00:13:00+00:00 2024-05-11T00:12:06.167967761Z [2024-05-11T00:12:06.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:11:00+00:00 exited with status success for try_number 1 2024-05-11T00:12:06.174871730Z [2024-05-11T00:12:06.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:11:00+00:00, map_index=-1, run_start_date=2024-05-11 00:12:03.074874+00:00, run_end_date=2024-05-11 00:12:05.312076+00:00, run_duration=2.237202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:12:01.150221+00:00, queued_by_job_id=2, pid=6863 2024-05-11T00:13:00.874178045Z [2024-05-11T00:13:00.873+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:13:00.899731195Z [2024-05-11T00:13:00.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:13:00+00:00, run_after=2024-05-11T00:14:00+00:00 2024-05-11T00:13:00.916050106Z [2024-05-11T00:13:00.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:13:00+00:00, run_after=2024-05-11T00:14:00+00:00 2024-05-11T00:13:00.992746531Z [2024-05-11T00:13:00.992+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:13:00.992785797Z 2024-05-11T00:13:00.992792222Z 2024-05-11T00:13:00.992797683Z 2024-05-11T00:13:00.992865240Z [2024-05-11T00:13:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:13:00.993027066Z [2024-05-11T00:13:00.992+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:13:00.993146046Z [2024-05-11T00:13:00.992+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:13:00.994040228Z [2024-05-11T00:13:00.993+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:13:00.994057448Z 2024-05-11T00:13:00.994063099Z 2024-05-11T00:13:00.994068475Z 2024-05-11T00:13:00.998992579Z [2024-05-11T00:13:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:13:00.999100659Z [2024-05-11T00:13:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:13:00.999378794Z [2024-05-11T00:13:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:13:00.999466443Z [2024-05-11T00:13:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:13:00.999721402Z [2024-05-11T00:13:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:13:00.999814793Z [2024-05-11T00:13:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:13:01.357604333Z [2024-05-11T00:13:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status queued for try_number 1 2024-05-11T00:13:01.357635881Z [2024-05-11T00:13:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status queued for try_number 1 2024-05-11T00:13:01.357751140Z [2024-05-11T00:13:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status queued for try_number 1 2024-05-11T00:13:01.365462310Z [2024-05-11T00:13:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c7963d1-7b39-4a40-ac78-9c338309752d 2024-05-11T00:13:01.365503423Z [2024-05-11T00:13:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d6afa3c-ce8d-4332-a284-4dd65439ca21 2024-05-11T00:13:01.365645598Z [2024-05-11T00:13:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e748032-a2ae-4907-9080-ebedd628e72f 2024-05-11T00:13:02.520506184Z [2024-05-11T00:13:02.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:13:02.520668849Z [2024-05-11T00:13:02.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:12:00+00:00, run_id=scheduled__2024-05-11T00:12:00+00:00, run_start_date=2024-05-11 00:13:00.928680+00:00, run_end_date=2024-05-11 00:13:02.520275+00:00, run_duration=1.591595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:12:00+00:00, data_interval_end=2024-05-11 00:13:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:13:02.530719191Z [2024-05-11T00:13:02.530+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:13:00+00:00, run_after=2024-05-11T00:14:00+00:00 2024-05-11T00:13:02.596581827Z [2024-05-11T00:13:02.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status success for try_number 1 2024-05-11T00:13:02.603647774Z [2024-05-11T00:13:02.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:12:00+00:00, map_index=-1, run_start_date=2024-05-11 00:13:01.884713+00:00, run_end_date=2024-05-11 00:13:02.240717+00:00, run_duration=0.356004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:13:00.995154+00:00, queued_by_job_id=2, pid=6896 2024-05-11T00:13:04.892386958Z [2024-05-11T00:13:04.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:13:04.892639565Z [2024-05-11T00:13:04.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:12:00+00:00, run_id=scheduled__2024-05-11T00:12:00+00:00, run_start_date=2024-05-11 00:13:00.929834+00:00, run_end_date=2024-05-11 00:13:04.892120+00:00, run_duration=3.962286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:12:00+00:00, data_interval_end=2024-05-11 00:13:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:13:04.905694898Z [2024-05-11T00:13:04.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:13:00+00:00, run_after=2024-05-11T00:14:00+00:00 2024-05-11T00:13:04.968342666Z [2024-05-11T00:13:04.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status success for try_number 1 2024-05-11T00:13:04.974385820Z [2024-05-11T00:13:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:12:00+00:00, map_index=-1, run_start_date=2024-05-11 00:13:02.729475+00:00, run_end_date=2024-05-11 00:13:04.516157+00:00, run_duration=1.786682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:13:00.995154+00:00, queued_by_job_id=2, pid=6914 2024-05-11T00:13:06.069497497Z [2024-05-11T00:13:06.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:13:06.069754137Z [2024-05-11T00:13:06.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:12:00+00:00, run_id=scheduled__2024-05-11T00:12:00+00:00, run_start_date=2024-05-11 00:13:00.930804+00:00, run_end_date=2024-05-11 00:13:06.069297+00:00, run_duration=5.138493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:12:00+00:00, data_interval_end=2024-05-11 00:13:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:13:06.078540930Z [2024-05-11T00:13:06.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:13:00+00:00, run_after=2024-05-11T00:14:00+00:00 2024-05-11T00:13:06.142097815Z [2024-05-11T00:13:06.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status success for try_number 1 2024-05-11T00:13:06.149152773Z [2024-05-11T00:13:06.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:12:00+00:00, map_index=-1, run_start_date=2024-05-11 00:13:02.849351+00:00, run_end_date=2024-05-11 00:13:04.974998+00:00, run_duration=2.125647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:13:00.995154+00:00, queued_by_job_id=2, pid=6915 2024-05-11T00:14:00.702031239Z [2024-05-11T00:14:00.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:14:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:14:00.715650372Z [2024-05-11T00:14:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:14:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:14:00.721903276Z [2024-05-11T00:14:00.721+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:14:00.727616613Z [2024-05-11T00:14:00.727+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:14:00.824145245Z [2024-05-11T00:14:00.823+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:14:00.824169375Z 2024-05-11T00:14:00.824173680Z 2024-05-11T00:14:00.824176845Z 2024-05-11T00:14:00.824179993Z 2024-05-11T00:14:00.824384414Z [2024-05-11T00:14:00.824+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:14:00.824585388Z [2024-05-11T00:14:00.824+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:14:00.824785933Z [2024-05-11T00:14:00.824+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:14:00.824975261Z [2024-05-11T00:14:00.824+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:14:00.825671300Z [2024-05-11T00:14:00.825+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:14:00.825686379Z 2024-05-11T00:14:00.825689911Z 2024-05-11T00:14:00.825692907Z 2024-05-11T00:14:00.825696100Z 2024-05-11T00:14:00.830008911Z [2024-05-11T00:14:00.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:14:00.830321786Z [2024-05-11T00:14:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:14:00.830711359Z [2024-05-11T00:14:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:14:00.830960759Z [2024-05-11T00:14:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:14:00.831309656Z [2024-05-11T00:14:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:14:00.831459668Z [2024-05-11T00:14:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:14:00.831710142Z [2024-05-11T00:14:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:14:00.831852411Z [2024-05-11T00:14:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:14:01.530636064Z [2024-05-11T00:14:01.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status queued for try_number 1 2024-05-11T00:14:01.530885965Z [2024-05-11T00:14:01.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:13:00+00:00 exited with status queued for try_number 1 2024-05-11T00:14:01.531091798Z [2024-05-11T00:14:01.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:13:00+00:00 exited with status queued for try_number 1 2024-05-11T00:14:01.531268481Z [2024-05-11T00:14:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:13:00+00:00 exited with status queued for try_number 1 2024-05-11T00:14:01.551278953Z [2024-05-11T00:14:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 023bdee8-0592-4962-83fd-acec8b2703ce 2024-05-11T00:14:01.551584671Z [2024-05-11T00:14:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6481b351-62ab-4d7c-8954-9a73a20173a1 2024-05-11T00:14:01.551836458Z [2024-05-11T00:14:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04a049f9-9a04-4eb7-8a6a-49f6b15f8239 2024-05-11T00:14:01.552094790Z [2024-05-11T00:14:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42fcba1c-15a0-4f54-b1ee-d016920a10d7 2024-05-11T00:14:02.825640663Z [2024-05-11T00:14:02.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:14:02.826583622Z [2024-05-11T00:14:02.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:12:00+00:00, run_id=scheduled__2024-05-11T00:12:00+00:00, run_start_date=2024-05-11 00:14:00.737716+00:00, run_end_date=2024-05-11 00:14:02.825799+00:00, run_duration=2.088083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:12:00+00:00, data_interval_end=2024-05-11 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:14:02.839088870Z [2024-05-11T00:14:02.838+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:14:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:14:02.857927718Z [2024-05-11T00:14:02.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:14:02.858617081Z [2024-05-11T00:14:02.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:13:00+00:00, run_id=scheduled__2024-05-11T00:13:00+00:00, run_start_date=2024-05-11 00:14:00.738917+00:00, run_end_date=2024-05-11 00:14:02.858074+00:00, run_duration=2.119157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:13:00+00:00, data_interval_end=2024-05-11 00:14:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:14:02.873102726Z [2024-05-11T00:14:02.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:14:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:14:02.956369292Z [2024-05-11T00:14:02.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:12:00+00:00 exited with status success for try_number 1 2024-05-11T00:14:02.956400671Z [2024-05-11T00:14:02.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:13:00+00:00 exited with status success for try_number 1 2024-05-11T00:14:02.968637437Z [2024-05-11T00:14:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:13:00+00:00, map_index=-1, run_start_date=2024-05-11 00:14:01.741799+00:00, run_end_date=2024-05-11 00:14:02.198984+00:00, run_duration=0.457185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:14:00.826740+00:00, queued_by_job_id=2, pid=6948 2024-05-11T00:14:02.969446814Z [2024-05-11T00:14:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:12:00+00:00, map_index=-1, run_start_date=2024-05-11 00:14:01.827716+00:00, run_end_date=2024-05-11 00:14:02.282187+00:00, run_duration=0.454471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:14:00.826740+00:00, queued_by_job_id=2, pid=6949 2024-05-11T00:14:05.731260483Z [2024-05-11T00:14:05.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:14:05.731651072Z [2024-05-11T00:14:05.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:13:00+00:00, run_id=scheduled__2024-05-11T00:13:00+00:00, run_start_date=2024-05-11 00:14:00.739858+00:00, run_end_date=2024-05-11 00:14:05.731375+00:00, run_duration=4.991517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:13:00+00:00, data_interval_end=2024-05-11 00:14:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:14:05.743494175Z [2024-05-11T00:14:05.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:14:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:14:05.752361786Z [2024-05-11T00:14:05.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:14:05.752752464Z [2024-05-11T00:14:05.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:13:00+00:00, run_id=scheduled__2024-05-11T00:13:00+00:00, run_start_date=2024-05-11 00:14:00.740855+00:00, run_end_date=2024-05-11 00:14:05.752340+00:00, run_duration=5.011485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:13:00+00:00, data_interval_end=2024-05-11 00:14:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:14:05.765447477Z [2024-05-11T00:14:05.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:14:00+00:00, run_after=2024-05-11T00:15:00+00:00 2024-05-11T00:14:05.820458974Z [2024-05-11T00:14:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:13:00+00:00 exited with status success for try_number 1 2024-05-11T00:14:05.820852189Z [2024-05-11T00:14:05.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:13:00+00:00 exited with status success for try_number 1 2024-05-11T00:14:05.828781332Z [2024-05-11T00:14:05.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:13:00+00:00, map_index=-1, run_start_date=2024-05-11 00:14:02.883196+00:00, run_end_date=2024-05-11 00:14:04.505739+00:00, run_duration=1.622543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:14:00.826740+00:00, queued_by_job_id=2, pid=6972 2024-05-11T00:14:05.828972933Z [2024-05-11T00:14:05.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:13:00+00:00, map_index=-1, run_start_date=2024-05-11 00:14:03.040338+00:00, run_end_date=2024-05-11 00:14:05.384572+00:00, run_duration=2.344234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:14:00.826740+00:00, queued_by_job_id=2, pid=6973 2024-05-11T00:15:00.655003255Z [2024-05-11T00:15:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:15:00.674282632Z [2024-05-11T00:15:00.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:15:00.689454279Z [2024-05-11T00:15:00.688+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:00.705792953Z [2024-05-11T00:15:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:00.836567556Z [2024-05-11T00:15:00.836+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:15:00.836601430Z 2024-05-11T00:15:00.836606710Z 2024-05-11T00:15:00.836610113Z 2024-05-11T00:15:00.836613445Z 2024-05-11T00:15:00.836753039Z [2024-05-11T00:15:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:15:00.837051716Z [2024-05-11T00:15:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:15:00.837285827Z [2024-05-11T00:15:00.837+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:15:00.837505817Z [2024-05-11T00:15:00.837+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:15:00.839168697Z [2024-05-11T00:15:00.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:15:00.839188434Z 2024-05-11T00:15:00.839193238Z 2024-05-11T00:15:00.839197753Z 2024-05-11T00:15:00.839202066Z 2024-05-11T00:15:00.845639963Z [2024-05-11T00:15:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:15:00.845880797Z [2024-05-11T00:15:00.845+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:15:00.846333474Z [2024-05-11T00:15:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:15:00.846565259Z [2024-05-11T00:15:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:15:00.846956767Z [2024-05-11T00:15:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:15:00.847172476Z [2024-05-11T00:15:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:15:00.847551157Z [2024-05-11T00:15:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:15:00.847769896Z [2024-05-11T00:15:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:15:01.299397770Z [2024-05-11T00:15:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:01.299428320Z [2024-05-11T00:15:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:01.299440568Z [2024-05-11T00:15:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:01.299523012Z [2024-05-11T00:15:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:01.315177644Z [2024-05-11T00:15:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63300e19-924c-42fd-9a00-4c172b87d366 2024-05-11T00:15:01.315213241Z [2024-05-11T00:15:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11fc0261-84a2-4dd2-b5b1-4068ac4608a6 2024-05-11T00:15:01.315328821Z [2024-05-11T00:15:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to f22b4cbf-9246-41bf-8f1d-140664a39bb4 2024-05-11T00:15:01.315428396Z [2024-05-11T00:15:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 567a1c9d-b13b-4993-9af9-eb3a94ff88e4 2024-05-11T00:15:03.530288175Z [2024-05-11T00:15:03.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:15:03.530334570Z [2024-05-11T00:15:03.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:14:00+00:00, run_id=scheduled__2024-05-11T00:14:00+00:00, run_start_date=2024-05-11 00:15:00.721058+00:00, run_end_date=2024-05-11 00:15:03.527973+00:00, run_duration=2.806915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:14:00+00:00, data_interval_end=2024-05-11 00:15:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:15:03.561821101Z [2024-05-11T00:15:03.560+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:03.667372283Z [2024-05-11T00:15:03.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:03.685982217Z [2024-05-11T00:15:03.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:14:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:02.020129+00:00, run_end_date=2024-05-11 00:15:02.556777+00:00, run_duration=0.536648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:00.840980+00:00, queued_by_job_id=2, pid=7006 2024-05-11T00:15:04.775284262Z [2024-05-11T00:15:04.774+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:15:04.775328492Z 2024-05-11T00:15:04.775696226Z [2024-05-11T00:15:04.775+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:15:04.777308528Z [2024-05-11T00:15:04.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:15:04.777323094Z 2024-05-11T00:15:04.782699407Z [2024-05-11T00:15:04.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:15:04.783385960Z [2024-05-11T00:15:04.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:15:04.851818353Z [2024-05-11T00:15:04.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:04.852381453Z [2024-05-11T00:15:04.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:04.860278367Z [2024-05-11T00:15:04.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48d90c25-dbf5-489e-8c2c-21e85d6aec0d 2024-05-11T00:15:04.860857656Z [2024-05-11T00:15:04.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:03.226481+00:00, run_end_date=2024-05-11 00:15:03.687207+00:00, run_duration=0.460726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:00.840980+00:00, queued_by_job_id=2, pid=7031 2024-05-11T00:15:04.912369835Z [2024-05-11T00:15:04.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:15:04.912800042Z [2024-05-11T00:15:04.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:14:00+00:00, run_id=scheduled__2024-05-11T00:14:00+00:00, run_start_date=2024-05-11 00:15:00.722313+00:00, run_end_date=2024-05-11 00:15:04.912464+00:00, run_duration=4.190151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:14:00+00:00, data_interval_end=2024-05-11 00:15:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:15:04.922277953Z [2024-05-11T00:15:04.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:04.992447214Z [2024-05-11T00:15:04.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:05.001533029Z [2024-05-11T00:15:05.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:14:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:03.026756+00:00, run_end_date=2024-05-11 00:15:04.716809+00:00, run_duration=1.690053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:00.840980+00:00, queued_by_job_id=2, pid=7025 2024-05-11T00:15:06.299333666Z [2024-05-11T00:15:06.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:15:06.299625118Z [2024-05-11T00:15:06.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:14:00+00:00, run_id=scheduled__2024-05-11T00:14:00+00:00, run_start_date=2024-05-11 00:15:00.723541+00:00, run_end_date=2024-05-11 00:15:06.299332+00:00, run_duration=5.575791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:14:00+00:00, data_interval_end=2024-05-11 00:15:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:15:06.308633408Z [2024-05-11T00:15:06.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:06.359786638Z [2024-05-11T00:15:06.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:06.364745414Z [2024-05-11T00:15:06.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:14:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:03.325076+00:00, run_end_date=2024-05-11 00:15:05.336640+00:00, run_duration=2.011564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:00.840980+00:00, queued_by_job_id=2, pid=7032 2024-05-11T00:15:07.437722046Z [2024-05-11T00:15:07.437+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:15:07.437765287Z 2024-05-11T00:15:07.437830007Z [2024-05-11T00:15:07.437+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:15:07.438443492Z [2024-05-11T00:15:07.438+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:15:07.438456271Z 2024-05-11T00:15:07.440872749Z [2024-05-11T00:15:07.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:15:07.441494450Z [2024-05-11T00:15:07.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:15:07.523227018Z [2024-05-11T00:15:07.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:07.523353696Z [2024-05-11T00:15:07.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:07.531858100Z [2024-05-11T00:15:07.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 824b89b8-ede8-444d-a8ad-c8d0179b389b 2024-05-11T00:15:07.533553932Z [2024-05-11T00:15:07.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:06.467444+00:00, run_end_date=2024-05-11 00:15:06.917407+00:00, run_duration=0.449963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:04.778464+00:00, queued_by_job_id=2, pid=7065 2024-05-11T00:15:09.958882039Z [2024-05-11T00:15:09.958+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:15:09.958943179Z 2024-05-11T00:15:09.959024787Z [2024-05-11T00:15:09.958+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:15:09.960047478Z [2024-05-11T00:15:09.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:15:09.960065511Z 2024-05-11T00:15:09.964117048Z [2024-05-11T00:15:09.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:15:09.964199161Z [2024-05-11T00:15:09.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:15:10.112228050Z [2024-05-11T00:15:10.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:10.113949150Z [2024-05-11T00:15:10.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:10.122670255Z [2024-05-11T00:15:10.122+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83bb94e1-f842-4ec7-a074-db7899bc921e 2024-05-11T00:15:10.122901645Z [2024-05-11T00:15:10.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=0, run_start_date=2024-05-11 00:15:09.288006+00:00, run_end_date=2024-05-11 00:15:09.620293+00:00, run_duration=0.332287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:07.438770+00:00, queued_by_job_id=2, pid=7076 2024-05-11T00:15:12.316379565Z [2024-05-11T00:15:12.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:15:12.316766974Z [2024-05-11T00:15:12.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:10:00+00:00, run_id=scheduled__2024-05-11T00:10:00+00:00, run_start_date=2024-05-11 00:15:00.719681+00:00, run_end_date=2024-05-11 00:15:12.316289+00:00, run_duration=11.596608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:10:00+00:00, data_interval_end=2024-05-11 00:15:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:15:12.324297922Z [2024-05-11T00:15:12.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:15:12.368737165Z [2024-05-11T00:15:12.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:10:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:12.380367935Z [2024-05-11T00:15:12.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:10:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:11.671251+00:00, run_end_date=2024-05-11 00:15:12.107027+00:00, run_duration=0.435776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:09.960795+00:00, queued_by_job_id=2, pid=7084 2024-05-11T00:15:18.756221573Z [2024-05-11T00:15:18.755+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:18.793724922Z [2024-05-11T00:15:18.793+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:15:18.793766819Z 2024-05-11T00:15:18.794154716Z [2024-05-11T00:15:18.793+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 has 0/16 running and queued tasks 2024-05-11T00:15:18.795715317Z [2024-05-11T00:15:18.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:15:18.795727108Z 2024-05-11T00:15:18.800846861Z [2024-05-11T00:15:18.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:15:18.801605141Z [2024-05-11T00:15:18.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:15:18.856216979Z [2024-05-11T00:15:18.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status queued for try_number 1 2024-05-11T00:15:18.864182720Z [2024-05-11T00:15:18.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07e653f9-035a-4fbe-8e24-92bd0a7367a2 2024-05-11T00:15:20.000192417Z [2024-05-11T00:15:19.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:15:20.003658229Z [2024-05-11T00:15:20.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488, execution_date=2024-05-11 00:14:00+00:00, run_id=scheduled__2024-05-11T00:14:00+00:00, run_start_date=2024-05-11 00:15:18.766096+00:00, run_end_date=2024-05-11 00:15:20.003158+00:00, run_duration=1.237062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:14:00+00:00, data_interval_end=2024-05-11 00:15:00+00:00, dag_hash=be2a173b116fa831ae9366e852774b59 2024-05-11T00:15:20.016415426Z [2024-05-11T00:15:20.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 to 2024-05-11T00:15:00+00:00, run_after=2024-05-11T00:16:00+00:00 2024-05-11T00:15:20.064568161Z [2024-05-11T00:15:20.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status success for try_number 1 2024-05-11T00:15:20.069998211Z [2024-05-11T00:15:20.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:14:00+00:00, map_index=-1, run_start_date=2024-05-11 00:15:19.458432+00:00, run_end_date=2024-05-11 00:15:19.815479+00:00, run_duration=0.357047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:15:18.797208+00:00, queued_by_job_id=2, pid=7091 2024-05-11T00:15:34.588992758Z [2024-05-11T00:15:34.588+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:16:00.686797997Z [2024-05-11T00:16:00.686+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:16:00.699102403Z [2024-05-11T00:16:00.698+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:00.712425674Z [2024-05-11T00:16:00.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:00.722062893Z [2024-05-11T00:16:00.721+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:16:00.734809827Z [2024-05-11T00:16:00.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:00.870517064Z [2024-05-11T00:16:00.870+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:16:00.870622347Z 2024-05-11T00:16:00.870630148Z 2024-05-11T00:16:00.870635724Z 2024-05-11T00:16:00.870690962Z 2024-05-11T00:16:00.870760358Z 2024-05-11T00:16:00.870770969Z [2024-05-11T00:16:00.870+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:16:00.870797959Z [2024-05-11T00:16:00.870+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:16:00.870804476Z [2024-05-11T00:16:00.870+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:16:00.870815697Z [2024-05-11T00:16:00.870+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 has 0/16 running and queued tasks 2024-05-11T00:16:00.870821383Z [2024-05-11T00:16:00.870+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:16:00.871375356Z [2024-05-11T00:16:00.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:16:00.871386579Z 2024-05-11T00:16:00.871398661Z 2024-05-11T00:16:00.871404350Z 2024-05-11T00:16:00.871410261Z 2024-05-11T00:16:00.871415682Z 2024-05-11T00:16:00.875329864Z [2024-05-11T00:16:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:16:00.875425412Z [2024-05-11T00:16:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:16:00.875675253Z [2024-05-11T00:16:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:16:00.875855699Z [2024-05-11T00:16:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:16:00.876079640Z [2024-05-11T00:16:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:16:00.876135335Z [2024-05-11T00:16:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:16:00.876306153Z [2024-05-11T00:16:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:16:00.876370260Z [2024-05-11T00:16:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:16:00.876545586Z [2024-05-11T00:16:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:16:00.876594978Z [2024-05-11T00:16:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:16:01.479704751Z [2024-05-11T00:16:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status queued for try_number 1 2024-05-11T00:16:01.486267051Z [2024-05-11T00:16:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:16:01.486426916Z [2024-05-11T00:16:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:16:01.486567061Z [2024-05-11T00:16:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:16:01.486758128Z [2024-05-11T00:16:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:16:01.503064450Z [2024-05-11T00:16:01.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to a31b6b61-b286-4506-a377-4ebb491ddbdb 2024-05-11T00:16:01.506343096Z [2024-05-11T00:16:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f787b67-9e42-4cb1-8842-e65376258fff 2024-05-11T00:16:01.507916256Z [2024-05-11T00:16:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e7d0c5e-4897-492a-97fc-f2395c3824fc 2024-05-11T00:16:01.508220056Z [2024-05-11T00:16:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 445346fe-5616-43eb-aec0-884ba8e064c6 2024-05-11T00:16:01.508507557Z [2024-05-11T00:16:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b51cb69-1ed3-4fa3-bca1-091050da1a9f 2024-05-11T00:16:02.892195083Z [2024-05-11T00:16:02.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:16:02.892566182Z [2024-05-11T00:16:02.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:15:00+00:00, run_id=scheduled__2024-05-11T00:15:00+00:00, run_start_date=2024-05-11 00:16:00.747187+00:00, run_end_date=2024-05-11 00:16:02.892213+00:00, run_duration=2.145026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:15:00+00:00, data_interval_end=2024-05-11 00:16:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:16:02.916800693Z [2024-05-11T00:16:02.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:02.941575520Z [2024-05-11T00:16:02.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:16:02.943385255Z [2024-05-11T00:16:02.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488, execution_date=2024-05-11 00:15:00+00:00, run_id=scheduled__2024-05-11T00:15:00+00:00, run_start_date=2024-05-11 00:16:00.748510+00:00, run_end_date=2024-05-11 00:16:02.942646+00:00, run_duration=2.194136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:15:00+00:00, data_interval_end=2024-05-11 00:16:00+00:00, dag_hash=be2a173b116fa831ae9366e852774b59 2024-05-11T00:16:02.956351737Z [2024-05-11T00:16:02.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:03.021553628Z [2024-05-11T00:16:03.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:16:03.036890867Z [2024-05-11T00:16:03.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:16:02.221791+00:00, run_end_date=2024-05-11 00:16:02.746643+00:00, run_duration=0.524852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:16:00.872380+00:00, queued_by_job_id=2, pid=7112 2024-05-11T00:16:03.678686386Z [2024-05-11T00:16:03.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:16:03.678883331Z [2024-05-11T00:16:03.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:14:00+00:00, run_id=scheduled__2024-05-11T00:14:00+00:00, run_start_date=2024-05-11 00:16:00.746004+00:00, run_end_date=2024-05-11 00:16:03.678588+00:00, run_duration=2.932584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:14:00+00:00, data_interval_end=2024-05-11 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:16:03.686640005Z [2024-05-11T00:16:03.686+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:16:03.724351093Z [2024-05-11T00:16:03.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:14:00+00:00 exited with status success for try_number 1 2024-05-11T00:16:03.724387821Z [2024-05-11T00:16:03.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:16:03.737190369Z [2024-05-11T00:16:03.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:14:00+00:00, map_index=-1, run_start_date=2024-05-11 00:16:02.452552+00:00, run_end_date=2024-05-11 00:16:02.960094+00:00, run_duration=0.507542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:16:00.872380+00:00, queued_by_job_id=2, pid=7114 2024-05-11T00:16:03.737741310Z [2024-05-11T00:16:03.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:16:02.382054+00:00, run_end_date=2024-05-11 00:16:02.872913+00:00, run_duration=0.490859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:16:00.872380+00:00, queued_by_job_id=2, pid=7113 2024-05-11T00:16:05.165703840Z [2024-05-11T00:16:05.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:16:05.165953448Z [2024-05-11T00:16:05.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:15:00+00:00, run_id=scheduled__2024-05-11T00:15:00+00:00, run_start_date=2024-05-11 00:16:00.749771+00:00, run_end_date=2024-05-11 00:16:05.165622+00:00, run_duration=4.415851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:15:00+00:00, data_interval_end=2024-05-11 00:16:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:16:05.182389302Z [2024-05-11T00:16:05.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:05.186640012Z [2024-05-11T00:16:05.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:16:05.186778630Z [2024-05-11T00:16:05.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:15:00+00:00, run_id=scheduled__2024-05-11T00:15:00+00:00, run_start_date=2024-05-11 00:16:00.750762+00:00, run_end_date=2024-05-11 00:16:05.186547+00:00, run_duration=4.435785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:15:00+00:00, data_interval_end=2024-05-11 00:16:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:16:05.195273589Z [2024-05-11T00:16:05.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:16:00+00:00, run_after=2024-05-11T00:17:00+00:00 2024-05-11T00:16:05.228467524Z [2024-05-11T00:16:05.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:16:05.235663373Z [2024-05-11T00:16:05.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:16:03.336465+00:00, run_end_date=2024-05-11 00:16:04.722623+00:00, run_duration=1.386158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:16:00.872380+00:00, queued_by_job_id=2, pid=7142 2024-05-11T00:16:05.664357547Z [2024-05-11T00:16:05.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:16:05.671044828Z [2024-05-11T00:16:05.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:16:03.528351+00:00, run_end_date=2024-05-11 00:16:05.131277+00:00, run_duration=1.602926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:16:00.872380+00:00, queued_by_job_id=2, pid=7143 2024-05-11T00:17:00.573201738Z [2024-05-11T00:17:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:17:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:17:00.593836994Z [2024-05-11T00:17:00.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:17:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:17:00.603522943Z [2024-05-11T00:17:00.603+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:17:00.621744315Z [2024-05-11T00:17:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 to 2024-05-11T00:17:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:17:00.724325017Z [2024-05-11T00:17:00.722+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:17:00.724361974Z 2024-05-11T00:17:00.724368660Z 2024-05-11T00:17:00.724375154Z 2024-05-11T00:17:00.724380825Z 2024-05-11T00:17:00.724407264Z [2024-05-11T00:17:00.723+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:17:00.724413272Z [2024-05-11T00:17:00.723+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 has 0/16 running and queued tasks 2024-05-11T00:17:00.724418878Z [2024-05-11T00:17:00.723+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:17:00.724424455Z [2024-05-11T00:17:00.723+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:17:00.724925019Z [2024-05-11T00:17:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:17:00.724944427Z 2024-05-11T00:17:00.724950822Z 2024-05-11T00:17:00.724956509Z 2024-05-11T00:17:00.724962022Z 2024-05-11T00:17:00.731429499Z [2024-05-11T00:17:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:17:00.731708269Z [2024-05-11T00:17:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:17:00.732140431Z [2024-05-11T00:17:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:17:00.732607177Z [2024-05-11T00:17:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:17:00.733095620Z [2024-05-11T00:17:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:17:00.733417126Z [2024-05-11T00:17:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:17:00.733806554Z [2024-05-11T00:17:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:17:00.734074813Z [2024-05-11T00:17:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:17:01.198125539Z [2024-05-11T00:17:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status queued for try_number 1 2024-05-11T00:17:01.198368636Z [2024-05-11T00:17:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status queued for try_number 1 2024-05-11T00:17:01.198527873Z [2024-05-11T00:17:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status queued for try_number 1 2024-05-11T00:17:01.198674667Z [2024-05-11T00:17:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status queued for try_number 1 2024-05-11T00:17:01.251337985Z [2024-05-11T00:17:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ef1aea2-37aa-4058-af0c-5a514333d930 2024-05-11T00:17:01.251601817Z [2024-05-11T00:17:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25c1def9-ea48-4ce2-af09-dc20e469cebd 2024-05-11T00:17:01.251806010Z [2024-05-11T00:17:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fd6243a-c62a-4224-9d1d-55f509fa2da5 2024-05-11T00:17:01.252022349Z [2024-05-11T00:17:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3f66132-3710-4ac9-bb44-2dd07bee945c 2024-05-11T00:17:02.510747517Z [2024-05-11T00:17:02.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:17:02.511219591Z [2024-05-11T00:17:02.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:16:00+00:00, run_id=scheduled__2024-05-11T00:16:00+00:00, run_start_date=2024-05-11 00:17:00.637350+00:00, run_end_date=2024-05-11 00:17:02.510641+00:00, run_duration=1.873291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:16:00+00:00, data_interval_end=2024-05-11 00:17:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:17:02.521828941Z [2024-05-11T00:17:02.521+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:17:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:17:02.588251929Z [2024-05-11T00:17:02.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status success for try_number 1 2024-05-11T00:17:02.588303369Z [2024-05-11T00:17:02.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status failed for try_number 1 2024-05-11T00:17:02.598192177Z [2024-05-11T00:17:02.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:17:00.726483+00:00, queued_by_job_id=2, pid=None 2024-05-11T00:17:02.598713146Z [2024-05-11T00:17:02.598+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T00:17:02.601404138Z [2024-05-11T00:17:02.601+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T00:17:02.617144734Z [2024-05-11T00:17:02.616+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240511T001600, start_date=, end_date=20240511T001702 2024-05-11T00:17:02.630469108Z [2024-05-11T00:17:02.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:16:00+00:00, map_index=-1, run_start_date=2024-05-11 00:17:01.673681+00:00, run_end_date=2024-05-11 00:17:02.055888+00:00, run_duration=0.382207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:17:00.726483+00:00, queued_by_job_id=2, pid=7186 2024-05-11T00:17:04.333486078Z [2024-05-11T00:17:04.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:17:04.333516268Z [2024-05-11T00:17:04.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:16:00+00:00, run_id=scheduled__2024-05-11T00:16:00+00:00, run_start_date=2024-05-11 00:17:00.641906+00:00, run_end_date=2024-05-11 00:17:04.332818+00:00, run_duration=3.690912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:16:00+00:00, data_interval_end=2024-05-11 00:17:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:17:04.344946428Z [2024-05-11T00:17:04.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:17:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:17:04.351538359Z [2024-05-11T00:17:04.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:17:04.351697540Z [2024-05-11T00:17:04.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:16:00+00:00, run_id=scheduled__2024-05-11T00:16:00+00:00, run_start_date=2024-05-11 00:17:00.640531+00:00, run_end_date=2024-05-11 00:17:04.351459+00:00, run_duration=3.710928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:16:00+00:00, data_interval_end=2024-05-11 00:17:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:17:04.361583222Z [2024-05-11T00:17:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:17:00+00:00, run_after=2024-05-11T00:18:00+00:00 2024-05-11T00:17:04.608364405Z [2024-05-11T00:17:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status success for try_number 1 2024-05-11T00:17:04.608418810Z [2024-05-11T00:17:04.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status success for try_number 1 2024-05-11T00:17:04.616652826Z [2024-05-11T00:17:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:16:00+00:00, map_index=-1, run_start_date=2024-05-11 00:17:02.644790+00:00, run_end_date=2024-05-11 00:17:04.312966+00:00, run_duration=1.668176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:17:00.726483+00:00, queued_by_job_id=2, pid=7204 2024-05-11T00:17:04.616763622Z [2024-05-11T00:17:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:16:00+00:00, map_index=-1, run_start_date=2024-05-11 00:17:02.714744+00:00, run_end_date=2024-05-11 00:17:04.243144+00:00, run_duration=1.5284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:17:00.726483+00:00, queued_by_job_id=2, pid=7205 2024-05-11T00:18:00.405085836Z [2024-05-11T00:18:00.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:18:00+00:00, run_after=2024-05-11T00:19:00+00:00 2024-05-11T00:18:00.411895052Z [2024-05-11T00:18:00.411+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:18:00.425242896Z [2024-05-11T00:18:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:18:00+00:00, run_after=2024-05-11T00:19:00+00:00 2024-05-11T00:18:00.431332967Z [2024-05-11T00:18:00.431+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:18:00.506778125Z [2024-05-11T00:18:00.506+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:18:00.506814374Z 2024-05-11T00:18:00.506837350Z 2024-05-11T00:18:00.506840921Z 2024-05-11T00:18:00.506844356Z 2024-05-11T00:18:00.507156006Z [2024-05-11T00:18:00.506+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:18:00.507297375Z [2024-05-11T00:18:00.507+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:18:00.507444689Z [2024-05-11T00:18:00.507+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:18:00.507610249Z [2024-05-11T00:18:00.507+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:18:00.508220931Z [2024-05-11T00:18:00.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:18:00.508235191Z 2024-05-11T00:18:00.508240177Z 2024-05-11T00:18:00.508244390Z 2024-05-11T00:18:00.508248392Z 2024-05-11T00:18:00.511455313Z [2024-05-11T00:18:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:18:00.511700695Z [2024-05-11T00:18:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:18:00.512113632Z [2024-05-11T00:18:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:18:00.512326921Z [2024-05-11T00:18:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:18:00.512579812Z [2024-05-11T00:18:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:18:00.512740621Z [2024-05-11T00:18:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:18:00.512978687Z [2024-05-11T00:18:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:18:00.513145941Z [2024-05-11T00:18:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:18:00.986298421Z [2024-05-11T00:18:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status queued for try_number 1 2024-05-11T00:18:00.986609527Z [2024-05-11T00:18:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:17:00+00:00 exited with status queued for try_number 1 2024-05-11T00:18:00.986839547Z [2024-05-11T00:18:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:17:00+00:00 exited with status queued for try_number 1 2024-05-11T00:18:00.987045103Z [2024-05-11T00:18:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:17:00+00:00 exited with status queued for try_number 1 2024-05-11T00:18:01.009753092Z [2024-05-11T00:18:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to f71fb9e8-ca74-47a5-9a58-a91cfd98e9fa 2024-05-11T00:18:01.010296159Z [2024-05-11T00:18:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e3b1899-88c2-4034-a600-023fd42973c2 2024-05-11T00:18:01.013681046Z [2024-05-11T00:18:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 317adb71-3c37-4f0e-8a90-16998b7af47b 2024-05-11T00:18:01.015514977Z [2024-05-11T00:18:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cdf5a6c-421c-458c-b3d0-a808eb82e29f 2024-05-11T00:18:02.319579953Z [2024-05-11T00:18:02.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:18:02.320337324Z [2024-05-11T00:18:02.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:16:00+00:00, run_id=scheduled__2024-05-11T00:16:00+00:00, run_start_date=2024-05-11 00:18:00.440204+00:00, run_end_date=2024-05-11 00:18:02.319746+00:00, run_duration=1.879542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:16:00+00:00, data_interval_end=2024-05-11 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:18:02.333182229Z [2024-05-11T00:18:02.332+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:18:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:18:02.341440059Z [2024-05-11T00:18:02.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:18:02.342043989Z [2024-05-11T00:18:02.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:17:00+00:00, run_id=scheduled__2024-05-11T00:17:00+00:00, run_start_date=2024-05-11 00:18:00.441626+00:00, run_end_date=2024-05-11 00:18:02.341527+00:00, run_duration=1.899901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:17:00+00:00, data_interval_end=2024-05-11 00:18:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:18:02.358160261Z [2024-05-11T00:18:02.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:18:00+00:00, run_after=2024-05-11T00:19:00+00:00 2024-05-11T00:18:02.430001791Z [2024-05-11T00:18:02.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:16:00+00:00 exited with status success for try_number 1 2024-05-11T00:18:02.430090343Z [2024-05-11T00:18:02.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:17:00+00:00 exited with status success for try_number 1 2024-05-11T00:18:02.455135910Z [2024-05-11T00:18:02.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:16:00+00:00, map_index=-1, run_start_date=2024-05-11 00:18:01.412287+00:00, run_end_date=2024-05-11 00:18:01.779806+00:00, run_duration=0.367519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:18:00.509195+00:00, queued_by_job_id=2, pid=7237 2024-05-11T00:18:02.455339046Z [2024-05-11T00:18:02.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:17:00+00:00, map_index=-1, run_start_date=2024-05-11 00:18:01.607774+00:00, run_end_date=2024-05-11 00:18:02.058165+00:00, run_duration=0.450391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:18:00.509195+00:00, queued_by_job_id=2, pid=7238 2024-05-11T00:18:04.621966187Z [2024-05-11T00:18:04.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:18:04.622372807Z [2024-05-11T00:18:04.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:17:00+00:00, run_id=scheduled__2024-05-11T00:17:00+00:00, run_start_date=2024-05-11 00:18:00.442668+00:00, run_end_date=2024-05-11 00:18:04.622053+00:00, run_duration=4.179385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:17:00+00:00, data_interval_end=2024-05-11 00:18:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:18:04.630632173Z [2024-05-11T00:18:04.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:18:00+00:00, run_after=2024-05-11T00:19:00+00:00 2024-05-11T00:18:04.637042107Z [2024-05-11T00:18:04.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:18:04.637398050Z [2024-05-11T00:18:04.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:17:00+00:00, run_id=scheduled__2024-05-11T00:17:00+00:00, run_start_date=2024-05-11 00:18:00.443695+00:00, run_end_date=2024-05-11 00:18:04.637131+00:00, run_duration=4.193436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:17:00+00:00, data_interval_end=2024-05-11 00:18:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:18:04.646067525Z [2024-05-11T00:18:04.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:18:00+00:00, run_after=2024-05-11T00:19:00+00:00 2024-05-11T00:18:04.679605686Z [2024-05-11T00:18:04.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:17:00+00:00 exited with status success for try_number 1 2024-05-11T00:18:04.679823818Z [2024-05-11T00:18:04.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:17:00+00:00 exited with status success for try_number 1 2024-05-11T00:18:04.685919052Z [2024-05-11T00:18:04.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:17:00+00:00, map_index=-1, run_start_date=2024-05-11 00:18:02.746893+00:00, run_end_date=2024-05-11 00:18:04.091073+00:00, run_duration=1.34418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:18:00.509195+00:00, queued_by_job_id=2, pid=7262 2024-05-11T00:18:04.686178120Z [2024-05-11T00:18:04.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:17:00+00:00, map_index=-1, run_start_date=2024-05-11 00:18:02.603878+00:00, run_end_date=2024-05-11 00:18:04.258333+00:00, run_duration=1.654455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:18:00.509195+00:00, queued_by_job_id=2, pid=7261 2024-05-11T00:19:01.029189451Z [2024-05-11T00:19:01.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:19:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:19:01.053253456Z [2024-05-11T00:19:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:19:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:19:01.063608890Z [2024-05-11T00:19:01.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:19:01.150360728Z [2024-05-11T00:19:01.149+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:19:01.150406640Z 2024-05-11T00:19:01.150411966Z 2024-05-11T00:19:01.150434037Z 2024-05-11T00:19:01.150492104Z [2024-05-11T00:19:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:19:01.150616307Z [2024-05-11T00:19:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:19:01.150739724Z [2024-05-11T00:19:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:19:01.151368754Z [2024-05-11T00:19:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:19:01.151378328Z 2024-05-11T00:19:01.151382625Z 2024-05-11T00:19:01.151386492Z 2024-05-11T00:19:01.154825387Z [2024-05-11T00:19:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:19:01.154981162Z [2024-05-11T00:19:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:19:01.155261603Z [2024-05-11T00:19:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:19:01.155390585Z [2024-05-11T00:19:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:19:01.155614410Z [2024-05-11T00:19:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:19:01.155809229Z [2024-05-11T00:19:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:19:01.399665337Z [2024-05-11T00:19:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status queued for try_number 1 2024-05-11T00:19:01.399709552Z [2024-05-11T00:19:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status queued for try_number 1 2024-05-11T00:19:01.399834026Z [2024-05-11T00:19:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status queued for try_number 1 2024-05-11T00:19:01.411352885Z [2024-05-11T00:19:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e9f41b0-ea1c-478d-abb7-41e3fcb6b149 2024-05-11T00:19:01.411409983Z [2024-05-11T00:19:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0268720a-f133-4151-87f7-8670f726c9ab 2024-05-11T00:19:01.411611784Z [2024-05-11T00:19:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6c528e8-a240-4d7c-a014-2a9998190c1c 2024-05-11T00:19:03.018419904Z [2024-05-11T00:19:03.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:19:03.018729373Z [2024-05-11T00:19:03.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:18:00+00:00, run_id=scheduled__2024-05-11T00:18:00+00:00, run_start_date=2024-05-11 00:19:01.080811+00:00, run_end_date=2024-05-11 00:19:03.018274+00:00, run_duration=1.937463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:18:00+00:00, data_interval_end=2024-05-11 00:19:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:19:03.028892564Z [2024-05-11T00:19:03.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:19:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:19:03.093217916Z [2024-05-11T00:19:03.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status success for try_number 1 2024-05-11T00:19:03.108594235Z [2024-05-11T00:19:03.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:18:00+00:00, map_index=-1, run_start_date=2024-05-11 00:19:01.941467+00:00, run_end_date=2024-05-11 00:19:02.420883+00:00, run_duration=0.479416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:19:01.152158+00:00, queued_by_job_id=2, pid=7295 2024-05-11T00:19:04.937070599Z [2024-05-11T00:19:04.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:19:04.937326309Z [2024-05-11T00:19:04.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:18:00+00:00, run_id=scheduled__2024-05-11T00:18:00+00:00, run_start_date=2024-05-11 00:19:01.083035+00:00, run_end_date=2024-05-11 00:19:04.936909+00:00, run_duration=3.853874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:18:00+00:00, data_interval_end=2024-05-11 00:19:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:19:04.947697441Z [2024-05-11T00:19:04.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:19:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:19:06.091742100Z [2024-05-11T00:19:06.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:19:06.094433768Z [2024-05-11T00:19:06.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:18:00+00:00, run_id=scheduled__2024-05-11T00:18:00+00:00, run_start_date=2024-05-11 00:19:01.084212+00:00, run_end_date=2024-05-11 00:19:06.091829+00:00, run_duration=5.007617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:18:00+00:00, data_interval_end=2024-05-11 00:19:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:19:06.115882804Z [2024-05-11T00:19:06.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:19:00+00:00, run_after=2024-05-11T00:20:00+00:00 2024-05-11T00:19:06.168065781Z [2024-05-11T00:19:06.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status success for try_number 1 2024-05-11T00:19:06.168533172Z [2024-05-11T00:19:06.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status success for try_number 1 2024-05-11T00:19:06.179843091Z [2024-05-11T00:19:06.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:18:00+00:00, map_index=-1, run_start_date=2024-05-11 00:19:03.115876+00:00, run_end_date=2024-05-11 00:19:04.847924+00:00, run_duration=1.732048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:19:01.152158+00:00, queued_by_job_id=2, pid=7314 2024-05-11T00:19:06.180341419Z [2024-05-11T00:19:06.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:18:00+00:00, map_index=-1, run_start_date=2024-05-11 00:19:03.046156+00:00, run_end_date=2024-05-11 00:19:05.246017+00:00, run_duration=2.199861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:19:01.152158+00:00, queued_by_job_id=2, pid=7313 2024-05-11T00:20:00.915599699Z [2024-05-11T00:20:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:21:00+00:00 2024-05-11T00:20:00.925318208Z [2024-05-11T00:20:00.924+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:20:00.939602184Z [2024-05-11T00:20:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:21:00+00:00 2024-05-11T00:20:00.946658682Z [2024-05-11T00:20:00.946+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:20:00.957599655Z [2024-05-11T00:20:00.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:20:01.118481894Z [2024-05-11T00:20:01.118+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:20:01.118508335Z 2024-05-11T00:20:01.118511963Z 2024-05-11T00:20:01.118519278Z 2024-05-11T00:20:01.118522474Z 2024-05-11T00:20:01.118525606Z 2024-05-11T00:20:01.118736349Z [2024-05-11T00:20:01.118+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:20:01.118946669Z [2024-05-11T00:20:01.118+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:20:01.119141575Z [2024-05-11T00:20:01.118+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:20:01.119357661Z [2024-05-11T00:20:01.119+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:20:01.119519738Z [2024-05-11T00:20:01.119+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:20:01.120433360Z [2024-05-11T00:20:01.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:20:01.120445425Z 2024-05-11T00:20:01.120449106Z 2024-05-11T00:20:01.120452713Z 2024-05-11T00:20:01.120455885Z 2024-05-11T00:20:01.120458881Z 2024-05-11T00:20:01.126561722Z [2024-05-11T00:20:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:20:01.127794100Z [2024-05-11T00:20:01.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:20:01.128191539Z [2024-05-11T00:20:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:20:01.128364050Z [2024-05-11T00:20:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:20:01.128644216Z [2024-05-11T00:20:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:20:01.128811595Z [2024-05-11T00:20:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:20:01.129097522Z [2024-05-11T00:20:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:20:01.129270985Z [2024-05-11T00:20:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:20:01.129533696Z [2024-05-11T00:20:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:20:01.129753017Z [2024-05-11T00:20:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:20:01.690162297Z [2024-05-11T00:20:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:01.690188426Z [2024-05-11T00:20:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:01.690192563Z [2024-05-11T00:20:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:19:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:01.690237385Z [2024-05-11T00:20:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:19:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:01.690240817Z [2024-05-11T00:20:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:19:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:01.713737039Z [2024-05-11T00:20:01.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9675b733-d919-4c72-a036-6aeeb3c9abc6 2024-05-11T00:20:01.713796474Z [2024-05-11T00:20:01.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95cc8118-f763-4d42-ae12-68e0f0cc18c4 2024-05-11T00:20:01.713918988Z [2024-05-11T00:20:01.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2755ac58-d5be-45a4-a03c-af9d056a97e4 2024-05-11T00:20:01.715023447Z [2024-05-11T00:20:01.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2637ae1-10dd-4229-936f-886fb40b66c1 2024-05-11T00:20:01.715173228Z [2024-05-11T00:20:01.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 713010b9-b911-4981-b6a3-014299b2ecbb 2024-05-11T00:20:04.020956588Z [2024-05-11T00:20:04.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:20:04.021736843Z [2024-05-11T00:20:04.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:18:00+00:00, run_id=scheduled__2024-05-11T00:18:00+00:00, run_start_date=2024-05-11 00:20:00.974093+00:00, run_end_date=2024-05-11 00:20:04.020842+00:00, run_duration=3.046749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:18:00+00:00, data_interval_end=2024-05-11 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:20:04.033602477Z [2024-05-11T00:20:04.033+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:22:00+00:00 2024-05-11T00:20:04.046041762Z [2024-05-11T00:20:04.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:20:04.046079265Z [2024-05-11T00:20:04.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:19:00+00:00, run_id=scheduled__2024-05-11T00:19:00+00:00, run_start_date=2024-05-11 00:20:00.975905+00:00, run_end_date=2024-05-11 00:20:04.042348+00:00, run_duration=3.066443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:19:00+00:00, data_interval_end=2024-05-11 00:20:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:20:04.061056870Z [2024-05-11T00:20:04.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:21:00+00:00 2024-05-11T00:20:04.140200496Z [2024-05-11T00:20:04.139+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:20:04.140238188Z 2024-05-11T00:20:04.140340704Z [2024-05-11T00:20:04.140+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:20:04.140892487Z [2024-05-11T00:20:04.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:20:04.140904363Z 2024-05-11T00:20:04.143507589Z [2024-05-11T00:20:04.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:20:04.143619411Z [2024-05-11T00:20:04.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:20:04.245891804Z [2024-05-11T00:20:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:04.246336875Z [2024-05-11T00:20:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:04.246590771Z [2024-05-11T00:20:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:18:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:04.246803376Z [2024-05-11T00:20:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:19:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:04.270688691Z [2024-05-11T00:20:04.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:18:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:02.449457+00:00, run_end_date=2024-05-11 00:20:02.891732+00:00, run_duration=0.442275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:01.121976+00:00, queued_by_job_id=2, pid=7350 2024-05-11T00:20:04.271078132Z [2024-05-11T00:20:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:19:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:02.356982+00:00, run_end_date=2024-05-11 00:20:02.963002+00:00, run_duration=0.60602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:01.121976+00:00, queued_by_job_id=2, pid=7349 2024-05-11T00:20:04.271503247Z [2024-05-11T00:20:04.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:03.619558+00:00, run_end_date=2024-05-11 00:20:04.032220+00:00, run_duration=0.412662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:01.121976+00:00, queued_by_job_id=2, pid=7379 2024-05-11T00:20:04.271948965Z [2024-05-11T00:20:04.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to d562b5c2-a0ca-479b-9537-a018c546b2f6 2024-05-11T00:20:05.265172968Z [2024-05-11T00:20:05.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:20:05.265602656Z [2024-05-11T00:20:05.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:19:00+00:00, run_id=scheduled__2024-05-11T00:19:00+00:00, run_start_date=2024-05-11 00:20:00.977731+00:00, run_end_date=2024-05-11 00:20:05.265072+00:00, run_duration=4.287341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:19:00+00:00, data_interval_end=2024-05-11 00:20:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:20:05.281580390Z [2024-05-11T00:20:05.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:21:00+00:00 2024-05-11T00:20:05.291565976Z [2024-05-11T00:20:05.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:20:05.292082083Z [2024-05-11T00:20:05.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:19:00+00:00, run_id=scheduled__2024-05-11T00:19:00+00:00, run_start_date=2024-05-11 00:20:00.979618+00:00, run_end_date=2024-05-11 00:20:05.291460+00:00, run_duration=4.311842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:19:00+00:00, data_interval_end=2024-05-11 00:20:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:20:05.301972374Z [2024-05-11T00:20:05.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:21:00+00:00 2024-05-11T00:20:05.379769659Z [2024-05-11T00:20:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:19:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:05.389459876Z [2024-05-11T00:20:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:19:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:03.722697+00:00, run_end_date=2024-05-11 00:20:05.073763+00:00, run_duration=1.351066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:01.121976+00:00, queued_by_job_id=2, pid=7380 2024-05-11T00:20:06.509066263Z [2024-05-11T00:20:06.508+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:20:06.509104852Z 2024-05-11T00:20:06.509356313Z [2024-05-11T00:20:06.508+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:20:06.510102524Z [2024-05-11T00:20:06.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:20:06.510115636Z 2024-05-11T00:20:06.512585426Z [2024-05-11T00:20:06.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:20:06.513122981Z [2024-05-11T00:20:06.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:20:06.601719784Z [2024-05-11T00:20:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:06.602025249Z [2024-05-11T00:20:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:19:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:06.608700351Z [2024-05-11T00:20:06.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:19:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:03.530519+00:00, run_end_date=2024-05-11 00:20:05.219512+00:00, run_duration=1.688993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:01.121976+00:00, queued_by_job_id=2, pid=7378 2024-05-11T00:20:06.608976840Z [2024-05-11T00:20:06.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to cce73ebc-f8d1-4ff7-b336-2a14a5f63969 2024-05-11T00:20:06.703101315Z [2024-05-11T00:20:06.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:06.709839913Z [2024-05-11T00:20:06.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:06.032355+00:00, run_end_date=2024-05-11 00:20:06.406796+00:00, run_duration=0.374441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:04.141223+00:00, queued_by_job_id=2, pid=7413 2024-05-11T00:20:09.151023281Z [2024-05-11T00:20:09.150+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:20:09.151067459Z 2024-05-11T00:20:09.151072014Z [2024-05-11T00:20:09.150+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:20:09.151603229Z [2024-05-11T00:20:09.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:20:09.151629418Z 2024-05-11T00:20:09.154680698Z [2024-05-11T00:20:09.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:20:09.154694775Z [2024-05-11T00:20:09.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:20:09.218094068Z [2024-05-11T00:20:09.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status queued for try_number 1 2024-05-11T00:20:09.218125809Z [2024-05-11T00:20:09.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:09.229313185Z [2024-05-11T00:20:09.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58804382-6c9f-4ae3-93ed-ad9dee10f20d 2024-05-11T00:20:09.230504276Z [2024-05-11T00:20:09.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=0, run_start_date=2024-05-11 00:20:08.260830+00:00, run_end_date=2024-05-11 00:20:08.675339+00:00, run_duration=0.414509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:06.510591+00:00, queued_by_job_id=2, pid=7424 2024-05-11T00:20:12.527039902Z [2024-05-11T00:20:12.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:20:12.527520049Z [2024-05-11T00:20:12.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:15:00+00:00, run_id=scheduled__2024-05-11T00:15:00+00:00, run_start_date=2024-05-11 00:20:00.970861+00:00, run_end_date=2024-05-11 00:20:12.526855+00:00, run_duration=11.555994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:15:00+00:00, data_interval_end=2024-05-11 00:20:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:20:12.535218885Z [2024-05-11T00:20:12.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:20:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:20:12.601247055Z [2024-05-11T00:20:12.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:15:00+00:00 exited with status success for try_number 1 2024-05-11T00:20:12.612602217Z [2024-05-11T00:20:12.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:15:00+00:00, map_index=-1, run_start_date=2024-05-11 00:20:11.210410+00:00, run_end_date=2024-05-11 00:20:11.602235+00:00, run_duration=0.391825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:20:09.151963+00:00, queued_by_job_id=2, pid=7432 2024-05-11T00:20:34.672065839Z [2024-05-11T00:20:34.671+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:21:01.114030268Z [2024-05-11T00:21:01.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:21:00+00:00, run_after=2024-05-11T00:22:00+00:00 2024-05-11T00:21:01.122466353Z [2024-05-11T00:21:01.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:21:01.140535015Z [2024-05-11T00:21:01.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:21:00+00:00, run_after=2024-05-11T00:22:00+00:00 2024-05-11T00:21:01.217735069Z [2024-05-11T00:21:01.217+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:21:01.217773662Z 2024-05-11T00:21:01.217777617Z 2024-05-11T00:21:01.217780748Z 2024-05-11T00:21:01.218163943Z [2024-05-11T00:21:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:21:01.218409121Z [2024-05-11T00:21:01.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:21:01.218637323Z [2024-05-11T00:21:01.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:21:01.219322980Z [2024-05-11T00:21:01.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:21:01.219333855Z 2024-05-11T00:21:01.219337439Z 2024-05-11T00:21:01.219340445Z 2024-05-11T00:21:01.223619525Z [2024-05-11T00:21:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:21:01.223836410Z [2024-05-11T00:21:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:21:01.224601238Z [2024-05-11T00:21:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:21:01.225034672Z [2024-05-11T00:21:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:21:01.225788859Z [2024-05-11T00:21:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:21:01.226649462Z [2024-05-11T00:21:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:21:01.522756772Z [2024-05-11T00:21:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:21:01.522865479Z [2024-05-11T00:21:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:21:01.522907319Z [2024-05-11T00:21:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:21:01.532046677Z [2024-05-11T00:21:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 157f31a6-f158-42c5-b565-2918ed02f74b 2024-05-11T00:21:01.532079079Z [2024-05-11T00:21:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb1a1994-e828-4ab5-b2d5-98e29d9bdb36 2024-05-11T00:21:01.532182536Z [2024-05-11T00:21:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81dbe854-e5d8-4eb4-b3bc-1b2c9e008b9a 2024-05-11T00:21:03.803586068Z [2024-05-11T00:21:03.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:21:03.803937346Z [2024-05-11T00:21:03.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:20:00+00:00, run_id=scheduled__2024-05-11T00:20:00+00:00, run_start_date=2024-05-11 00:21:01.152127+00:00, run_end_date=2024-05-11 00:21:03.803469+00:00, run_duration=2.651342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:20:00+00:00, data_interval_end=2024-05-11 00:21:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:21:03.814323895Z [2024-05-11T00:21:03.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:21:00+00:00, run_after=2024-05-11T00:22:00+00:00 2024-05-11T00:21:03.862652838Z [2024-05-11T00:21:03.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:21:03.868137175Z [2024-05-11T00:21:03.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:21:02.107704+00:00, run_end_date=2024-05-11 00:21:02.553430+00:00, run_duration=0.445726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:21:01.220228+00:00, queued_by_job_id=2, pid=7441 2024-05-11T00:21:05.122179701Z [2024-05-11T00:21:05.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:21:05.122283199Z [2024-05-11T00:21:05.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:20:00+00:00, run_id=scheduled__2024-05-11T00:20:00+00:00, run_start_date=2024-05-11 00:21:01.153335+00:00, run_end_date=2024-05-11 00:21:05.121964+00:00, run_duration=3.968629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:20:00+00:00, data_interval_end=2024-05-11 00:21:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:21:05.131244446Z [2024-05-11T00:21:05.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:21:00+00:00, run_after=2024-05-11T00:22:00+00:00 2024-05-11T00:21:05.219886426Z [2024-05-11T00:21:05.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:21:05.227466415Z [2024-05-11T00:21:05.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:21:03.230704+00:00, run_end_date=2024-05-11 00:21:04.807195+00:00, run_duration=1.576491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:21:01.220228+00:00, queued_by_job_id=2, pid=7460 2024-05-11T00:21:05.674582300Z [2024-05-11T00:21:05.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:21:05.674675391Z [2024-05-11T00:21:05.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:20:00+00:00, run_id=scheduled__2024-05-11T00:20:00+00:00, run_start_date=2024-05-11 00:21:01.154426+00:00, run_end_date=2024-05-11 00:21:05.674256+00:00, run_duration=4.51983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:20:00+00:00, data_interval_end=2024-05-11 00:21:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:21:05.687213215Z [2024-05-11T00:21:05.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:21:00+00:00, run_after=2024-05-11T00:22:00+00:00 2024-05-11T00:21:05.729141798Z [2024-05-11T00:21:05.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:21:05.737980472Z [2024-05-11T00:21:05.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:21:03.153426+00:00, run_end_date=2024-05-11 00:21:05.120478+00:00, run_duration=1.967052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:21:01.220228+00:00, queued_by_job_id=2, pid=7459 2024-05-11T00:22:00.970117320Z [2024-05-11T00:22:00.969+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:22:00+00:00, run_after=2024-05-11T00:23:00+00:00 2024-05-11T00:22:00.979611141Z [2024-05-11T00:22:00.979+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:22:00.996729154Z [2024-05-11T00:22:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:22:00+00:00, run_after=2024-05-11T00:23:00+00:00 2024-05-11T00:22:01.009083009Z [2024-05-11T00:22:01.008+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:22:01.102053412Z [2024-05-11T00:22:01.101+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:22:01.102096521Z 2024-05-11T00:22:01.102110193Z 2024-05-11T00:22:01.102121282Z 2024-05-11T00:22:01.102126226Z 2024-05-11T00:22:01.102198194Z [2024-05-11T00:22:01.101+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:22:01.102423647Z [2024-05-11T00:22:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:22:01.102492398Z [2024-05-11T00:22:01.102+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:22:01.102568293Z [2024-05-11T00:22:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:22:01.103142764Z [2024-05-11T00:22:01.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:22:01.103163038Z 2024-05-11T00:22:01.103168727Z 2024-05-11T00:22:01.103173538Z 2024-05-11T00:22:01.103210625Z 2024-05-11T00:22:01.106719820Z [2024-05-11T00:22:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:22:01.106818598Z [2024-05-11T00:22:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:22:01.107082919Z [2024-05-11T00:22:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:22:01.107300157Z [2024-05-11T00:22:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:22:01.107544648Z [2024-05-11T00:22:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:22:01.107663007Z [2024-05-11T00:22:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:22:01.107951881Z [2024-05-11T00:22:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:22:01.108136385Z [2024-05-11T00:22:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:22:01.518355130Z [2024-05-11T00:22:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:22:01.518464559Z [2024-05-11T00:22:01.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:21:00+00:00 exited with status queued for try_number 1 2024-05-11T00:22:01.518605209Z [2024-05-11T00:22:01.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:21:00+00:00 exited with status queued for try_number 1 2024-05-11T00:22:01.518720511Z [2024-05-11T00:22:01.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:21:00+00:00 exited with status queued for try_number 1 2024-05-11T00:22:01.529455650Z [2024-05-11T00:22:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to fde1d3b7-1c2a-4bd0-b754-bb55273a2f15 2024-05-11T00:22:01.530017590Z [2024-05-11T00:22:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e6bf599-996d-4d7d-897d-e45c8f976827 2024-05-11T00:22:01.531412221Z [2024-05-11T00:22:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to acb129a4-df67-40ee-a57b-0411fecdfdbc 2024-05-11T00:22:01.531704570Z [2024-05-11T00:22:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a7bfaa8-92f0-42da-98ed-185c001f629a 2024-05-11T00:22:02.730625128Z [2024-05-11T00:22:02.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:22:02.734526226Z [2024-05-11T00:22:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:20:00+00:00, run_id=scheduled__2024-05-11T00:20:00+00:00, run_start_date=2024-05-11 00:22:01.030606+00:00, run_end_date=2024-05-11 00:22:02.730540+00:00, run_duration=1.699934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:20:00+00:00, data_interval_end=2024-05-11 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:22:02.743597965Z [2024-05-11T00:22:02.743+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:22:00+00:00, run_after=2024-05-11T00:24:00+00:00 2024-05-11T00:22:02.815435527Z [2024-05-11T00:22:02.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:22:02.821693899Z [2024-05-11T00:22:02.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:22:02.011964+00:00, run_end_date=2024-05-11 00:22:02.450480+00:00, run_duration=0.438516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:22:01.103966+00:00, queued_by_job_id=2, pid=7488 2024-05-11T00:22:03.880820797Z [2024-05-11T00:22:03.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:22:03.881425687Z [2024-05-11T00:22:03.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:21:00+00:00, run_id=scheduled__2024-05-11T00:21:00+00:00, run_start_date=2024-05-11 00:22:01.032738+00:00, run_end_date=2024-05-11 00:22:03.880813+00:00, run_duration=2.848075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:21:00+00:00, data_interval_end=2024-05-11 00:22:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:22:03.898046974Z [2024-05-11T00:22:03.897+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:22:00+00:00, run_after=2024-05-11T00:23:00+00:00 2024-05-11T00:22:03.951434650Z [2024-05-11T00:22:03.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:21:00+00:00 exited with status success for try_number 1 2024-05-11T00:22:03.958992578Z [2024-05-11T00:22:03.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:21:00+00:00, map_index=-1, run_start_date=2024-05-11 00:22:02.380818+00:00, run_end_date=2024-05-11 00:22:02.862636+00:00, run_duration=0.481818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:22:01.103966+00:00, queued_by_job_id=2, pid=7500 2024-05-11T00:22:06.038448860Z [2024-05-11T00:22:06.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:22:06.038623893Z [2024-05-11T00:22:06.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:21:00+00:00, run_id=scheduled__2024-05-11T00:21:00+00:00, run_start_date=2024-05-11 00:22:01.034661+00:00, run_end_date=2024-05-11 00:22:06.038347+00:00, run_duration=5.003686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:21:00+00:00, data_interval_end=2024-05-11 00:22:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:22:06.047374117Z [2024-05-11T00:22:06.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:22:00+00:00, run_after=2024-05-11T00:23:00+00:00 2024-05-11T00:22:06.053102243Z [2024-05-11T00:22:06.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:22:06.053355186Z [2024-05-11T00:22:06.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:21:00+00:00, run_id=scheduled__2024-05-11T00:21:00+00:00, run_start_date=2024-05-11 00:22:01.036666+00:00, run_end_date=2024-05-11 00:22:06.053014+00:00, run_duration=5.016348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:21:00+00:00, data_interval_end=2024-05-11 00:22:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:22:06.062680217Z [2024-05-11T00:22:06.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:22:00+00:00, run_after=2024-05-11T00:23:00+00:00 2024-05-11T00:22:06.120534567Z [2024-05-11T00:22:06.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:21:00+00:00 exited with status success for try_number 1 2024-05-11T00:22:06.120562159Z [2024-05-11T00:22:06.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:21:00+00:00 exited with status success for try_number 1 2024-05-11T00:22:06.127762433Z [2024-05-11T00:22:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:21:00+00:00, map_index=-1, run_start_date=2024-05-11 00:22:03.321425+00:00, run_end_date=2024-05-11 00:22:05.730943+00:00, run_duration=2.409518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:22:01.103966+00:00, queued_by_job_id=2, pid=7518 2024-05-11T00:22:06.127917768Z [2024-05-11T00:22:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:21:00+00:00, map_index=-1, run_start_date=2024-05-11 00:22:03.262637+00:00, run_end_date=2024-05-11 00:22:05.087365+00:00, run_duration=1.824728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:22:01.103966+00:00, queued_by_job_id=2, pid=7517 2024-05-11T00:23:00.624955951Z [2024-05-11T00:23:00.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:23:00+00:00, run_after=2024-05-11T00:24:00+00:00 2024-05-11T00:23:00.634000820Z [2024-05-11T00:23:00.633+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:23:00.652535304Z [2024-05-11T00:23:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:23:00+00:00, run_after=2024-05-11T00:24:00+00:00 2024-05-11T00:23:00.754735990Z [2024-05-11T00:23:00.754+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:23:00.754780951Z 2024-05-11T00:23:00.754787664Z 2024-05-11T00:23:00.754793399Z 2024-05-11T00:23:00.755086829Z [2024-05-11T00:23:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:23:00.755421400Z [2024-05-11T00:23:00.755+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:23:00.755801436Z [2024-05-11T00:23:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:23:00.757055304Z [2024-05-11T00:23:00.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:23:00.757083694Z 2024-05-11T00:23:00.757089608Z 2024-05-11T00:23:00.757094572Z 2024-05-11T00:23:00.762151656Z [2024-05-11T00:23:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:23:00.762457855Z [2024-05-11T00:23:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:23:00.762799000Z [2024-05-11T00:23:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:23:00.763021672Z [2024-05-11T00:23:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:23:00.763331318Z [2024-05-11T00:23:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:23:00.763546304Z [2024-05-11T00:23:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:23:00.995459355Z [2024-05-11T00:23:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status queued for try_number 1 2024-05-11T00:23:00.995490644Z [2024-05-11T00:23:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status queued for try_number 1 2024-05-11T00:23:00.995558378Z [2024-05-11T00:23:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status queued for try_number 1 2024-05-11T00:23:01.003322183Z [2024-05-11T00:23:01.002+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc890935-1724-43b0-a345-0a8c38affc77 2024-05-11T00:23:01.003381790Z [2024-05-11T00:23:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71a27c25-cafa-4fe6-bcf3-fa0699cf3e01 2024-05-11T00:23:01.003498404Z [2024-05-11T00:23:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to f370f22d-160d-4720-96d2-66fab12a0f8d 2024-05-11T00:23:02.267974999Z [2024-05-11T00:23:02.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:23:02.268249514Z [2024-05-11T00:23:02.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:22:00+00:00, run_id=scheduled__2024-05-11T00:22:00+00:00, run_start_date=2024-05-11 00:23:00.670114+00:00, run_end_date=2024-05-11 00:23:02.267753+00:00, run_duration=1.597639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:22:00+00:00, data_interval_end=2024-05-11 00:23:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:23:02.279099877Z [2024-05-11T00:23:02.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:23:00+00:00, run_after=2024-05-11T00:24:00+00:00 2024-05-11T00:23:02.335239425Z [2024-05-11T00:23:02.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status success for try_number 1 2024-05-11T00:23:02.345821377Z [2024-05-11T00:23:02.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:22:00+00:00, map_index=-1, run_start_date=2024-05-11 00:23:01.656827+00:00, run_end_date=2024-05-11 00:23:02.038755+00:00, run_duration=0.381928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:23:00.758453+00:00, queued_by_job_id=2, pid=7551 2024-05-11T00:23:04.465789043Z [2024-05-11T00:23:04.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:23:04.465978591Z [2024-05-11T00:23:04.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:22:00+00:00, run_id=scheduled__2024-05-11T00:22:00+00:00, run_start_date=2024-05-11 00:23:00.672029+00:00, run_end_date=2024-05-11 00:23:04.465581+00:00, run_duration=3.793552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:22:00+00:00, data_interval_end=2024-05-11 00:23:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:23:04.475873260Z [2024-05-11T00:23:04.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:23:00+00:00, run_after=2024-05-11T00:24:00+00:00 2024-05-11T00:23:04.516195319Z [2024-05-11T00:23:04.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status success for try_number 1 2024-05-11T00:23:04.523296154Z [2024-05-11T00:23:04.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:22:00+00:00, map_index=-1, run_start_date=2024-05-11 00:23:02.712875+00:00, run_end_date=2024-05-11 00:23:04.341303+00:00, run_duration=1.628428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:23:00.758453+00:00, queued_by_job_id=2, pid=7570 2024-05-11T00:23:05.568201207Z [2024-05-11T00:23:05.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:23:05.568620387Z [2024-05-11T00:23:05.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:22:00+00:00, run_id=scheduled__2024-05-11T00:22:00+00:00, run_start_date=2024-05-11 00:23:00.673650+00:00, run_end_date=2024-05-11 00:23:05.568004+00:00, run_duration=4.894354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:22:00+00:00, data_interval_end=2024-05-11 00:23:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:23:05.577813911Z [2024-05-11T00:23:05.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:23:00+00:00, run_after=2024-05-11T00:24:00+00:00 2024-05-11T00:23:05.619474250Z [2024-05-11T00:23:05.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status success for try_number 1 2024-05-11T00:23:05.627427692Z [2024-05-11T00:23:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:22:00+00:00, map_index=-1, run_start_date=2024-05-11 00:23:02.711065+00:00, run_end_date=2024-05-11 00:23:04.996662+00:00, run_duration=2.285597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:23:00.758453+00:00, queued_by_job_id=2, pid=7569 2024-05-11T00:24:00.942925966Z [2024-05-11T00:24:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:24:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:24:00.962490064Z [2024-05-11T00:24:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:24:00.970559094Z [2024-05-11T00:24:00.970+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:24:00.982948558Z [2024-05-11T00:24:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:24:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:24:01.105395222Z [2024-05-11T00:24:01.105+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:24:01.105424940Z 2024-05-11T00:24:01.105433972Z 2024-05-11T00:24:01.105440093Z 2024-05-11T00:24:01.105445146Z 2024-05-11T00:24:01.106239295Z [2024-05-11T00:24:01.105+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:24:01.106347777Z [2024-05-11T00:24:01.106+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:24:01.106419125Z [2024-05-11T00:24:01.106+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:24:01.106748315Z [2024-05-11T00:24:01.106+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:24:01.107589548Z [2024-05-11T00:24:01.107+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:24:01.107599789Z 2024-05-11T00:24:01.107603235Z 2024-05-11T00:24:01.107606202Z 2024-05-11T00:24:01.107609026Z 2024-05-11T00:24:01.113186302Z [2024-05-11T00:24:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:24:01.113254292Z [2024-05-11T00:24:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:24:01.113446602Z [2024-05-11T00:24:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:24:01.113515505Z [2024-05-11T00:24:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:24:01.113693948Z [2024-05-11T00:24:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:24:01.113754473Z [2024-05-11T00:24:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:24:01.114067656Z [2024-05-11T00:24:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:24:01.114137784Z [2024-05-11T00:24:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:24:01.434858128Z [2024-05-11T00:24:01.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status queued for try_number 1 2024-05-11T00:24:01.434962453Z [2024-05-11T00:24:01.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:23:00+00:00 exited with status queued for try_number 1 2024-05-11T00:24:01.435063734Z [2024-05-11T00:24:01.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:23:00+00:00 exited with status queued for try_number 1 2024-05-11T00:24:01.435176272Z [2024-05-11T00:24:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:23:00+00:00 exited with status queued for try_number 1 2024-05-11T00:24:01.445481232Z [2024-05-11T00:24:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 752333eb-c6c5-4f81-8f67-1d4c4b099ec4 2024-05-11T00:24:01.445617299Z [2024-05-11T00:24:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2347c24d-e800-4505-b5c6-3079c696a83a 2024-05-11T00:24:01.445761974Z [2024-05-11T00:24:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c3aa79a-64d9-4fe9-b754-54c4b6126389 2024-05-11T00:24:01.445944539Z [2024-05-11T00:24:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to af5e9fe7-06c4-4f10-bc7b-8690bfea8866 2024-05-11T00:24:03.147662543Z [2024-05-11T00:24:03.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:24:03.147935471Z [2024-05-11T00:24:03.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:22:00+00:00, run_id=scheduled__2024-05-11T00:22:00+00:00, run_start_date=2024-05-11 00:24:00.993574+00:00, run_end_date=2024-05-11 00:24:03.147556+00:00, run_duration=2.153982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:22:00+00:00, data_interval_end=2024-05-11 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:24:03.158095698Z [2024-05-11T00:24:03.156+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:24:00+00:00, run_after=2024-05-11T00:26:00+00:00 2024-05-11T00:24:03.179629644Z [2024-05-11T00:24:03.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:24:03.180045306Z [2024-05-11T00:24:03.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:23:00+00:00, run_id=scheduled__2024-05-11T00:23:00+00:00, run_start_date=2024-05-11 00:24:00.994862+00:00, run_end_date=2024-05-11 00:24:03.179511+00:00, run_duration=2.184649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:23:00+00:00, data_interval_end=2024-05-11 00:24:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:24:03.191406342Z [2024-05-11T00:24:03.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:24:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:24:03.247454112Z [2024-05-11T00:24:03.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:22:00+00:00 exited with status success for try_number 1 2024-05-11T00:24:03.248244189Z [2024-05-11T00:24:03.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:23:00+00:00 exited with status success for try_number 1 2024-05-11T00:24:03.257774864Z [2024-05-11T00:24:03.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:23:00+00:00, map_index=-1, run_start_date=2024-05-11 00:24:02.401704+00:00, run_end_date=2024-05-11 00:24:02.758655+00:00, run_duration=0.356951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:24:01.109072+00:00, queued_by_job_id=2, pid=7604 2024-05-11T00:24:03.258289060Z [2024-05-11T00:24:03.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:22:00+00:00, map_index=-1, run_start_date=2024-05-11 00:24:02.208150+00:00, run_end_date=2024-05-11 00:24:02.763602+00:00, run_duration=0.555452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:24:01.109072+00:00, queued_by_job_id=2, pid=7602 2024-05-11T00:24:06.520214831Z [2024-05-11T00:24:06.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:24:06.520519814Z [2024-05-11T00:24:06.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:23:00+00:00, run_id=scheduled__2024-05-11T00:23:00+00:00, run_start_date=2024-05-11 00:24:00.996002+00:00, run_end_date=2024-05-11 00:24:06.520004+00:00, run_duration=5.524002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:23:00+00:00, data_interval_end=2024-05-11 00:24:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:24:06.529556040Z [2024-05-11T00:24:06.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:24:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:24:06.536890269Z [2024-05-11T00:24:06.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:24:06.537256247Z [2024-05-11T00:24:06.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:23:00+00:00, run_id=scheduled__2024-05-11T00:23:00+00:00, run_start_date=2024-05-11 00:24:00.997032+00:00, run_end_date=2024-05-11 00:24:06.536782+00:00, run_duration=5.53975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:23:00+00:00, data_interval_end=2024-05-11 00:24:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:24:06.546507863Z [2024-05-11T00:24:06.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:24:00+00:00, run_after=2024-05-11T00:25:00+00:00 2024-05-11T00:24:06.591729893Z [2024-05-11T00:24:06.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:23:00+00:00 exited with status success for try_number 1 2024-05-11T00:24:06.592040860Z [2024-05-11T00:24:06.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:23:00+00:00 exited with status success for try_number 1 2024-05-11T00:24:06.607537419Z [2024-05-11T00:24:06.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:23:00+00:00, map_index=-1, run_start_date=2024-05-11 00:24:03.410194+00:00, run_end_date=2024-05-11 00:24:05.969573+00:00, run_duration=2.559379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:24:01.109072+00:00, queued_by_job_id=2, pid=7626 2024-05-11T00:24:06.607698214Z [2024-05-11T00:24:06.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:23:00+00:00, map_index=-1, run_start_date=2024-05-11 00:24:03.591445+00:00, run_end_date=2024-05-11 00:24:05.674680+00:00, run_duration=2.083235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:24:01.109072+00:00, queued_by_job_id=2, pid=7627 2024-05-11T00:25:00.326375571Z [2024-05-11T00:25:00.325+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:25:00.353634143Z [2024-05-11T00:25:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:26:00+00:00 2024-05-11T00:25:00.378021794Z [2024-05-11T00:25:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:25:00.400702431Z [2024-05-11T00:25:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:26:00+00:00 2024-05-11T00:25:00.555621608Z [2024-05-11T00:25:00.555+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:25:00.555655552Z 2024-05-11T00:25:00.555665418Z 2024-05-11T00:25:00.555668890Z 2024-05-11T00:25:00.555672206Z 2024-05-11T00:25:00.555817206Z [2024-05-11T00:25:00.555+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:25:00.555992199Z [2024-05-11T00:25:00.555+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:25:00.556187868Z [2024-05-11T00:25:00.556+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:25:00.556376751Z [2024-05-11T00:25:00.556+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:25:00.557092756Z [2024-05-11T00:25:00.556+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:25:00.557101295Z 2024-05-11T00:25:00.557105064Z 2024-05-11T00:25:00.557108452Z 2024-05-11T00:25:00.557111601Z 2024-05-11T00:25:00.561847843Z [2024-05-11T00:25:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:25:00.562814951Z [2024-05-11T00:25:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:25:00.563152966Z [2024-05-11T00:25:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:25:00.563721781Z [2024-05-11T00:25:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:25:00.563731035Z [2024-05-11T00:25:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:25:00.563803559Z [2024-05-11T00:25:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:25:00.564046197Z [2024-05-11T00:25:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:25:00.564250495Z [2024-05-11T00:25:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:25:01.034173906Z [2024-05-11T00:25:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:01.034223422Z [2024-05-11T00:25:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:01.034227717Z [2024-05-11T00:25:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:01.039653255Z [2024-05-11T00:25:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:01.060534470Z [2024-05-11T00:25:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 649e4475-a056-4e57-8df2-f98f8e57ae0f 2024-05-11T00:25:01.060875658Z [2024-05-11T00:25:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 002ba0e5-c7c8-4699-9c45-a93bcdaedccf 2024-05-11T00:25:01.061106075Z [2024-05-11T00:25:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 093ae6b8-ee10-4873-ae77-fcc338ae20c9 2024-05-11T00:25:01.061349342Z [2024-05-11T00:25:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7b27867-a45a-4bbf-b806-e4d9a8121201 2024-05-11T00:25:02.607859501Z [2024-05-11T00:25:02.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:25:02.608378603Z [2024-05-11T00:25:02.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:24:00+00:00, run_id=scheduled__2024-05-11T00:24:00+00:00, run_start_date=2024-05-11 00:25:00.426117+00:00, run_end_date=2024-05-11 00:25:02.607916+00:00, run_duration=2.181799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:24:00+00:00, data_interval_end=2024-05-11 00:25:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:25:02.621463512Z [2024-05-11T00:25:02.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:26:00+00:00 2024-05-11T00:25:03.095512139Z [2024-05-11T00:25:03.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:03.108099942Z [2024-05-11T00:25:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:24:00+00:00, map_index=-1, run_start_date=2024-05-11 00:25:01.939062+00:00, run_end_date=2024-05-11 00:25:02.524128+00:00, run_duration=0.585066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:00.558449+00:00, queued_by_job_id=2, pid=7660 2024-05-11T00:25:04.236913864Z [2024-05-11T00:25:04.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:25:04.236983819Z 2024-05-11T00:25:04.237133921Z [2024-05-11T00:25:04.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:25:04.237780861Z [2024-05-11T00:25:04.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:25:04.237793977Z 2024-05-11T00:25:04.240583887Z [2024-05-11T00:25:04.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:25:04.240856508Z [2024-05-11T00:25:04.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:25:04.333593886Z [2024-05-11T00:25:04.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:04.333934236Z [2024-05-11T00:25:04.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:04.342700131Z [2024-05-11T00:25:04.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19119708-b9ee-4131-8e6c-37cdd59b30a7 2024-05-11T00:25:04.343121801Z [2024-05-11T00:25:04.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:25:03.432973+00:00, run_end_date=2024-05-11 00:25:04.136743+00:00, run_duration=0.70377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:00.558449+00:00, queued_by_job_id=2, pid=7676 2024-05-11T00:25:05.529023444Z [2024-05-11T00:25:05.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:25:05.529380087Z [2024-05-11T00:25:05.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:24:00+00:00, run_id=scheduled__2024-05-11T00:24:00+00:00, run_start_date=2024-05-11 00:25:00.428959+00:00, run_end_date=2024-05-11 00:25:05.529020+00:00, run_duration=5.100061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:24:00+00:00, data_interval_end=2024-05-11 00:25:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:25:05.538747066Z [2024-05-11T00:25:05.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:26:00+00:00 2024-05-11T00:25:05.604472535Z [2024-05-11T00:25:05.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:05.614255891Z [2024-05-11T00:25:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:24:00+00:00, map_index=-1, run_start_date=2024-05-11 00:25:03.748894+00:00, run_end_date=2024-05-11 00:25:05.148161+00:00, run_duration=1.399267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:00.558449+00:00, queued_by_job_id=2, pid=7686 2024-05-11T00:25:06.660320859Z [2024-05-11T00:25:06.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:25:06.660358945Z [2024-05-11T00:25:06.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:24:00+00:00, run_id=scheduled__2024-05-11T00:24:00+00:00, run_start_date=2024-05-11 00:25:00.431778+00:00, run_end_date=2024-05-11 00:25:06.658363+00:00, run_duration=6.226585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:24:00+00:00, data_interval_end=2024-05-11 00:25:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:25:06.674002629Z [2024-05-11T00:25:06.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:26:00+00:00 2024-05-11T00:25:06.713240622Z [2024-05-11T00:25:06.712+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:25:06.713293460Z 2024-05-11T00:25:06.713608862Z [2024-05-11T00:25:06.713+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:25:06.714605424Z [2024-05-11T00:25:06.714+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:25:06.714622819Z 2024-05-11T00:25:06.717576110Z [2024-05-11T00:25:06.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:25:06.717827214Z [2024-05-11T00:25:06.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:25:06.824057418Z [2024-05-11T00:25:06.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:06.824102796Z [2024-05-11T00:25:06.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:06.824153413Z [2024-05-11T00:25:06.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:06.841735426Z [2024-05-11T00:25:06.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:25:05.867992+00:00, run_end_date=2024-05-11 00:25:06.248712+00:00, run_duration=0.38072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:04.238417+00:00, queued_by_job_id=2, pid=7719 2024-05-11T00:25:06.842239056Z [2024-05-11T00:25:06.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a424d60-9d7a-469c-a3e4-c114780a4cfe 2024-05-11T00:25:06.842442354Z [2024-05-11T00:25:06.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:24:00+00:00, map_index=-1, run_start_date=2024-05-11 00:25:03.729510+00:00, run_end_date=2024-05-11 00:25:05.664064+00:00, run_duration=1.934554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:00.558449+00:00, queued_by_job_id=2, pid=7685 2024-05-11T00:25:09.321002970Z [2024-05-11T00:25:09.320+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:25:09.321070835Z 2024-05-11T00:25:09.321085287Z [2024-05-11T00:25:09.320+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:25:09.321710108Z [2024-05-11T00:25:09.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:25:09.321744710Z 2024-05-11T00:25:09.323992653Z [2024-05-11T00:25:09.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:25:09.324037025Z [2024-05-11T00:25:09.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:25:09.402748709Z [2024-05-11T00:25:09.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status queued for try_number 1 2024-05-11T00:25:09.403018475Z [2024-05-11T00:25:09.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:09.411937276Z [2024-05-11T00:25:09.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe153e3-fd83-47fd-89c4-02585c259a70 2024-05-11T00:25:09.412329856Z [2024-05-11T00:25:09.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=0, run_start_date=2024-05-11 00:25:08.445362+00:00, run_end_date=2024-05-11 00:25:08.858403+00:00, run_duration=0.413041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:06.715056+00:00, queued_by_job_id=2, pid=7730 2024-05-11T00:25:11.730393037Z [2024-05-11T00:25:11.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:25:11.730875296Z [2024-05-11T00:25:11.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:20:00+00:00, run_id=scheduled__2024-05-11T00:20:00+00:00, run_start_date=2024-05-11 00:25:00.422633+00:00, run_end_date=2024-05-11 00:25:11.730366+00:00, run_duration=11.307733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:20:00+00:00, data_interval_end=2024-05-11 00:25:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:25:11.741505596Z [2024-05-11T00:25:11.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:25:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:25:12.908130917Z [2024-05-11T00:25:12.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:20:00+00:00 exited with status success for try_number 1 2024-05-11T00:25:12.917893055Z [2024-05-11T00:25:12.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:20:00+00:00, map_index=-1, run_start_date=2024-05-11 00:25:11.218160+00:00, run_end_date=2024-05-11 00:25:11.643559+00:00, run_duration=0.425399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:25:09.321984+00:00, queued_by_job_id=2, pid=7738 2024-05-11T00:25:34.696298611Z [2024-05-11T00:25:34.695+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:26:00.840127640Z [2024-05-11T00:26:00.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:26:00+00:00, run_after=2024-05-11T00:27:00+00:00 2024-05-11T00:26:00.854225256Z [2024-05-11T00:26:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:26:00.870171451Z [2024-05-11T00:26:00.869+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:26:00.896465313Z [2024-05-11T00:26:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:26:00+00:00, run_after=2024-05-11T00:27:00+00:00 2024-05-11T00:26:01.001742819Z [2024-05-11T00:26:01.000+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:26:01.001804277Z 2024-05-11T00:26:01.001820172Z 2024-05-11T00:26:01.001833246Z 2024-05-11T00:26:01.001845938Z 2024-05-11T00:26:01.002340414Z [2024-05-11T00:26:01.001+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:26:01.003017756Z [2024-05-11T00:26:01.002+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:26:01.003521192Z [2024-05-11T00:26:01.003+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:26:01.003927049Z [2024-05-11T00:26:01.003+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:26:01.005233315Z [2024-05-11T00:26:01.004+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:26:01.005253252Z 2024-05-11T00:26:01.005260696Z 2024-05-11T00:26:01.005266938Z 2024-05-11T00:26:01.005272596Z 2024-05-11T00:26:01.018124181Z [2024-05-11T00:26:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:26:01.018336905Z [2024-05-11T00:26:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:26:01.018788705Z [2024-05-11T00:26:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:26:01.019025931Z [2024-05-11T00:26:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:26:01.019347197Z [2024-05-11T00:26:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:26:01.019472785Z [2024-05-11T00:26:01.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:26:01.019766524Z [2024-05-11T00:26:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:26:01.019905788Z [2024-05-11T00:26:01.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:26:01.530066847Z [2024-05-11T00:26:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status queued for try_number 1 2024-05-11T00:26:01.530629278Z [2024-05-11T00:26:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:26:01.530926860Z [2024-05-11T00:26:01.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:26:01.531204123Z [2024-05-11T00:26:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:26:01.541444101Z [2024-05-11T00:26:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to d26722d8-38ab-46ee-9794-22a2050e7fe8 2024-05-11T00:26:01.541825401Z [2024-05-11T00:26:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e8718c8-5d45-4ec6-9d3b-f5ad7bb8bf46 2024-05-11T00:26:01.542207206Z [2024-05-11T00:26:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ea102d9-11d3-4c25-ac05-61f6fa1d3133 2024-05-11T00:26:01.542539231Z [2024-05-11T00:26:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50af0ab5-c868-4ab3-9c4d-ac9d44d5a7c0 2024-05-11T00:26:02.685380741Z [2024-05-11T00:26:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:26:02.685823926Z [2024-05-11T00:26:02.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:24:00+00:00, run_id=scheduled__2024-05-11T00:24:00+00:00, run_start_date=2024-05-11 00:26:00.914491+00:00, run_end_date=2024-05-11 00:26:02.685244+00:00, run_duration=1.770753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:24:00+00:00, data_interval_end=2024-05-11 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:26:02.693448840Z [2024-05-11T00:26:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:26:00+00:00, run_after=2024-05-11T00:28:00+00:00 2024-05-11T00:26:02.700481593Z [2024-05-11T00:26:02.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:26:02.700922904Z [2024-05-11T00:26:02.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:25:00+00:00, run_id=scheduled__2024-05-11T00:25:00+00:00, run_start_date=2024-05-11 00:26:00.916725+00:00, run_end_date=2024-05-11 00:26:02.700354+00:00, run_duration=1.783629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:25:00+00:00, data_interval_end=2024-05-11 00:26:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:26:02.711715323Z [2024-05-11T00:26:02.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:26:00+00:00, run_after=2024-05-11T00:27:00+00:00 2024-05-11T00:26:02.772242881Z [2024-05-11T00:26:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:24:00+00:00 exited with status success for try_number 1 2024-05-11T00:26:02.772769824Z [2024-05-11T00:26:02.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:26:02.785072366Z [2024-05-11T00:26:02.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=-1, run_start_date=2024-05-11 00:26:01.884127+00:00, run_end_date=2024-05-11 00:26:02.334032+00:00, run_duration=0.449905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:26:01.007785+00:00, queued_by_job_id=2, pid=7748 2024-05-11T00:26:02.785176063Z [2024-05-11T00:26:02.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:24:00+00:00, map_index=-1, run_start_date=2024-05-11 00:26:02.114124+00:00, run_end_date=2024-05-11 00:26:02.565673+00:00, run_duration=0.451549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:26:01.007785+00:00, queued_by_job_id=2, pid=7749 2024-05-11T00:26:06.311970468Z [2024-05-11T00:26:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:26:06.312479590Z [2024-05-11T00:26:06.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:25:00+00:00, run_id=scheduled__2024-05-11T00:25:00+00:00, run_start_date=2024-05-11 00:26:00.918345+00:00, run_end_date=2024-05-11 00:26:06.311803+00:00, run_duration=5.393458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:25:00+00:00, data_interval_end=2024-05-11 00:26:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:26:06.321378106Z [2024-05-11T00:26:06.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:26:00+00:00, run_after=2024-05-11T00:27:00+00:00 2024-05-11T00:26:06.328497779Z [2024-05-11T00:26:06.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:26:06.328928531Z [2024-05-11T00:26:06.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:25:00+00:00, run_id=scheduled__2024-05-11T00:25:00+00:00, run_start_date=2024-05-11 00:26:00.919787+00:00, run_end_date=2024-05-11 00:26:06.328581+00:00, run_duration=5.408794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:25:00+00:00, data_interval_end=2024-05-11 00:26:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:26:06.339706246Z [2024-05-11T00:26:06.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:26:00+00:00, run_after=2024-05-11T00:27:00+00:00 2024-05-11T00:26:06.394537796Z [2024-05-11T00:26:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:26:06.394993654Z [2024-05-11T00:26:06.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:26:06.403718394Z [2024-05-11T00:26:06.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=-1, run_start_date=2024-05-11 00:26:03.089429+00:00, run_end_date=2024-05-11 00:26:05.330527+00:00, run_duration=2.241098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:26:01.007785+00:00, queued_by_job_id=2, pid=7772 2024-05-11T00:26:06.404460591Z [2024-05-11T00:26:06.404+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=-1, run_start_date=2024-05-11 00:26:03.201645+00:00, run_end_date=2024-05-11 00:26:05.089564+00:00, run_duration=1.887919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:26:01.007785+00:00, queued_by_job_id=2, pid=7773 2024-05-11T00:27:00.138018350Z [2024-05-11T00:27:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:27:00+00:00, run_after=2024-05-11T00:28:00+00:00 2024-05-11T00:27:00.145713959Z [2024-05-11T00:27:00.145+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:27:00.160784022Z [2024-05-11T00:27:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:27:00+00:00, run_after=2024-05-11T00:28:00+00:00 2024-05-11T00:27:00.242650766Z [2024-05-11T00:27:00.241+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:27:00.242697170Z 2024-05-11T00:27:00.242706926Z 2024-05-11T00:27:00.242716067Z 2024-05-11T00:27:00.243115736Z [2024-05-11T00:27:00.242+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:27:00.243504961Z [2024-05-11T00:27:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:27:00.243831855Z [2024-05-11T00:27:00.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:27:00.245278559Z [2024-05-11T00:27:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:27:00.245302306Z 2024-05-11T00:27:00.245311198Z 2024-05-11T00:27:00.245320094Z 2024-05-11T00:27:00.251454151Z [2024-05-11T00:27:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:27:00.251725057Z [2024-05-11T00:27:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:27:00.252159662Z [2024-05-11T00:27:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:27:00.252359679Z [2024-05-11T00:27:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:27:00.252719781Z [2024-05-11T00:27:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:27:00.252984931Z [2024-05-11T00:27:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:27:00.536403368Z [2024-05-11T00:27:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status queued for try_number 1 2024-05-11T00:27:00.536496038Z [2024-05-11T00:27:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status queued for try_number 1 2024-05-11T00:27:00.536576884Z [2024-05-11T00:27:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status queued for try_number 1 2024-05-11T00:27:00.545651520Z [2024-05-11T00:27:00.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to fac0a967-5d87-4ab4-85c7-3708e711dacf 2024-05-11T00:27:00.545930208Z [2024-05-11T00:27:00.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 034acf89-c847-470a-b4d5-c1d46e5471d2 2024-05-11T00:27:00.546143125Z [2024-05-11T00:27:00.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61dd17ba-ba44-4fb0-a16e-2068356f8ab2 2024-05-11T00:27:01.694265373Z [2024-05-11T00:27:01.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:27:01.694891245Z [2024-05-11T00:27:01.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:26:00+00:00, run_id=scheduled__2024-05-11T00:26:00+00:00, run_start_date=2024-05-11 00:27:00.172962+00:00, run_end_date=2024-05-11 00:27:01.694177+00:00, run_duration=1.521215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:26:00+00:00, data_interval_end=2024-05-11 00:27:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:27:01.707809453Z [2024-05-11T00:27:01.707+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:27:00+00:00, run_after=2024-05-11T00:28:00+00:00 2024-05-11T00:27:01.758575969Z [2024-05-11T00:27:01.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status success for try_number 1 2024-05-11T00:27:01.763462502Z [2024-05-11T00:27:01.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:26:00+00:00, map_index=-1, run_start_date=2024-05-11 00:27:01.028820+00:00, run_end_date=2024-05-11 00:27:01.431595+00:00, run_duration=0.402775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:27:00.247048+00:00, queued_by_job_id=2, pid=7805 2024-05-11T00:27:03.928610628Z [2024-05-11T00:27:03.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:27:03.929018472Z [2024-05-11T00:27:03.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:26:00+00:00, run_id=scheduled__2024-05-11T00:26:00+00:00, run_start_date=2024-05-11 00:27:00.174492+00:00, run_end_date=2024-05-11 00:27:03.928486+00:00, run_duration=3.753994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:26:00+00:00, data_interval_end=2024-05-11 00:27:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:27:03.937162722Z [2024-05-11T00:27:03.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:27:00+00:00, run_after=2024-05-11T00:28:00+00:00 2024-05-11T00:27:03.943273334Z [2024-05-11T00:27:03.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:27:03.943656034Z [2024-05-11T00:27:03.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:26:00+00:00, run_id=scheduled__2024-05-11T00:26:00+00:00, run_start_date=2024-05-11 00:27:00.175475+00:00, run_end_date=2024-05-11 00:27:03.943170+00:00, run_duration=3.767695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:26:00+00:00, data_interval_end=2024-05-11 00:27:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:27:03.951977456Z [2024-05-11T00:27:03.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:27:00+00:00, run_after=2024-05-11T00:28:00+00:00 2024-05-11T00:27:03.998288556Z [2024-05-11T00:27:03.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status success for try_number 1 2024-05-11T00:27:03.998412835Z [2024-05-11T00:27:03.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status success for try_number 1 2024-05-11T00:27:04.008603651Z [2024-05-11T00:27:04.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:26:00+00:00, map_index=-1, run_start_date=2024-05-11 00:27:02.131230+00:00, run_end_date=2024-05-11 00:27:03.478802+00:00, run_duration=1.347572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:27:00.247048+00:00, queued_by_job_id=2, pid=7824 2024-05-11T00:27:04.008789814Z [2024-05-11T00:27:04.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:26:00+00:00, map_index=-1, run_start_date=2024-05-11 00:27:02.045615+00:00, run_end_date=2024-05-11 00:27:03.827861+00:00, run_duration=1.782246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:27:00.247048+00:00, queued_by_job_id=2, pid=7823 2024-05-11T00:28:00.018010109Z [2024-05-11T00:28:00.012+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:28:00.035326767Z [2024-05-11T00:28:00.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:28:00+00:00, run_after=2024-05-11T00:29:00+00:00 2024-05-11T00:28:00.050868043Z [2024-05-11T00:28:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:28:00+00:00, run_after=2024-05-11T00:29:00+00:00 2024-05-11T00:28:00.059049528Z [2024-05-11T00:28:00.058+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:28:00.170078348Z [2024-05-11T00:28:00.169+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:28:00.170132942Z 2024-05-11T00:28:00.170139846Z 2024-05-11T00:28:00.170145172Z 2024-05-11T00:28:00.170150391Z 2024-05-11T00:28:00.170454326Z [2024-05-11T00:28:00.169+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:28:00.170663978Z [2024-05-11T00:28:00.170+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:28:00.170887328Z [2024-05-11T00:28:00.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:28:00.171092019Z [2024-05-11T00:28:00.170+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:28:00.172429039Z [2024-05-11T00:28:00.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:28:00.172483202Z 2024-05-11T00:28:00.172517102Z 2024-05-11T00:28:00.172525485Z 2024-05-11T00:28:00.172532773Z 2024-05-11T00:28:00.179734144Z [2024-05-11T00:28:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:28:00.179865547Z [2024-05-11T00:28:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:28:00.180289867Z [2024-05-11T00:28:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:28:00.180512501Z [2024-05-11T00:28:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:28:00.180874636Z [2024-05-11T00:28:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:28:00.181035163Z [2024-05-11T00:28:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:28:00.181405667Z [2024-05-11T00:28:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:28:00.181574697Z [2024-05-11T00:28:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:28:00.618805726Z [2024-05-11T00:28:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status queued for try_number 1 2024-05-11T00:28:00.619111086Z [2024-05-11T00:28:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:27:00+00:00 exited with status queued for try_number 1 2024-05-11T00:28:00.619338603Z [2024-05-11T00:28:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:27:00+00:00 exited with status queued for try_number 1 2024-05-11T00:28:00.619573569Z [2024-05-11T00:28:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:27:00+00:00 exited with status queued for try_number 1 2024-05-11T00:28:00.634558949Z [2024-05-11T00:28:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to b92de09d-1926-4cd2-8042-670eb24c2b17 2024-05-11T00:28:00.634880133Z [2024-05-11T00:28:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29814fc9-9fa8-4495-9b88-edb8f8fb34b2 2024-05-11T00:28:00.635136487Z [2024-05-11T00:28:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49033558-86aa-400a-b14d-f9fae0974a0a 2024-05-11T00:28:00.635429103Z [2024-05-11T00:28:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93d88597-21ab-45f9-9905-bcf1c42664ca 2024-05-11T00:28:02.027699666Z [2024-05-11T00:28:02.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:28:02.028363565Z [2024-05-11T00:28:02.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:26:00+00:00, run_id=scheduled__2024-05-11T00:26:00+00:00, run_start_date=2024-05-11 00:28:00.071343+00:00, run_end_date=2024-05-11 00:28:02.027871+00:00, run_duration=1.956528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:26:00+00:00, data_interval_end=2024-05-11 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:28:02.037549630Z [2024-05-11T00:28:02.037+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:28:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:28:02.047258009Z [2024-05-11T00:28:02.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:28:02.047772475Z [2024-05-11T00:28:02.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:27:00+00:00, run_id=scheduled__2024-05-11T00:27:00+00:00, run_start_date=2024-05-11 00:28:00.072944+00:00, run_end_date=2024-05-11 00:28:02.047170+00:00, run_duration=1.974226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:27:00+00:00, data_interval_end=2024-05-11 00:28:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:28:02.059533756Z [2024-05-11T00:28:02.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:28:00+00:00, run_after=2024-05-11T00:29:00+00:00 2024-05-11T00:28:02.123163120Z [2024-05-11T00:28:02.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:26:00+00:00 exited with status success for try_number 1 2024-05-11T00:28:02.123227517Z [2024-05-11T00:28:02.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:27:00+00:00 exited with status success for try_number 1 2024-05-11T00:28:02.132302425Z [2024-05-11T00:28:02.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:27:00+00:00, map_index=-1, run_start_date=2024-05-11 00:28:01.374911+00:00, run_end_date=2024-05-11 00:28:01.754623+00:00, run_duration=0.379712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:28:00.174395+00:00, queued_by_job_id=2, pid=7859 2024-05-11T00:28:02.132451102Z [2024-05-11T00:28:02.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:26:00+00:00, map_index=-1, run_start_date=2024-05-11 00:28:01.079901+00:00, run_end_date=2024-05-11 00:28:01.556710+00:00, run_duration=0.476809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:28:00.174395+00:00, queued_by_job_id=2, pid=7858 2024-05-11T00:28:04.294440799Z [2024-05-11T00:28:04.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:28:04.294687309Z [2024-05-11T00:28:04.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:27:00+00:00, run_id=scheduled__2024-05-11T00:27:00+00:00, run_start_date=2024-05-11 00:28:00.078223+00:00, run_end_date=2024-05-11 00:28:04.294339+00:00, run_duration=4.216116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:27:00+00:00, data_interval_end=2024-05-11 00:28:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:28:04.305949999Z [2024-05-11T00:28:04.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:28:00+00:00, run_after=2024-05-11T00:29:00+00:00 2024-05-11T00:28:04.314903108Z [2024-05-11T00:28:04.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:28:04.315058058Z [2024-05-11T00:28:04.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:27:00+00:00, run_id=scheduled__2024-05-11T00:27:00+00:00, run_start_date=2024-05-11 00:28:00.079686+00:00, run_end_date=2024-05-11 00:28:04.314809+00:00, run_duration=4.235123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:27:00+00:00, data_interval_end=2024-05-11 00:28:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:28:04.324154654Z [2024-05-11T00:28:04.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:28:00+00:00, run_after=2024-05-11T00:29:00+00:00 2024-05-11T00:28:04.355263267Z [2024-05-11T00:28:04.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:27:00+00:00 exited with status success for try_number 1 2024-05-11T00:28:04.355421952Z [2024-05-11T00:28:04.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:27:00+00:00 exited with status success for try_number 1 2024-05-11T00:28:04.361656471Z [2024-05-11T00:28:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:27:00+00:00, map_index=-1, run_start_date=2024-05-11 00:28:02.255396+00:00, run_end_date=2024-05-11 00:28:03.801378+00:00, run_duration=1.545982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:28:00.174395+00:00, queued_by_job_id=2, pid=7883 2024-05-11T00:28:04.361779636Z [2024-05-11T00:28:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:27:00+00:00, map_index=-1, run_start_date=2024-05-11 00:28:02.221283+00:00, run_end_date=2024-05-11 00:28:03.562856+00:00, run_duration=1.341573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:28:00.174395+00:00, queued_by_job_id=2, pid=7882 2024-05-11T00:29:01.021886645Z [2024-05-11T00:29:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:29:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:29:01.029400177Z [2024-05-11T00:29:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:29:01.042167396Z [2024-05-11T00:29:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:29:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:29:01.149171517Z [2024-05-11T00:29:01.148+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:29:01.149207624Z 2024-05-11T00:29:01.149211575Z 2024-05-11T00:29:01.149214841Z 2024-05-11T00:29:01.149492987Z [2024-05-11T00:29:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:29:01.149849607Z [2024-05-11T00:29:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:29:01.150166916Z [2024-05-11T00:29:01.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:29:01.150979825Z [2024-05-11T00:29:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:29:01.150994571Z 2024-05-11T00:29:01.150999235Z 2024-05-11T00:29:01.151003826Z 2024-05-11T00:29:01.155442924Z [2024-05-11T00:29:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:29:01.155621734Z [2024-05-11T00:29:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:29:01.155881894Z [2024-05-11T00:29:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:29:01.156134979Z [2024-05-11T00:29:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:29:01.156522956Z [2024-05-11T00:29:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:29:01.156725011Z [2024-05-11T00:29:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:29:01.401117997Z [2024-05-11T00:29:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status queued for try_number 1 2024-05-11T00:29:01.401476952Z [2024-05-11T00:29:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status queued for try_number 1 2024-05-11T00:29:01.402031265Z [2024-05-11T00:29:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status queued for try_number 1 2024-05-11T00:29:01.411113955Z [2024-05-11T00:29:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 550e7d81-4c06-4538-9fc8-da8b39bcd7ca 2024-05-11T00:29:01.411451338Z [2024-05-11T00:29:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5c9f818-e5ed-4cf5-bdf2-40ad2f607497 2024-05-11T00:29:01.411747847Z [2024-05-11T00:29:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 000b5aa9-29f0-422d-936d-41934d7bf773 2024-05-11T00:29:02.974875669Z [2024-05-11T00:29:02.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:29:02.975203894Z [2024-05-11T00:29:02.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:28:00+00:00, run_id=scheduled__2024-05-11T00:28:00+00:00, run_start_date=2024-05-11 00:29:01.059951+00:00, run_end_date=2024-05-11 00:29:02.974855+00:00, run_duration=1.914904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:28:00+00:00, data_interval_end=2024-05-11 00:29:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:29:02.984005425Z [2024-05-11T00:29:02.983+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:29:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:29:03.040415580Z [2024-05-11T00:29:03.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status success for try_number 1 2024-05-11T00:29:03.048433485Z [2024-05-11T00:29:03.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:28:00+00:00, map_index=-1, run_start_date=2024-05-11 00:29:01.841545+00:00, run_end_date=2024-05-11 00:29:02.280841+00:00, run_duration=0.439296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:29:01.152277+00:00, queued_by_job_id=2, pid=7915 2024-05-11T00:29:05.199944922Z [2024-05-11T00:29:05.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:29:05.200206184Z [2024-05-11T00:29:05.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:28:00+00:00, run_id=scheduled__2024-05-11T00:28:00+00:00, run_start_date=2024-05-11 00:29:01.061985+00:00, run_end_date=2024-05-11 00:29:05.199791+00:00, run_duration=4.137806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:28:00+00:00, data_interval_end=2024-05-11 00:29:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:29:05.210903525Z [2024-05-11T00:29:05.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:29:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:29:05.217688048Z [2024-05-11T00:29:05.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:29:05.218018049Z [2024-05-11T00:29:05.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:28:00+00:00, run_id=scheduled__2024-05-11T00:28:00+00:00, run_start_date=2024-05-11 00:29:01.063356+00:00, run_end_date=2024-05-11 00:29:05.217575+00:00, run_duration=4.154219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:28:00+00:00, data_interval_end=2024-05-11 00:29:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:29:05.231916643Z [2024-05-11T00:29:05.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:29:00+00:00, run_after=2024-05-11T00:30:00+00:00 2024-05-11T00:29:05.268210837Z [2024-05-11T00:29:05.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status success for try_number 1 2024-05-11T00:29:05.268658219Z [2024-05-11T00:29:05.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status success for try_number 1 2024-05-11T00:29:05.278197367Z [2024-05-11T00:29:05.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:28:00+00:00, map_index=-1, run_start_date=2024-05-11 00:29:02.937521+00:00, run_end_date=2024-05-11 00:29:04.453759+00:00, run_duration=1.516238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:29:01.152277+00:00, queued_by_job_id=2, pid=7934 2024-05-11T00:29:05.278331387Z [2024-05-11T00:29:05.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:28:00+00:00, map_index=-1, run_start_date=2024-05-11 00:29:02.906391+00:00, run_end_date=2024-05-11 00:29:05.019006+00:00, run_duration=2.112615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:29:01.152277+00:00, queued_by_job_id=2, pid=7933 2024-05-11T00:30:00.918624544Z [2024-05-11T00:30:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:31:00+00:00 2024-05-11T00:30:00.930427357Z [2024-05-11T00:30:00.929+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:30:00.946965990Z [2024-05-11T00:30:00.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:31:00+00:00 2024-05-11T00:30:00.960078255Z [2024-05-11T00:30:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:30:00.968266520Z [2024-05-11T00:30:00.967+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:30:01.107706722Z [2024-05-11T00:30:01.107+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:30:01.107740802Z 2024-05-11T00:30:01.107744506Z 2024-05-11T00:30:01.107748686Z 2024-05-11T00:30:01.107752258Z 2024-05-11T00:30:01.107755518Z 2024-05-11T00:30:01.107765109Z [2024-05-11T00:30:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:30:01.107860785Z [2024-05-11T00:30:01.107+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:30:01.107950192Z [2024-05-11T00:30:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:30:01.108021696Z [2024-05-11T00:30:01.107+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:30:01.108099156Z [2024-05-11T00:30:01.108+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:30:01.108769660Z [2024-05-11T00:30:01.108+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:30:01.108780980Z 2024-05-11T00:30:01.108785817Z 2024-05-11T00:30:01.108818476Z 2024-05-11T00:30:01.108822581Z 2024-05-11T00:30:01.108825935Z 2024-05-11T00:30:01.112880129Z [2024-05-11T00:30:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:30:01.112964286Z [2024-05-11T00:30:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:30:01.113196502Z [2024-05-11T00:30:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:30:01.113237633Z [2024-05-11T00:30:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:30:01.113406372Z [2024-05-11T00:30:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:30:01.113477474Z [2024-05-11T00:30:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:30:01.113661600Z [2024-05-11T00:30:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:30:01.113711287Z [2024-05-11T00:30:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:30:01.113903718Z [2024-05-11T00:30:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:30:01.114020341Z [2024-05-11T00:30:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:30:01.622088961Z [2024-05-11T00:30:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:01.622158008Z [2024-05-11T00:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:01.622163169Z [2024-05-11T00:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:29:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:01.622166449Z [2024-05-11T00:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:29:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:01.622169524Z [2024-05-11T00:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:29:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:01.631131974Z [2024-05-11T00:30:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8293f449-ce3d-4c07-8df7-f597857dd1de 2024-05-11T00:30:01.631168311Z [2024-05-11T00:30:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 284ebb7a-0c56-448f-b7c5-481c82995a82 2024-05-11T00:30:01.631384667Z [2024-05-11T00:30:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to e951f62f-e7bd-4b12-8ab7-e166840d24de 2024-05-11T00:30:01.631668220Z [2024-05-11T00:30:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19c69421-5816-40c0-a132-53b02f0fb211 2024-05-11T00:30:01.631861091Z [2024-05-11T00:30:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to a98f12b8-67f8-4cc0-aefe-0706d461c083 2024-05-11T00:30:02.863990258Z [2024-05-11T00:30:02.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:30:02.864685580Z [2024-05-11T00:30:02.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:28:00+00:00, run_id=scheduled__2024-05-11T00:28:00+00:00, run_start_date=2024-05-11 00:30:00.980891+00:00, run_end_date=2024-05-11 00:30:02.864212+00:00, run_duration=1.883321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:28:00+00:00, data_interval_end=2024-05-11 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:30:02.880065342Z [2024-05-11T00:30:02.879+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:32:00+00:00 2024-05-11T00:30:02.889843141Z [2024-05-11T00:30:02.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:30:02.890158259Z [2024-05-11T00:30:02.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:29:00+00:00, run_id=scheduled__2024-05-11T00:29:00+00:00, run_start_date=2024-05-11 00:30:00.981915+00:00, run_end_date=2024-05-11 00:30:02.889700+00:00, run_duration=1.907785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:29:00+00:00, data_interval_end=2024-05-11 00:30:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:30:02.900764178Z [2024-05-11T00:30:02.900+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:31:00+00:00 2024-05-11T00:30:04.181601395Z [2024-05-11T00:30:04.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:28:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:04.181642872Z [2024-05-11T00:30:04.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:29:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:04.194588948Z [2024-05-11T00:30:04.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:28:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:02.263417+00:00, run_end_date=2024-05-11 00:30:02.734204+00:00, run_duration=0.470787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:01.110049+00:00, queued_by_job_id=2, pid=7968 2024-05-11T00:30:04.194689495Z [2024-05-11T00:30:04.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:29:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:02.375658+00:00, run_end_date=2024-05-11 00:30:02.778077+00:00, run_duration=0.402419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:01.110049+00:00, queued_by_job_id=2, pid=7969 2024-05-11T00:30:05.247640370Z [2024-05-11T00:30:05.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:30:05.248337335Z [2024-05-11T00:30:05.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:29:00+00:00, run_id=scheduled__2024-05-11T00:29:00+00:00, run_start_date=2024-05-11 00:30:00.982828+00:00, run_end_date=2024-05-11 00:30:05.247592+00:00, run_duration=4.264764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:29:00+00:00, data_interval_end=2024-05-11 00:30:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:30:05.258123016Z [2024-05-11T00:30:05.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:31:00+00:00 2024-05-11T00:30:05.294100924Z [2024-05-11T00:30:05.293+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:30:05.294132989Z 2024-05-11T00:30:05.294154154Z [2024-05-11T00:30:05.293+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:30:05.294755046Z [2024-05-11T00:30:05.294+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:30:05.294762956Z 2024-05-11T00:30:05.297825697Z [2024-05-11T00:30:05.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:30:05.297980835Z [2024-05-11T00:30:05.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:30:05.404658765Z [2024-05-11T00:30:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:05.404750176Z [2024-05-11T00:30:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:05.404770641Z [2024-05-11T00:30:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:29:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:05.413305228Z [2024-05-11T00:30:05.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:03.881690+00:00, run_end_date=2024-05-11 00:30:04.342886+00:00, run_duration=0.461196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:01.110049+00:00, queued_by_job_id=2, pid=8000 2024-05-11T00:30:05.414134815Z [2024-05-11T00:30:05.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25dee330-54fd-48a5-8ea9-e79c9a3efa98 2024-05-11T00:30:05.414428344Z [2024-05-11T00:30:05.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:29:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:03.736075+00:00, run_end_date=2024-05-11 00:30:05.087002+00:00, run_duration=1.350927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:01.110049+00:00, queued_by_job_id=2, pid=7999 2024-05-11T00:30:05.501999795Z [2024-05-11T00:30:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:30:05.502208483Z [2024-05-11T00:30:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:29:00+00:00, run_id=scheduled__2024-05-11T00:29:00+00:00, run_start_date=2024-05-11 00:30:00.983906+00:00, run_end_date=2024-05-11 00:30:05.501799+00:00, run_duration=4.517893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:29:00+00:00, data_interval_end=2024-05-11 00:30:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:30:05.513446834Z [2024-05-11T00:30:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:31:00+00:00 2024-05-11T00:30:05.595902082Z [2024-05-11T00:30:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:29:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:05.602140457Z [2024-05-11T00:30:05.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:29:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:03.695596+00:00, run_end_date=2024-05-11 00:30:05.363994+00:00, run_duration=1.668398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:01.110049+00:00, queued_by_job_id=2, pid=7998 2024-05-11T00:30:07.746453177Z [2024-05-11T00:30:07.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:30:07.746490624Z 2024-05-11T00:30:07.746722177Z [2024-05-11T00:30:07.746+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:30:07.747408624Z [2024-05-11T00:30:07.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:30:07.747416913Z 2024-05-11T00:30:07.750432340Z [2024-05-11T00:30:07.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:30:07.750750616Z [2024-05-11T00:30:07.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:30:07.800142833Z [2024-05-11T00:30:07.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:07.800239150Z [2024-05-11T00:30:07.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:07.806842467Z [2024-05-11T00:30:07.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe9cac07-ab02-415e-84ed-4e853e4e7ea7 2024-05-11T00:30:07.807051234Z [2024-05-11T00:30:07.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:06.932186+00:00, run_end_date=2024-05-11 00:30:07.310000+00:00, run_duration=0.377814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:05.295241+00:00, queued_by_job_id=2, pid=8033 2024-05-11T00:30:10.503814092Z [2024-05-11T00:30:10.503+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:30:10.503879779Z 2024-05-11T00:30:10.504105338Z [2024-05-11T00:30:10.503+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:30:10.504775144Z [2024-05-11T00:30:10.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:30:10.504783519Z 2024-05-11T00:30:10.508065264Z [2024-05-11T00:30:10.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:30:10.508310954Z [2024-05-11T00:30:10.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:30:10.567629675Z [2024-05-11T00:30:10.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status queued for try_number 1 2024-05-11T00:30:10.567749892Z [2024-05-11T00:30:10.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:10.578246842Z [2024-05-11T00:30:10.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f61ef71-0033-4211-bf90-14cfb5fcc4c6 2024-05-11T00:30:10.578533740Z [2024-05-11T00:30:10.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=0, run_start_date=2024-05-11 00:30:09.515396+00:00, run_end_date=2024-05-11 00:30:09.870675+00:00, run_duration=0.355279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:07.747815+00:00, queued_by_job_id=2, pid=8044 2024-05-11T00:30:13.132865866Z [2024-05-11T00:30:13.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:30:13.133327359Z [2024-05-11T00:30:13.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:25:00+00:00, run_id=scheduled__2024-05-11T00:25:00+00:00, run_start_date=2024-05-11 00:30:00.979571+00:00, run_end_date=2024-05-11 00:30:13.132752+00:00, run_duration=12.153181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:25:00+00:00, data_interval_end=2024-05-11 00:30:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:30:13.140155068Z [2024-05-11T00:30:13.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:30:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:30:13.171409668Z [2024-05-11T00:30:13.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:25:00+00:00 exited with status success for try_number 1 2024-05-11T00:30:13.183457414Z [2024-05-11T00:30:13.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:25:00+00:00, map_index=-1, run_start_date=2024-05-11 00:30:12.365054+00:00, run_end_date=2024-05-11 00:30:12.763294+00:00, run_duration=0.39824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:30:10.505326+00:00, queued_by_job_id=2, pid=8052 2024-05-11T00:30:34.782468820Z [2024-05-11T00:30:34.781+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:31:00.986985442Z [2024-05-11T00:31:00.986+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:31:00+00:00, run_after=2024-05-11T00:32:00+00:00 2024-05-11T00:31:00.999684955Z [2024-05-11T00:31:00.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:31:00+00:00, run_after=2024-05-11T00:32:00+00:00 2024-05-11T00:31:01.007433307Z [2024-05-11T00:31:01.007+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:31:01.116909333Z [2024-05-11T00:31:01.116+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:31:01.116941457Z 2024-05-11T00:31:01.116945601Z 2024-05-11T00:31:01.116949193Z 2024-05-11T00:31:01.117167621Z [2024-05-11T00:31:01.116+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:31:01.117362313Z [2024-05-11T00:31:01.117+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:31:01.117567546Z [2024-05-11T00:31:01.117+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:31:01.118271271Z [2024-05-11T00:31:01.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:31:01.118284357Z 2024-05-11T00:31:01.118287568Z 2024-05-11T00:31:01.118326692Z 2024-05-11T00:31:01.121714753Z [2024-05-11T00:31:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:31:01.121999006Z [2024-05-11T00:31:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:31:01.122315108Z [2024-05-11T00:31:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:31:01.122507311Z [2024-05-11T00:31:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:31:01.122793610Z [2024-05-11T00:31:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:31:01.123003892Z [2024-05-11T00:31:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:31:01.374009426Z [2024-05-11T00:31:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:31:01.374294884Z [2024-05-11T00:31:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:31:01.374569133Z [2024-05-11T00:31:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:31:01.382084926Z [2024-05-11T00:31:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fb953fd-1dd2-4263-aefc-549d4d3fbc49 2024-05-11T00:31:01.382354254Z [2024-05-11T00:31:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a436fd0-58e2-4ee6-9877-f28abaf5162b 2024-05-11T00:31:01.382642747Z [2024-05-11T00:31:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27465ec0-494f-4759-a1bb-95f9e82c75d5 2024-05-11T00:31:03.533381162Z [2024-05-11T00:31:03.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:31:03.533928486Z [2024-05-11T00:31:03.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:30:00+00:00, run_id=scheduled__2024-05-11T00:30:00+00:00, run_start_date=2024-05-11 00:31:01.022384+00:00, run_end_date=2024-05-11 00:31:03.533353+00:00, run_duration=2.510969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:30:00+00:00, data_interval_end=2024-05-11 00:31:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:31:03.543306720Z [2024-05-11T00:31:03.543+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:31:00+00:00, run_after=2024-05-11T00:32:00+00:00 2024-05-11T00:31:03.604132640Z [2024-05-11T00:31:03.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:31:03.612264941Z [2024-05-11T00:31:03.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:31:01.984570+00:00, run_end_date=2024-05-11 00:31:02.337520+00:00, run_duration=0.35295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:31:01.119071+00:00, queued_by_job_id=2, pid=8061 2024-05-11T00:31:05.081961110Z [2024-05-11T00:31:05.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:31:05.082279953Z [2024-05-11T00:31:05.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:30:00+00:00, run_id=scheduled__2024-05-11T00:30:00+00:00, run_start_date=2024-05-11 00:31:01.023955+00:00, run_end_date=2024-05-11 00:31:05.081718+00:00, run_duration=4.057763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:30:00+00:00, data_interval_end=2024-05-11 00:31:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:31:05.095014024Z [2024-05-11T00:31:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:31:00+00:00, run_after=2024-05-11T00:32:00+00:00 2024-05-11T00:31:05.144966646Z [2024-05-11T00:31:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:31:05.156871912Z [2024-05-11T00:31:05.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:31:02.867365+00:00, run_end_date=2024-05-11 00:31:04.362492+00:00, run_duration=1.495127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:31:01.119071+00:00, queued_by_job_id=2, pid=8079 2024-05-11T00:31:06.211837473Z [2024-05-11T00:31:06.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:31:06.212039491Z [2024-05-11T00:31:06.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:30:00+00:00, run_id=scheduled__2024-05-11T00:30:00+00:00, run_start_date=2024-05-11 00:31:01.024991+00:00, run_end_date=2024-05-11 00:31:06.211712+00:00, run_duration=5.186721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:30:00+00:00, data_interval_end=2024-05-11 00:31:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:31:06.220217169Z [2024-05-11T00:31:06.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:31:00+00:00, run_after=2024-05-11T00:32:00+00:00 2024-05-11T00:31:06.257295914Z [2024-05-11T00:31:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:31:06.264240265Z [2024-05-11T00:31:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:31:02.963988+00:00, run_end_date=2024-05-11 00:31:05.967542+00:00, run_duration=3.003554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:31:01.119071+00:00, queued_by_job_id=2, pid=8080 2024-05-11T00:32:00.912139101Z [2024-05-11T00:32:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:32:00+00:00, run_after=2024-05-11T00:33:00+00:00 2024-05-11T00:32:00.925013976Z [2024-05-11T00:32:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:32:00+00:00, run_after=2024-05-11T00:33:00+00:00 2024-05-11T00:32:00.932983042Z [2024-05-11T00:32:00.932+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:32:00.938936355Z [2024-05-11T00:32:00.938+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:32:01.040884096Z [2024-05-11T00:32:01.037+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:32:01.040911122Z 2024-05-11T00:32:01.040916061Z 2024-05-11T00:32:01.040919724Z 2024-05-11T00:32:01.040923262Z 2024-05-11T00:32:01.040927342Z [2024-05-11T00:32:01.037+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:32:01.040942688Z [2024-05-11T00:32:01.037+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:32:01.040946198Z [2024-05-11T00:32:01.037+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:32:01.040949576Z [2024-05-11T00:32:01.038+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:32:01.040952850Z [2024-05-11T00:32:01.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:32:01.040956325Z 2024-05-11T00:32:01.040959934Z 2024-05-11T00:32:01.040963200Z 2024-05-11T00:32:01.040966543Z 2024-05-11T00:32:01.045369499Z [2024-05-11T00:32:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:32:01.045391473Z [2024-05-11T00:32:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:32:01.045395819Z [2024-05-11T00:32:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:32:01.045399660Z [2024-05-11T00:32:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:32:01.045518956Z [2024-05-11T00:32:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:32:01.045524846Z [2024-05-11T00:32:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:32:01.045528010Z [2024-05-11T00:32:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:32:01.045531183Z [2024-05-11T00:32:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:32:01.435250025Z [2024-05-11T00:32:01.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:32:01.435443661Z [2024-05-11T00:32:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:31:00+00:00 exited with status queued for try_number 1 2024-05-11T00:32:01.435448961Z [2024-05-11T00:32:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:31:00+00:00 exited with status queued for try_number 1 2024-05-11T00:32:01.435452275Z [2024-05-11T00:32:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:31:00+00:00 exited with status queued for try_number 1 2024-05-11T00:32:01.451518184Z [2024-05-11T00:32:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bda2953-64da-4667-8465-c0d41097498a 2024-05-11T00:32:01.451882941Z [2024-05-11T00:32:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8804a150-96f4-417d-b09c-fcf067641d97 2024-05-11T00:32:01.452244806Z [2024-05-11T00:32:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0e644cc-6e32-4936-b385-de7bb93db356 2024-05-11T00:32:01.452600719Z [2024-05-11T00:32:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09557385-099f-4bf3-9c15-f5094d91849d 2024-05-11T00:32:02.641663600Z [2024-05-11T00:32:02.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:32:02.641854157Z [2024-05-11T00:32:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:30:00+00:00, run_id=scheduled__2024-05-11T00:30:00+00:00, run_start_date=2024-05-11 00:32:00.950955+00:00, run_end_date=2024-05-11 00:32:02.641530+00:00, run_duration=1.690575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:30:00+00:00, data_interval_end=2024-05-11 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:32:02.649001722Z [2024-05-11T00:32:02.648+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:32:00+00:00, run_after=2024-05-11T00:34:00+00:00 2024-05-11T00:32:02.663603000Z [2024-05-11T00:32:02.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:32:02.663798046Z [2024-05-11T00:32:02.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:31:00+00:00, run_id=scheduled__2024-05-11T00:31:00+00:00, run_start_date=2024-05-11 00:32:00.952111+00:00, run_end_date=2024-05-11 00:32:02.663507+00:00, run_duration=1.711396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:31:00+00:00, data_interval_end=2024-05-11 00:32:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:32:02.678956365Z [2024-05-11T00:32:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:32:00+00:00, run_after=2024-05-11T00:33:00+00:00 2024-05-11T00:32:02.725493515Z [2024-05-11T00:32:02.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:32:02.725682606Z [2024-05-11T00:32:02.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:31:00+00:00 exited with status success for try_number 1 2024-05-11T00:32:02.733049270Z [2024-05-11T00:32:02.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:31:00+00:00, map_index=-1, run_start_date=2024-05-11 00:32:01.948539+00:00, run_end_date=2024-05-11 00:32:02.432097+00:00, run_duration=0.483558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:32:01.040133+00:00, queued_by_job_id=2, pid=8115 2024-05-11T00:32:02.733329931Z [2024-05-11T00:32:02.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:32:01.939912+00:00, run_end_date=2024-05-11 00:32:02.303460+00:00, run_duration=0.363548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:32:01.040133+00:00, queued_by_job_id=2, pid=8114 2024-05-11T00:32:04.931302878Z [2024-05-11T00:32:04.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:32:04.931862764Z [2024-05-11T00:32:04.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:31:00+00:00, run_id=scheduled__2024-05-11T00:31:00+00:00, run_start_date=2024-05-11 00:32:00.954296+00:00, run_end_date=2024-05-11 00:32:04.931125+00:00, run_duration=3.976829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:31:00+00:00, data_interval_end=2024-05-11 00:32:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:32:04.947287062Z [2024-05-11T00:32:04.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:32:00+00:00, run_after=2024-05-11T00:33:00+00:00 2024-05-11T00:32:04.955117494Z [2024-05-11T00:32:04.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:32:04.955315053Z [2024-05-11T00:32:04.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:31:00+00:00, run_id=scheduled__2024-05-11T00:31:00+00:00, run_start_date=2024-05-11 00:32:00.953242+00:00, run_end_date=2024-05-11 00:32:04.954950+00:00, run_duration=4.001708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:31:00+00:00, data_interval_end=2024-05-11 00:32:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:32:04.964497895Z [2024-05-11T00:32:04.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:32:00+00:00, run_after=2024-05-11T00:33:00+00:00 2024-05-11T00:32:05.009079871Z [2024-05-11T00:32:05.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:31:00+00:00 exited with status success for try_number 1 2024-05-11T00:32:05.009211596Z [2024-05-11T00:32:05.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:31:00+00:00 exited with status success for try_number 1 2024-05-11T00:32:05.016812190Z [2024-05-11T00:32:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:31:00+00:00, map_index=-1, run_start_date=2024-05-11 00:32:03.018683+00:00, run_end_date=2024-05-11 00:32:04.300009+00:00, run_duration=1.281326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:32:01.040133+00:00, queued_by_job_id=2, pid=8139 2024-05-11T00:32:05.016991768Z [2024-05-11T00:32:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:31:00+00:00, map_index=-1, run_start_date=2024-05-11 00:32:02.967189+00:00, run_end_date=2024-05-11 00:32:04.549365+00:00, run_duration=1.582176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:32:01.040133+00:00, queued_by_job_id=2, pid=8138 2024-05-11T00:33:00.864186064Z [2024-05-11T00:33:00.863+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:33:00.896635368Z [2024-05-11T00:33:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:33:00+00:00, run_after=2024-05-11T00:34:00+00:00 2024-05-11T00:33:00.909549276Z [2024-05-11T00:33:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:33:00+00:00, run_after=2024-05-11T00:34:00+00:00 2024-05-11T00:33:00.981358593Z [2024-05-11T00:33:00.980+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:33:00.981411179Z 2024-05-11T00:33:00.981415705Z 2024-05-11T00:33:00.981419712Z 2024-05-11T00:33:00.981709738Z [2024-05-11T00:33:00.981+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:33:00.982103508Z [2024-05-11T00:33:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:33:00.982132906Z [2024-05-11T00:33:00.981+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:33:00.982918151Z [2024-05-11T00:33:00.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:33:00.982931321Z 2024-05-11T00:33:00.982935162Z 2024-05-11T00:33:00.982939579Z 2024-05-11T00:33:00.986742585Z [2024-05-11T00:33:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:33:00.986931299Z [2024-05-11T00:33:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:33:00.987318602Z [2024-05-11T00:33:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:33:00.987575329Z [2024-05-11T00:33:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:33:00.987921905Z [2024-05-11T00:33:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:33:00.988105321Z [2024-05-11T00:33:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:33:01.407090172Z [2024-05-11T00:33:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status queued for try_number 1 2024-05-11T00:33:01.407133517Z [2024-05-11T00:33:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status queued for try_number 1 2024-05-11T00:33:01.407146136Z [2024-05-11T00:33:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status queued for try_number 1 2024-05-11T00:33:01.416265356Z [2024-05-11T00:33:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20cf5b64-e9d3-4388-aeee-e73641a50f11 2024-05-11T00:33:01.416345459Z [2024-05-11T00:33:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca67b0d1-a191-45f2-b271-92f1fd8025d1 2024-05-11T00:33:01.416388077Z [2024-05-11T00:33:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81e4828f-bb5a-45fb-8a8f-82aad0e50d72 2024-05-11T00:33:02.622669214Z [2024-05-11T00:33:02.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:33:02.622970967Z [2024-05-11T00:33:02.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:32:00+00:00, run_id=scheduled__2024-05-11T00:32:00+00:00, run_start_date=2024-05-11 00:33:00.920109+00:00, run_end_date=2024-05-11 00:33:02.622541+00:00, run_duration=1.702432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:32:00+00:00, data_interval_end=2024-05-11 00:33:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:33:02.633229663Z [2024-05-11T00:33:02.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:33:00+00:00, run_after=2024-05-11T00:34:00+00:00 2024-05-11T00:33:02.691129964Z [2024-05-11T00:33:02.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status success for try_number 1 2024-05-11T00:33:02.697487713Z [2024-05-11T00:33:02.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:32:00+00:00, map_index=-1, run_start_date=2024-05-11 00:33:02.058945+00:00, run_end_date=2024-05-11 00:33:02.489461+00:00, run_duration=0.430516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:33:00.983849+00:00, queued_by_job_id=2, pid=8172 2024-05-11T00:33:05.568508360Z [2024-05-11T00:33:05.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:33:05.568769136Z [2024-05-11T00:33:05.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:32:00+00:00, run_id=scheduled__2024-05-11T00:32:00+00:00, run_start_date=2024-05-11 00:33:00.921402+00:00, run_end_date=2024-05-11 00:33:05.568274+00:00, run_duration=4.646872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:32:00+00:00, data_interval_end=2024-05-11 00:33:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:33:05.577835998Z [2024-05-11T00:33:05.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:33:00+00:00, run_after=2024-05-11T00:34:00+00:00 2024-05-11T00:33:05.622371568Z [2024-05-11T00:33:05.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status success for try_number 1 2024-05-11T00:33:05.628329881Z [2024-05-11T00:33:05.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:32:00+00:00, map_index=-1, run_start_date=2024-05-11 00:33:02.985697+00:00, run_end_date=2024-05-11 00:33:04.495200+00:00, run_duration=1.509503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:33:00.983849+00:00, queued_by_job_id=2, pid=8190 2024-05-11T00:33:07.607973847Z [2024-05-11T00:33:07.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:33:07.608204496Z [2024-05-11T00:33:07.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:32:00+00:00, run_id=scheduled__2024-05-11T00:32:00+00:00, run_start_date=2024-05-11 00:33:00.922408+00:00, run_end_date=2024-05-11 00:33:07.607803+00:00, run_duration=6.685395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:32:00+00:00, data_interval_end=2024-05-11 00:33:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:33:07.616765820Z [2024-05-11T00:33:07.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:33:00+00:00, run_after=2024-05-11T00:34:00+00:00 2024-05-11T00:33:07.655238364Z [2024-05-11T00:33:07.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status success for try_number 1 2024-05-11T00:33:07.661354054Z [2024-05-11T00:33:07.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:32:00+00:00, map_index=-1, run_start_date=2024-05-11 00:33:03.147809+00:00, run_end_date=2024-05-11 00:33:06.547664+00:00, run_duration=3.399855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:33:00.983849+00:00, queued_by_job_id=2, pid=8191 2024-05-11T00:34:00.514910763Z [2024-05-11T00:34:00.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:34:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:34:00.523048556Z [2024-05-11T00:34:00.522+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:34:00.535005981Z [2024-05-11T00:34:00.534+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:34:00.553037430Z [2024-05-11T00:34:00.552+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:34:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:34:00.635318394Z [2024-05-11T00:34:00.634+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:34:00.635342535Z 2024-05-11T00:34:00.635361389Z 2024-05-11T00:34:00.635364822Z 2024-05-11T00:34:00.635367760Z 2024-05-11T00:34:00.635516611Z [2024-05-11T00:34:00.635+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:34:00.635661652Z [2024-05-11T00:34:00.635+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:34:00.635828113Z [2024-05-11T00:34:00.635+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:34:00.636000573Z [2024-05-11T00:34:00.635+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:34:00.636676443Z [2024-05-11T00:34:00.636+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:34:00.636689952Z 2024-05-11T00:34:00.636693524Z 2024-05-11T00:34:00.636696782Z 2024-05-11T00:34:00.636699900Z 2024-05-11T00:34:00.640311047Z [2024-05-11T00:34:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:34:00.640535930Z [2024-05-11T00:34:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:34:00.640853840Z [2024-05-11T00:34:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:34:00.641042019Z [2024-05-11T00:34:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:34:00.641376351Z [2024-05-11T00:34:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:34:00.641544540Z [2024-05-11T00:34:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:34:00.641818657Z [2024-05-11T00:34:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:34:00.642001500Z [2024-05-11T00:34:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:34:00.931158312Z [2024-05-11T00:34:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status queued for try_number 1 2024-05-11T00:34:00.931366016Z [2024-05-11T00:34:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:33:00+00:00 exited with status queued for try_number 1 2024-05-11T00:34:00.931546973Z [2024-05-11T00:34:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:33:00+00:00 exited with status queued for try_number 1 2024-05-11T00:34:00.931690896Z [2024-05-11T00:34:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:33:00+00:00 exited with status queued for try_number 1 2024-05-11T00:34:00.942162131Z [2024-05-11T00:34:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70242243-4179-4e32-83cf-3bec87ddc6a7 2024-05-11T00:34:00.942660911Z [2024-05-11T00:34:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fe32e51-c526-4a5b-a86b-03d2475430d1 2024-05-11T00:34:00.943051826Z [2024-05-11T00:34:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42c3e5e4-1336-4097-8d06-309090de0d72 2024-05-11T00:34:00.943272756Z [2024-05-11T00:34:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a745486-65cc-46b1-bca9-564afb01f030 2024-05-11T00:34:03.447154686Z [2024-05-11T00:34:03.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:34:03.447551550Z [2024-05-11T00:34:03.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:32:00+00:00, run_id=scheduled__2024-05-11T00:32:00+00:00, run_start_date=2024-05-11 00:34:00.566414+00:00, run_end_date=2024-05-11 00:34:03.447112+00:00, run_duration=2.880698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:32:00+00:00, data_interval_end=2024-05-11 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:34:03.456014235Z [2024-05-11T00:34:03.455+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:34:00+00:00, run_after=2024-05-11T00:36:00+00:00 2024-05-11T00:34:03.485955505Z [2024-05-11T00:34:03.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:34:03.485981260Z [2024-05-11T00:34:03.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:33:00+00:00, run_id=scheduled__2024-05-11T00:33:00+00:00, run_start_date=2024-05-11 00:34:00.568335+00:00, run_end_date=2024-05-11 00:34:03.474586+00:00, run_duration=2.906251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:33:00+00:00, data_interval_end=2024-05-11 00:34:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:34:03.505159196Z [2024-05-11T00:34:03.502+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:34:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:34:03.545577971Z [2024-05-11T00:34:03.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:32:00+00:00 exited with status success for try_number 1 2024-05-11T00:34:03.545886277Z [2024-05-11T00:34:03.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:33:00+00:00 exited with status success for try_number 1 2024-05-11T00:34:03.553202729Z [2024-05-11T00:34:03.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:32:00+00:00, map_index=-1, run_start_date=2024-05-11 00:34:01.882548+00:00, run_end_date=2024-05-11 00:34:02.397563+00:00, run_duration=0.515015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:34:00.637567+00:00, queued_by_job_id=2, pid=8225 2024-05-11T00:34:03.553491912Z [2024-05-11T00:34:03.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:33:00+00:00, map_index=-1, run_start_date=2024-05-11 00:34:02.244613+00:00, run_end_date=2024-05-11 00:34:02.791683+00:00, run_duration=0.54707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:34:00.637567+00:00, queued_by_job_id=2, pid=8228 2024-05-11T00:34:06.139974459Z [2024-05-11T00:34:06.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:34:06.140444854Z [2024-05-11T00:34:06.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:33:00+00:00, run_id=scheduled__2024-05-11T00:33:00+00:00, run_start_date=2024-05-11 00:34:00.569631+00:00, run_end_date=2024-05-11 00:34:06.139808+00:00, run_duration=5.570177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:33:00+00:00, data_interval_end=2024-05-11 00:34:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:34:06.150456669Z [2024-05-11T00:34:06.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:34:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:34:06.162322128Z [2024-05-11T00:34:06.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:34:06.163007405Z [2024-05-11T00:34:06.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:33:00+00:00, run_id=scheduled__2024-05-11T00:33:00+00:00, run_start_date=2024-05-11 00:34:00.570876+00:00, run_end_date=2024-05-11 00:34:06.162224+00:00, run_duration=5.591348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:33:00+00:00, data_interval_end=2024-05-11 00:34:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:34:06.178870566Z [2024-05-11T00:34:06.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:34:00+00:00, run_after=2024-05-11T00:35:00+00:00 2024-05-11T00:34:06.226699797Z [2024-05-11T00:34:06.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:33:00+00:00 exited with status success for try_number 1 2024-05-11T00:34:06.227260524Z [2024-05-11T00:34:06.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:33:00+00:00 exited with status success for try_number 1 2024-05-11T00:34:06.238122892Z [2024-05-11T00:34:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:33:00+00:00, map_index=-1, run_start_date=2024-05-11 00:34:03.658938+00:00, run_end_date=2024-05-11 00:34:05.381207+00:00, run_duration=1.722269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:34:00.637567+00:00, queued_by_job_id=2, pid=8250 2024-05-11T00:34:06.238470370Z [2024-05-11T00:34:06.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:33:00+00:00, map_index=-1, run_start_date=2024-05-11 00:34:03.496292+00:00, run_end_date=2024-05-11 00:34:05.027190+00:00, run_duration=1.530898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:34:00.637567+00:00, queued_by_job_id=2, pid=8249 2024-05-11T00:35:00.208427223Z [2024-05-11T00:35:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:35:00.220976550Z [2024-05-11T00:35:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:36:00+00:00 2024-05-11T00:35:00.244387281Z [2024-05-11T00:35:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:36:00+00:00 2024-05-11T00:35:00.259115878Z [2024-05-11T00:35:00.258+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:35:00.363549646Z [2024-05-11T00:35:00.363+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:35:00.363576950Z 2024-05-11T00:35:00.363592913Z 2024-05-11T00:35:00.363596162Z 2024-05-11T00:35:00.363599049Z 2024-05-11T00:35:00.364084922Z [2024-05-11T00:35:00.363+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:35:00.364328411Z [2024-05-11T00:35:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:35:00.364575520Z [2024-05-11T00:35:00.364+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:35:00.364797858Z [2024-05-11T00:35:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:35:00.365471141Z [2024-05-11T00:35:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:35:00.365486110Z 2024-05-11T00:35:00.365492450Z 2024-05-11T00:35:00.365497054Z 2024-05-11T00:35:00.365501913Z 2024-05-11T00:35:00.370231495Z [2024-05-11T00:35:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:35:00.370519100Z [2024-05-11T00:35:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:35:00.370894041Z [2024-05-11T00:35:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:35:00.371143347Z [2024-05-11T00:35:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:35:00.371665082Z [2024-05-11T00:35:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:35:00.371927863Z [2024-05-11T00:35:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:35:00.372250629Z [2024-05-11T00:35:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:35:00.372527372Z [2024-05-11T00:35:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:35:00.934991836Z [2024-05-11T00:35:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:00.935076507Z [2024-05-11T00:35:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:00.935198431Z [2024-05-11T00:35:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:00.935318502Z [2024-05-11T00:35:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:00.944939311Z [2024-05-11T00:35:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6fd8028-bde5-43f4-a7c8-c9c9d0c262dd 2024-05-11T00:35:00.945103570Z [2024-05-11T00:35:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ba27f4b-cef7-4f25-9db6-34ee9afc0b60 2024-05-11T00:35:00.945281208Z [2024-05-11T00:35:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72912b0a-577d-4bb3-99a9-40dd29e195ba 2024-05-11T00:35:00.945404189Z [2024-05-11T00:35:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2fcbdd9-27bf-457a-ac0d-0195404406de 2024-05-11T00:35:02.167831630Z [2024-05-11T00:35:02.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:35:02.168218853Z [2024-05-11T00:35:02.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:34:00+00:00, run_id=scheduled__2024-05-11T00:34:00+00:00, run_start_date=2024-05-11 00:35:00.271254+00:00, run_end_date=2024-05-11 00:35:02.167876+00:00, run_duration=1.896622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:34:00+00:00, data_interval_end=2024-05-11 00:35:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:35:02.181220155Z [2024-05-11T00:35:02.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:36:00+00:00 2024-05-11T00:35:02.222434572Z [2024-05-11T00:35:02.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:02.227416625Z [2024-05-11T00:35:02.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:34:00+00:00, map_index=-1, run_start_date=2024-05-11 00:35:01.517350+00:00, run_end_date=2024-05-11 00:35:01.958093+00:00, run_duration=0.440743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:00.367071+00:00, queued_by_job_id=2, pid=8284 2024-05-11T00:35:03.202863177Z [2024-05-11T00:35:03.201+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:35:03.202906687Z 2024-05-11T00:35:03.203253976Z [2024-05-11T00:35:03.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:35:03.204317721Z [2024-05-11T00:35:03.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:35:03.204343540Z 2024-05-11T00:35:03.208313271Z [2024-05-11T00:35:03.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:35:03.208636998Z [2024-05-11T00:35:03.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:35:03.268812918Z [2024-05-11T00:35:03.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:03.268893775Z [2024-05-11T00:35:03.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:03.275495573Z [2024-05-11T00:35:03.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to e262d694-c9da-451f-9976-3eb219d019e1 2024-05-11T00:35:03.275586677Z [2024-05-11T00:35:03.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:35:02.491578+00:00, run_end_date=2024-05-11 00:35:02.980444+00:00, run_duration=0.488866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:00.367071+00:00, queued_by_job_id=2, pid=8308 2024-05-11T00:35:04.421197870Z [2024-05-11T00:35:04.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:35:04.421593869Z [2024-05-11T00:35:04.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:34:00+00:00, run_id=scheduled__2024-05-11T00:34:00+00:00, run_start_date=2024-05-11 00:35:00.272494+00:00, run_end_date=2024-05-11 00:35:04.421044+00:00, run_duration=4.14855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:34:00+00:00, data_interval_end=2024-05-11 00:35:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:35:04.436139863Z [2024-05-11T00:35:04.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:36:00+00:00 2024-05-11T00:35:04.443512292Z [2024-05-11T00:35:04.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:35:04.443772265Z [2024-05-11T00:35:04.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:34:00+00:00, run_id=scheduled__2024-05-11T00:34:00+00:00, run_start_date=2024-05-11 00:35:00.274542+00:00, run_end_date=2024-05-11 00:35:04.443359+00:00, run_duration=4.168817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:34:00+00:00, data_interval_end=2024-05-11 00:35:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:35:04.454824321Z [2024-05-11T00:35:04.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:36:00+00:00 2024-05-11T00:35:04.517412044Z [2024-05-11T00:35:04.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:04.518058201Z [2024-05-11T00:35:04.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:04.530411526Z [2024-05-11T00:35:04.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:34:00+00:00, map_index=-1, run_start_date=2024-05-11 00:35:02.484608+00:00, run_end_date=2024-05-11 00:35:03.722227+00:00, run_duration=1.237619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:00.367071+00:00, queued_by_job_id=2, pid=8307 2024-05-11T00:35:04.531206324Z [2024-05-11T00:35:04.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:34:00+00:00, map_index=-1, run_start_date=2024-05-11 00:35:02.625418+00:00, run_end_date=2024-05-11 00:35:04.214693+00:00, run_duration=1.589275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:00.367071+00:00, queued_by_job_id=2, pid=8309 2024-05-11T00:35:05.612347780Z [2024-05-11T00:35:05.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:35:05.612377836Z 2024-05-11T00:35:05.612439289Z [2024-05-11T00:35:05.612+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:35:05.613124278Z [2024-05-11T00:35:05.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:35:05.613136792Z 2024-05-11T00:35:05.615473314Z [2024-05-11T00:35:05.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:35:05.615657265Z [2024-05-11T00:35:05.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:35:05.679028740Z [2024-05-11T00:35:05.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:05.679358158Z [2024-05-11T00:35:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:05.685193163Z [2024-05-11T00:35:05.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 446267c3-898a-4631-8803-091a3796a2e6 2024-05-11T00:35:05.685547645Z [2024-05-11T00:35:05.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:35:04.886448+00:00, run_end_date=2024-05-11 00:35:05.326781+00:00, run_duration=0.440333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:03.205096+00:00, queued_by_job_id=2, pid=8332 2024-05-11T00:35:08.376411104Z [2024-05-11T00:35:08.375+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:35:08.376443864Z 2024-05-11T00:35:08.376448332Z [2024-05-11T00:35:08.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:35:08.377211536Z [2024-05-11T00:35:08.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:35:08.377241016Z 2024-05-11T00:35:08.379446022Z [2024-05-11T00:35:08.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:35:08.379593220Z [2024-05-11T00:35:08.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:35:08.433932020Z [2024-05-11T00:35:08.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status queued for try_number 1 2024-05-11T00:35:08.434126828Z [2024-05-11T00:35:08.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:08.438697615Z [2024-05-11T00:35:08.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5719719c-db77-4528-a1c7-4a070879852c 2024-05-11T00:35:08.438948968Z [2024-05-11T00:35:08.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=0, run_start_date=2024-05-11 00:35:07.740465+00:00, run_end_date=2024-05-11 00:35:08.116086+00:00, run_duration=0.375621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:05.613520+00:00, queued_by_job_id=2, pid=8352 2024-05-11T00:35:10.650246425Z [2024-05-11T00:35:10.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:35:10.650738687Z [2024-05-11T00:35:10.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:30:00+00:00, run_id=scheduled__2024-05-11T00:30:00+00:00, run_start_date=2024-05-11 00:35:00.269932+00:00, run_end_date=2024-05-11 00:35:10.650175+00:00, run_duration=10.380243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:30:00+00:00, data_interval_end=2024-05-11 00:35:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:35:10.663333960Z [2024-05-11T00:35:10.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:35:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:35:10.718605288Z [2024-05-11T00:35:10.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:30:00+00:00 exited with status success for try_number 1 2024-05-11T00:35:10.728755000Z [2024-05-11T00:35:10.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:30:00+00:00, map_index=-1, run_start_date=2024-05-11 00:35:09.941012+00:00, run_end_date=2024-05-11 00:35:10.251848+00:00, run_duration=0.310836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:35:08.377583+00:00, queued_by_job_id=2, pid=8360 2024-05-11T00:35:34.849807697Z [2024-05-11T00:35:34.849+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:36:00.257882458Z [2024-05-11T00:36:00.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:36:00.280113312Z [2024-05-11T00:36:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:36:00+00:00, run_after=2024-05-11T00:37:00+00:00 2024-05-11T00:36:00.287938439Z [2024-05-11T00:36:00.287+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:36:00.303285485Z [2024-05-11T00:36:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:36:00+00:00, run_after=2024-05-11T00:37:00+00:00 2024-05-11T00:36:00.414671187Z [2024-05-11T00:36:00.413+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:36:00.414696194Z 2024-05-11T00:36:00.414703047Z 2024-05-11T00:36:00.414706429Z 2024-05-11T00:36:00.414709623Z 2024-05-11T00:36:00.415180348Z [2024-05-11T00:36:00.414+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:36:00.415576469Z [2024-05-11T00:36:00.415+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:36:00.415937203Z [2024-05-11T00:36:00.415+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:36:00.416296132Z [2024-05-11T00:36:00.416+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:36:00.417573408Z [2024-05-11T00:36:00.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:36:00.417579080Z 2024-05-11T00:36:00.417582774Z 2024-05-11T00:36:00.417586224Z 2024-05-11T00:36:00.417589448Z 2024-05-11T00:36:00.422833233Z [2024-05-11T00:36:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:36:00.423148481Z [2024-05-11T00:36:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:36:00.423524924Z [2024-05-11T00:36:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:36:00.423788085Z [2024-05-11T00:36:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:36:00.424138345Z [2024-05-11T00:36:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:36:00.424371965Z [2024-05-11T00:36:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:36:00.424744256Z [2024-05-11T00:36:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:36:00.424975397Z [2024-05-11T00:36:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:36:00.751103729Z [2024-05-11T00:36:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status queued for try_number 1 2024-05-11T00:36:00.751134569Z [2024-05-11T00:36:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:36:00.751173561Z [2024-05-11T00:36:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:36:00.751267649Z [2024-05-11T00:36:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:36:00.760548930Z [2024-05-11T00:36:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87c237e9-7450-4ba4-b418-89700cf19ec2 2024-05-11T00:36:00.760634770Z [2024-05-11T00:36:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b94d21c-4d3d-4997-a0b9-e22eea782ff1 2024-05-11T00:36:00.760801421Z [2024-05-11T00:36:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0323110-76a0-413e-abdd-7b98b86b1b23 2024-05-11T00:36:00.760971319Z [2024-05-11T00:36:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5324887-399b-48bd-98e5-7d62d9f63d09 2024-05-11T00:36:01.935333571Z [2024-05-11T00:36:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:36:01.935573231Z [2024-05-11T00:36:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:34:00+00:00, run_id=scheduled__2024-05-11T00:34:00+00:00, run_start_date=2024-05-11 00:36:00.316948+00:00, run_end_date=2024-05-11 00:36:01.935189+00:00, run_duration=1.618241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:34:00+00:00, data_interval_end=2024-05-11 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:36:01.942903432Z [2024-05-11T00:36:01.942+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:36:00+00:00, run_after=2024-05-11T00:38:00+00:00 2024-05-11T00:36:01.995861960Z [2024-05-11T00:36:01.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:34:00+00:00 exited with status success for try_number 1 2024-05-11T00:36:02.003829111Z [2024-05-11T00:36:02.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:34:00+00:00, map_index=-1, run_start_date=2024-05-11 00:36:01.310923+00:00, run_end_date=2024-05-11 00:36:01.743562+00:00, run_duration=0.432639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:36:00.419334+00:00, queued_by_job_id=2, pid=8368 2024-05-11T00:36:03.055778946Z [2024-05-11T00:36:03.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:36:03.056220089Z [2024-05-11T00:36:03.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:35:00+00:00, run_id=scheduled__2024-05-11T00:35:00+00:00, run_start_date=2024-05-11 00:36:00.318148+00:00, run_end_date=2024-05-11 00:36:03.055704+00:00, run_duration=2.737556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:35:00+00:00, data_interval_end=2024-05-11 00:36:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:36:03.065701261Z [2024-05-11T00:36:03.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:36:00+00:00, run_after=2024-05-11T00:37:00+00:00 2024-05-11T00:36:03.131013005Z [2024-05-11T00:36:03.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:36:03.135520848Z [2024-05-11T00:36:03.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=-1, run_start_date=2024-05-11 00:36:01.570732+00:00, run_end_date=2024-05-11 00:36:01.970951+00:00, run_duration=0.400219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:36:00.419334+00:00, queued_by_job_id=2, pid=8371 2024-05-11T00:36:04.196499209Z [2024-05-11T00:36:04.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:36:04.197341484Z [2024-05-11T00:36:04.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:35:00+00:00, run_id=scheduled__2024-05-11T00:35:00+00:00, run_start_date=2024-05-11 00:36:00.319279+00:00, run_end_date=2024-05-11 00:36:04.196255+00:00, run_duration=3.876976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:35:00+00:00, data_interval_end=2024-05-11 00:36:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:36:04.210713964Z [2024-05-11T00:36:04.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:36:00+00:00, run_after=2024-05-11T00:37:00+00:00 2024-05-11T00:36:04.267064657Z [2024-05-11T00:36:04.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:36:04.278762204Z [2024-05-11T00:36:04.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=-1, run_start_date=2024-05-11 00:36:02.465310+00:00, run_end_date=2024-05-11 00:36:03.621809+00:00, run_duration=1.156499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:36:00.419334+00:00, queued_by_job_id=2, pid=8394 2024-05-11T00:36:04.916618700Z [2024-05-11T00:36:04.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:36:04.917032311Z [2024-05-11T00:36:04.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:35:00+00:00, run_id=scheduled__2024-05-11T00:35:00+00:00, run_start_date=2024-05-11 00:36:00.320305+00:00, run_end_date=2024-05-11 00:36:04.916509+00:00, run_duration=4.596204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:35:00+00:00, data_interval_end=2024-05-11 00:36:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:36:04.940417551Z [2024-05-11T00:36:04.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:36:00+00:00, run_after=2024-05-11T00:37:00+00:00 2024-05-11T00:36:04.997388023Z [2024-05-11T00:36:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:36:05.007507695Z [2024-05-11T00:36:05.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=-1, run_start_date=2024-05-11 00:36:02.549283+00:00, run_end_date=2024-05-11 00:36:04.290961+00:00, run_duration=1.741678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:36:00.419334+00:00, queued_by_job_id=2, pid=8395 2024-05-11T00:37:00.178684697Z [2024-05-11T00:37:00.178+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:37:00.196725308Z [2024-05-11T00:37:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:37:00+00:00, run_after=2024-05-11T00:38:00+00:00 2024-05-11T00:37:00.214300284Z [2024-05-11T00:37:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:37:00+00:00, run_after=2024-05-11T00:38:00+00:00 2024-05-11T00:37:00.301547559Z [2024-05-11T00:37:00.301+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:37:00.301587561Z 2024-05-11T00:37:00.301596917Z 2024-05-11T00:37:00.301606612Z 2024-05-11T00:37:00.301615292Z [2024-05-11T00:37:00.301+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:37:00.301718279Z [2024-05-11T00:37:00.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:37:00.301729719Z [2024-05-11T00:37:00.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:37:00.302385097Z [2024-05-11T00:37:00.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:37:00.302406980Z 2024-05-11T00:37:00.302416336Z 2024-05-11T00:37:00.302424827Z 2024-05-11T00:37:00.325980728Z [2024-05-11T00:37:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:37:00.326003874Z [2024-05-11T00:37:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:37:00.326008353Z [2024-05-11T00:37:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:37:00.326024447Z [2024-05-11T00:37:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:37:00.326028287Z [2024-05-11T00:37:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:37:00.326032334Z [2024-05-11T00:37:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:37:00.539570157Z [2024-05-11T00:37:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status queued for try_number 1 2024-05-11T00:37:00.539782211Z [2024-05-11T00:37:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status queued for try_number 1 2024-05-11T00:37:00.539949565Z [2024-05-11T00:37:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status queued for try_number 1 2024-05-11T00:37:00.556682321Z [2024-05-11T00:37:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to bebf221a-8a6d-4650-9ec6-ab9efc3a092d 2024-05-11T00:37:00.556911257Z [2024-05-11T00:37:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 190c81bc-15c8-403e-a546-f29a53a3cbac 2024-05-11T00:37:00.557112552Z [2024-05-11T00:37:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d0327d2-e315-47e7-9b35-f9ce4f6808fc 2024-05-11T00:37:01.726949324Z [2024-05-11T00:37:01.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:37:01.727349726Z [2024-05-11T00:37:01.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:36:00+00:00, run_id=scheduled__2024-05-11T00:36:00+00:00, run_start_date=2024-05-11 00:37:00.226168+00:00, run_end_date=2024-05-11 00:37:01.726896+00:00, run_duration=1.500728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:36:00+00:00, data_interval_end=2024-05-11 00:37:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:37:01.738602363Z [2024-05-11T00:37:01.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:37:00+00:00, run_after=2024-05-11T00:38:00+00:00 2024-05-11T00:37:01.780472320Z [2024-05-11T00:37:01.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status success for try_number 1 2024-05-11T00:37:01.787588403Z [2024-05-11T00:37:01.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:36:00+00:00, map_index=-1, run_start_date=2024-05-11 00:37:01.063621+00:00, run_end_date=2024-05-11 00:37:01.516798+00:00, run_duration=0.453177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:37:00.302964+00:00, queued_by_job_id=2, pid=8428 2024-05-11T00:37:03.984733356Z [2024-05-11T00:37:03.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:37:03.984973182Z [2024-05-11T00:37:03.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:36:00+00:00, run_id=scheduled__2024-05-11T00:36:00+00:00, run_start_date=2024-05-11 00:37:00.227304+00:00, run_end_date=2024-05-11 00:37:03.984397+00:00, run_duration=3.757093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:36:00+00:00, data_interval_end=2024-05-11 00:37:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:37:03.997500248Z [2024-05-11T00:37:03.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:37:00+00:00, run_after=2024-05-11T00:38:00+00:00 2024-05-11T00:37:04.068175477Z [2024-05-11T00:37:04.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status success for try_number 1 2024-05-11T00:37:04.073681756Z [2024-05-11T00:37:04.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:36:00+00:00, map_index=-1, run_start_date=2024-05-11 00:37:02.146996+00:00, run_end_date=2024-05-11 00:37:03.488644+00:00, run_duration=1.341648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:37:00.302964+00:00, queued_by_job_id=2, pid=8446 2024-05-11T00:37:05.129595107Z [2024-05-11T00:37:05.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:37:05.130232538Z [2024-05-11T00:37:05.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:36:00+00:00, run_id=scheduled__2024-05-11T00:36:00+00:00, run_start_date=2024-05-11 00:37:00.228266+00:00, run_end_date=2024-05-11 00:37:05.129557+00:00, run_duration=4.901291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:36:00+00:00, data_interval_end=2024-05-11 00:37:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:37:05.142175976Z [2024-05-11T00:37:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:37:00+00:00, run_after=2024-05-11T00:38:00+00:00 2024-05-11T00:37:05.196987523Z [2024-05-11T00:37:05.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status success for try_number 1 2024-05-11T00:37:05.201408121Z [2024-05-11T00:37:05.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:36:00+00:00, map_index=-1, run_start_date=2024-05-11 00:37:02.174313+00:00, run_end_date=2024-05-11 00:37:04.113300+00:00, run_duration=1.938987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:37:00.302964+00:00, queued_by_job_id=2, pid=8447 2024-05-11T00:38:00.648865036Z [2024-05-11T00:38:00.648+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:38:00.674968494Z [2024-05-11T00:38:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:38:00+00:00, run_after=2024-05-11T00:39:00+00:00 2024-05-11T00:38:00.686688683Z [2024-05-11T00:38:00.686+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:38:00.702835811Z [2024-05-11T00:38:00.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:38:00+00:00, run_after=2024-05-11T00:39:00+00:00 2024-05-11T00:38:00.780978430Z [2024-05-11T00:38:00.780+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:38:00.781004402Z 2024-05-11T00:38:00.781009054Z 2024-05-11T00:38:00.781012356Z 2024-05-11T00:38:00.781015895Z 2024-05-11T00:38:00.781188585Z [2024-05-11T00:38:00.780+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:38:00.781363972Z [2024-05-11T00:38:00.781+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:38:00.781535915Z [2024-05-11T00:38:00.781+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:38:00.781698932Z [2024-05-11T00:38:00.781+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:38:00.782405715Z [2024-05-11T00:38:00.782+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:38:00.782418919Z 2024-05-11T00:38:00.782422941Z 2024-05-11T00:38:00.782426378Z 2024-05-11T00:38:00.782446829Z 2024-05-11T00:38:00.786522100Z [2024-05-11T00:38:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:38:00.786716479Z [2024-05-11T00:38:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:38:00.787041088Z [2024-05-11T00:38:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:38:00.787200968Z [2024-05-11T00:38:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:38:00.787476407Z [2024-05-11T00:38:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:38:00.787643943Z [2024-05-11T00:38:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:38:00.787922754Z [2024-05-11T00:38:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:38:00.788092177Z [2024-05-11T00:38:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:38:01.268951516Z [2024-05-11T00:38:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status queued for try_number 1 2024-05-11T00:38:01.269152125Z [2024-05-11T00:38:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:37:00+00:00 exited with status queued for try_number 1 2024-05-11T00:38:01.269313930Z [2024-05-11T00:38:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:37:00+00:00 exited with status queued for try_number 1 2024-05-11T00:38:01.269463070Z [2024-05-11T00:38:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:37:00+00:00 exited with status queued for try_number 1 2024-05-11T00:38:01.278122465Z [2024-05-11T00:38:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ec8affb-2abd-4e22-be6c-8382cbf1f180 2024-05-11T00:38:01.278354092Z [2024-05-11T00:38:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 365268fe-5cbd-4460-bc22-11d8fe936996 2024-05-11T00:38:01.278553317Z [2024-05-11T00:38:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6288fc8a-aeca-4427-96b0-0a842d9d7315 2024-05-11T00:38:01.278746853Z [2024-05-11T00:38:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to e218bcd9-9614-4867-a3f6-d480342efd28 2024-05-11T00:38:02.558864428Z [2024-05-11T00:38:02.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:38:02.559247008Z [2024-05-11T00:38:02.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:36:00+00:00, run_id=scheduled__2024-05-11T00:36:00+00:00, run_start_date=2024-05-11 00:38:00.715367+00:00, run_end_date=2024-05-11 00:38:02.558775+00:00, run_duration=1.843408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:36:00+00:00, data_interval_end=2024-05-11 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:38:02.566866225Z [2024-05-11T00:38:02.566+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:38:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:38:02.578958039Z [2024-05-11T00:38:02.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:38:02.579324835Z [2024-05-11T00:38:02.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:37:00+00:00, run_id=scheduled__2024-05-11T00:37:00+00:00, run_start_date=2024-05-11 00:38:00.716918+00:00, run_end_date=2024-05-11 00:38:02.579040+00:00, run_duration=1.862122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:37:00+00:00, data_interval_end=2024-05-11 00:38:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:38:02.589677375Z [2024-05-11T00:38:02.589+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:38:00+00:00, run_after=2024-05-11T00:39:00+00:00 2024-05-11T00:38:02.628841106Z [2024-05-11T00:38:02.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:36:00+00:00 exited with status success for try_number 1 2024-05-11T00:38:02.628983162Z [2024-05-11T00:38:02.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:37:00+00:00 exited with status success for try_number 1 2024-05-11T00:38:02.636867347Z [2024-05-11T00:38:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:37:00+00:00, map_index=-1, run_start_date=2024-05-11 00:38:01.645081+00:00, run_end_date=2024-05-11 00:38:02.044123+00:00, run_duration=0.399042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:38:00.783283+00:00, queued_by_job_id=2, pid=8480 2024-05-11T00:38:02.637069844Z [2024-05-11T00:38:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:36:00+00:00, map_index=-1, run_start_date=2024-05-11 00:38:01.829347+00:00, run_end_date=2024-05-11 00:38:02.205032+00:00, run_duration=0.375685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:38:00.783283+00:00, queued_by_job_id=2, pid=8481 2024-05-11T00:38:04.820406377Z [2024-05-11T00:38:04.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:38:04.820859667Z [2024-05-11T00:38:04.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:37:00+00:00, run_id=scheduled__2024-05-11T00:37:00+00:00, run_start_date=2024-05-11 00:38:00.718297+00:00, run_end_date=2024-05-11 00:38:04.820308+00:00, run_duration=4.102011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:37:00+00:00, data_interval_end=2024-05-11 00:38:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:38:04.829383360Z [2024-05-11T00:38:04.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:38:00+00:00, run_after=2024-05-11T00:39:00+00:00 2024-05-11T00:38:04.837656567Z [2024-05-11T00:38:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:38:04.838038402Z [2024-05-11T00:38:04.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:37:00+00:00, run_id=scheduled__2024-05-11T00:37:00+00:00, run_start_date=2024-05-11 00:38:00.719597+00:00, run_end_date=2024-05-11 00:38:04.837537+00:00, run_duration=4.11794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:37:00+00:00, data_interval_end=2024-05-11 00:38:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:38:04.850468695Z [2024-05-11T00:38:04.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:38:00+00:00, run_after=2024-05-11T00:39:00+00:00 2024-05-11T00:38:04.904803107Z [2024-05-11T00:38:04.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:37:00+00:00 exited with status success for try_number 1 2024-05-11T00:38:04.913301789Z [2024-05-11T00:38:04.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:37:00+00:00, map_index=-1, run_start_date=2024-05-11 00:38:02.909079+00:00, run_end_date=2024-05-11 00:38:04.445139+00:00, run_duration=1.53606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:38:00.783283+00:00, queued_by_job_id=2, pid=8505 2024-05-11T00:38:05.939317765Z [2024-05-11T00:38:05.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:37:00+00:00 exited with status success for try_number 1 2024-05-11T00:38:05.945076899Z [2024-05-11T00:38:05.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:37:00+00:00, map_index=-1, run_start_date=2024-05-11 00:38:02.771010+00:00, run_end_date=2024-05-11 00:38:04.742856+00:00, run_duration=1.971846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:38:00.783283+00:00, queued_by_job_id=2, pid=8504 2024-05-11T00:39:00.582921525Z [2024-05-11T00:39:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:39:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:39:00.608207628Z [2024-05-11T00:39:00.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:39:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:39:00.627456710Z [2024-05-11T00:39:00.626+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:39:00.726658122Z [2024-05-11T00:39:00.726+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:39:00.726704932Z 2024-05-11T00:39:00.726714980Z 2024-05-11T00:39:00.726723939Z 2024-05-11T00:39:00.726871991Z [2024-05-11T00:39:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:39:00.727045315Z [2024-05-11T00:39:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:39:00.727250473Z [2024-05-11T00:39:00.727+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:39:00.728245916Z [2024-05-11T00:39:00.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:39:00.728265058Z 2024-05-11T00:39:00.728273910Z 2024-05-11T00:39:00.728283048Z 2024-05-11T00:39:00.732631287Z [2024-05-11T00:39:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:39:00.732921349Z [2024-05-11T00:39:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:39:00.733311838Z [2024-05-11T00:39:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:39:00.733565942Z [2024-05-11T00:39:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:39:00.733974741Z [2024-05-11T00:39:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:39:00.734226443Z [2024-05-11T00:39:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:39:00.969732671Z [2024-05-11T00:39:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status queued for try_number 1 2024-05-11T00:39:00.969836122Z [2024-05-11T00:39:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status queued for try_number 1 2024-05-11T00:39:00.970040660Z [2024-05-11T00:39:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status queued for try_number 1 2024-05-11T00:39:00.978224480Z [2024-05-11T00:39:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9656852d-d931-4a9a-82a2-2021c96a4cf0 2024-05-11T00:39:00.978388992Z [2024-05-11T00:39:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2ebc85e-180f-4a83-b703-c76f9ff9a490 2024-05-11T00:39:00.978535239Z [2024-05-11T00:39:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a858a48-40c0-4b38-aaae-23205b54356f 2024-05-11T00:39:02.477521861Z [2024-05-11T00:39:02.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:39:02.478062880Z [2024-05-11T00:39:02.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:38:00+00:00, run_id=scheduled__2024-05-11T00:38:00+00:00, run_start_date=2024-05-11 00:39:00.650677+00:00, run_end_date=2024-05-11 00:39:02.477657+00:00, run_duration=1.82698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:38:00+00:00, data_interval_end=2024-05-11 00:39:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:39:02.488628169Z [2024-05-11T00:39:02.488+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:39:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:39:02.538961010Z [2024-05-11T00:39:02.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status success for try_number 1 2024-05-11T00:39:02.551516623Z [2024-05-11T00:39:02.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:38:00+00:00, map_index=-1, run_start_date=2024-05-11 00:39:01.630581+00:00, run_end_date=2024-05-11 00:39:02.057905+00:00, run_duration=0.427324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:39:00.729418+00:00, queued_by_job_id=2, pid=8537 2024-05-11T00:39:04.736520481Z [2024-05-11T00:39:04.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:39:04.737091565Z [2024-05-11T00:39:04.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:38:00+00:00, run_id=scheduled__2024-05-11T00:38:00+00:00, run_start_date=2024-05-11 00:39:00.655141+00:00, run_end_date=2024-05-11 00:39:04.736353+00:00, run_duration=4.081212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:38:00+00:00, data_interval_end=2024-05-11 00:39:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:39:04.756747054Z [2024-05-11T00:39:04.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:39:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:39:04.764597974Z [2024-05-11T00:39:04.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:39:04.764823694Z [2024-05-11T00:39:04.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:38:00+00:00, run_id=scheduled__2024-05-11T00:38:00+00:00, run_start_date=2024-05-11 00:39:00.656794+00:00, run_end_date=2024-05-11 00:39:04.764442+00:00, run_duration=4.107648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:38:00+00:00, data_interval_end=2024-05-11 00:39:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:39:04.774639162Z [2024-05-11T00:39:04.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:39:00+00:00, run_after=2024-05-11T00:40:00+00:00 2024-05-11T00:39:04.820170562Z [2024-05-11T00:39:04.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status success for try_number 1 2024-05-11T00:39:04.820387374Z [2024-05-11T00:39:04.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status success for try_number 1 2024-05-11T00:39:04.831087860Z [2024-05-11T00:39:04.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:38:00+00:00, map_index=-1, run_start_date=2024-05-11 00:39:02.805226+00:00, run_end_date=2024-05-11 00:39:04.241748+00:00, run_duration=1.436522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:39:00.729418+00:00, queued_by_job_id=2, pid=8556 2024-05-11T00:39:04.831483276Z [2024-05-11T00:39:04.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:38:00+00:00, map_index=-1, run_start_date=2024-05-11 00:39:02.652225+00:00, run_end_date=2024-05-11 00:39:04.504133+00:00, run_duration=1.851908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:39:00.729418+00:00, queued_by_job_id=2, pid=8555 2024-05-11T00:40:00.576725650Z [2024-05-11T00:40:00.575+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:40:00.588961682Z [2024-05-11T00:40:00.588+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:40:00.619597494Z [2024-05-11T00:40:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:41:00+00:00 2024-05-11T00:40:00.642607044Z [2024-05-11T00:40:00.642+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:41:00+00:00 2024-05-11T00:40:00.658563968Z [2024-05-11T00:40:00.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:40:00.782413281Z [2024-05-11T00:40:00.781+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:40:00.782441784Z 2024-05-11T00:40:00.782448105Z 2024-05-11T00:40:00.782455278Z 2024-05-11T00:40:00.782463457Z 2024-05-11T00:40:00.782470157Z 2024-05-11T00:40:00.782563926Z [2024-05-11T00:40:00.782+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:40:00.782678864Z [2024-05-11T00:40:00.782+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:40:00.782700559Z [2024-05-11T00:40:00.782+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:40:00.782805971Z [2024-05-11T00:40:00.782+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:40:00.782904965Z [2024-05-11T00:40:00.782+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:40:00.783860795Z [2024-05-11T00:40:00.783+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:40:00.783878229Z 2024-05-11T00:40:00.783883044Z 2024-05-11T00:40:00.783887292Z 2024-05-11T00:40:00.783891284Z 2024-05-11T00:40:00.783895572Z 2024-05-11T00:40:00.790519871Z [2024-05-11T00:40:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:40:00.790931902Z [2024-05-11T00:40:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:40:00.791517551Z [2024-05-11T00:40:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:40:00.791912931Z [2024-05-11T00:40:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:40:00.792493530Z [2024-05-11T00:40:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:40:00.792713890Z [2024-05-11T00:40:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:40:00.793110042Z [2024-05-11T00:40:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:40:00.793410707Z [2024-05-11T00:40:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:40:00.794545113Z [2024-05-11T00:40:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:40:00.794568020Z [2024-05-11T00:40:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:40:01.505993658Z [2024-05-11T00:40:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:01.506379340Z [2024-05-11T00:40:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:01.506723307Z [2024-05-11T00:40:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:39:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:01.506879922Z [2024-05-11T00:40:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:39:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:01.507022695Z [2024-05-11T00:40:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:39:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:01.532698678Z [2024-05-11T00:40:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73881bcf-27bf-4295-a4e4-351af3357438 2024-05-11T00:40:01.541059558Z [2024-05-11T00:40:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7eb0be5-52fd-42ba-86cb-ed66b5cc82ad 2024-05-11T00:40:01.541322782Z [2024-05-11T00:40:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42e5a931-c77d-4d47-bc77-9a436c719c1b 2024-05-11T00:40:01.541621018Z [2024-05-11T00:40:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e1bc64b-4cf9-4871-b92d-f8476e647523 2024-05-11T00:40:01.541795900Z [2024-05-11T00:40:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37fb86b4-4cce-4718-84fd-b64359839bc6 2024-05-11T00:40:02.824168468Z [2024-05-11T00:40:02.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:40:02.824863426Z [2024-05-11T00:40:02.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:39:00+00:00, run_id=scheduled__2024-05-11T00:39:00+00:00, run_start_date=2024-05-11 00:40:00.675359+00:00, run_end_date=2024-05-11 00:40:02.824084+00:00, run_duration=2.148725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:39:00+00:00, data_interval_end=2024-05-11 00:40:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:40:02.838235645Z [2024-05-11T00:40:02.837+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:41:00+00:00 2024-05-11T00:40:02.860435093Z [2024-05-11T00:40:02.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:40:02.860794109Z [2024-05-11T00:40:02.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:38:00+00:00, run_id=scheduled__2024-05-11T00:38:00+00:00, run_start_date=2024-05-11 00:40:00.674024+00:00, run_end_date=2024-05-11 00:40:02.860367+00:00, run_duration=2.186343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:38:00+00:00, data_interval_end=2024-05-11 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:40:02.870963821Z [2024-05-11T00:40:02.870+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:42:00+00:00 2024-05-11T00:40:02.919826889Z [2024-05-11T00:40:02.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:38:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:02.919850426Z [2024-05-11T00:40:02.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:39:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:02.926856940Z [2024-05-11T00:40:02.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:38:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:02.179285+00:00, run_end_date=2024-05-11 00:40:02.582947+00:00, run_duration=0.403662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:00.785480+00:00, queued_by_job_id=2, pid=8596 2024-05-11T00:40:02.926990427Z [2024-05-11T00:40:02.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:39:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:01.839868+00:00, run_end_date=2024-05-11 00:40:02.237903+00:00, run_duration=0.398035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:00.785480+00:00, queued_by_job_id=2, pid=8590 2024-05-11T00:40:03.579805865Z [2024-05-11T00:40:03.579+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:40:03.579829282Z 2024-05-11T00:40:03.580070460Z [2024-05-11T00:40:03.579+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:40:03.580715331Z [2024-05-11T00:40:03.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:40:03.580724572Z 2024-05-11T00:40:03.583808720Z [2024-05-11T00:40:03.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:40:03.583838779Z [2024-05-11T00:40:03.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:40:03.642308264Z [2024-05-11T00:40:03.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:03.642556617Z [2024-05-11T00:40:03.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:03.647769419Z [2024-05-11T00:40:03.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b08dbd1-08e4-4151-bb3c-948cb8fc121d 2024-05-11T00:40:03.648009311Z [2024-05-11T00:40:03.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:03.015746+00:00, run_end_date=2024-05-11 00:40:03.374522+00:00, run_duration=0.358776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:00.785480+00:00, queued_by_job_id=2, pid=8615 2024-05-11T00:40:05.922486471Z [2024-05-11T00:40:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:40:05.922801213Z [2024-05-11T00:40:05.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:39:00+00:00, run_id=scheduled__2024-05-11T00:39:00+00:00, run_start_date=2024-05-11 00:40:00.678126+00:00, run_end_date=2024-05-11 00:40:05.922281+00:00, run_duration=5.244155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:39:00+00:00, data_interval_end=2024-05-11 00:40:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:40:05.931041911Z [2024-05-11T00:40:05.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:41:00+00:00 2024-05-11T00:40:05.937342970Z [2024-05-11T00:40:05.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:40:05.937722850Z [2024-05-11T00:40:05.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:39:00+00:00, run_id=scheduled__2024-05-11T00:39:00+00:00, run_start_date=2024-05-11 00:40:00.676765+00:00, run_end_date=2024-05-11 00:40:05.937182+00:00, run_duration=5.260417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:39:00+00:00, data_interval_end=2024-05-11 00:40:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:40:05.946766906Z [2024-05-11T00:40:05.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:41:00+00:00 2024-05-11T00:40:05.994932929Z [2024-05-11T00:40:05.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:40:05.994972814Z 2024-05-11T00:40:05.995324390Z [2024-05-11T00:40:05.994+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:40:05.996909539Z [2024-05-11T00:40:05.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:40:05.996917632Z 2024-05-11T00:40:06.001422195Z [2024-05-11T00:40:06.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:40:06.001706452Z [2024-05-11T00:40:06.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:40:06.066395941Z [2024-05-11T00:40:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:06.066802992Z [2024-05-11T00:40:06.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:39:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:06.067106643Z [2024-05-11T00:40:06.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:39:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:06.067327204Z [2024-05-11T00:40:06.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:06.076529203Z [2024-05-11T00:40:06.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:39:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:03.151184+00:00, run_end_date=2024-05-11 00:40:04.835732+00:00, run_duration=1.684548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:00.785480+00:00, queued_by_job_id=2, pid=8616 2024-05-11T00:40:06.076900740Z [2024-05-11T00:40:06.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:39:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:03.494593+00:00, run_end_date=2024-05-11 00:40:04.825117+00:00, run_duration=1.330524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:00.785480+00:00, queued_by_job_id=2, pid=8632 2024-05-11T00:40:06.077266197Z [2024-05-11T00:40:06.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e17240c-ab76-471c-9a58-529b9d07a688 2024-05-11T00:40:06.077543554Z [2024-05-11T00:40:06.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:05.258794+00:00, run_end_date=2024-05-11 00:40:05.639459+00:00, run_duration=0.380665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:03.581223+00:00, queued_by_job_id=2, pid=8654 2024-05-11T00:40:08.766317298Z [2024-05-11T00:40:08.765+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:40:08.766365710Z 2024-05-11T00:40:08.766903228Z [2024-05-11T00:40:08.766+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:40:08.768268796Z [2024-05-11T00:40:08.767+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:40:08.768302021Z 2024-05-11T00:40:08.773931985Z [2024-05-11T00:40:08.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:40:08.774346618Z [2024-05-11T00:40:08.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:40:08.843754667Z [2024-05-11T00:40:08.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status queued for try_number 1 2024-05-11T00:40:08.844180171Z [2024-05-11T00:40:08.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:08.852563119Z [2024-05-11T00:40:08.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c099e3f-9630-49d1-8a17-30a7e01d8519 2024-05-11T00:40:08.852793154Z [2024-05-11T00:40:08.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=0, run_start_date=2024-05-11 00:40:07.701749+00:00, run_end_date=2024-05-11 00:40:08.048294+00:00, run_duration=0.346545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:05.997805+00:00, queued_by_job_id=2, pid=8665 2024-05-11T00:40:10.915004740Z [2024-05-11T00:40:10.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:40:10.915367933Z [2024-05-11T00:40:10.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:35:00+00:00, run_id=scheduled__2024-05-11T00:35:00+00:00, run_start_date=2024-05-11 00:40:00.672425+00:00, run_end_date=2024-05-11 00:40:10.914898+00:00, run_duration=10.242473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:35:00+00:00, data_interval_end=2024-05-11 00:40:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:40:10.923111500Z [2024-05-11T00:40:10.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:40:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:40:12.039421828Z [2024-05-11T00:40:12.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:35:00+00:00 exited with status success for try_number 1 2024-05-11T00:40:12.051119733Z [2024-05-11T00:40:12.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:35:00+00:00, map_index=-1, run_start_date=2024-05-11 00:40:10.444672+00:00, run_end_date=2024-05-11 00:40:10.867628+00:00, run_duration=0.422956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:40:08.769269+00:00, queued_by_job_id=2, pid=8673 2024-05-11T00:40:34.917487702Z [2024-05-11T00:40:34.916+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:41:00.784376156Z [2024-05-11T00:41:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:41:00+00:00, run_after=2024-05-11T00:42:00+00:00 2024-05-11T00:41:00.796339216Z [2024-05-11T00:41:00.795+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:41:00+00:00, run_after=2024-05-11T00:42:00+00:00 2024-05-11T00:41:00.802854416Z [2024-05-11T00:41:00.802+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:41:00.879170787Z [2024-05-11T00:41:00.878+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:41:00.879254650Z 2024-05-11T00:41:00.879263777Z 2024-05-11T00:41:00.879270836Z 2024-05-11T00:41:00.879579590Z [2024-05-11T00:41:00.879+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:41:00.880013827Z [2024-05-11T00:41:00.879+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:41:00.880200606Z [2024-05-11T00:41:00.879+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:41:00.881370295Z [2024-05-11T00:41:00.881+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:41:00.881382862Z 2024-05-11T00:41:00.881389870Z 2024-05-11T00:41:00.881396776Z 2024-05-11T00:41:00.887597057Z [2024-05-11T00:41:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:41:00.887801048Z [2024-05-11T00:41:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:41:00.888228878Z [2024-05-11T00:41:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:41:00.888497291Z [2024-05-11T00:41:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:41:00.888887529Z [2024-05-11T00:41:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:41:00.889091292Z [2024-05-11T00:41:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:41:01.183198403Z [2024-05-11T00:41:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:41:01.183278227Z [2024-05-11T00:41:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:41:01.185186423Z [2024-05-11T00:41:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:41:01.196303080Z [2024-05-11T00:41:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20d3404e-ac77-462f-a320-0e57b6a9cdd5 2024-05-11T00:41:01.196497197Z [2024-05-11T00:41:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cb598e8-3c11-41b5-aa20-5be19d60a4d7 2024-05-11T00:41:01.196691105Z [2024-05-11T00:41:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33c4d139-7049-4a15-aba0-67a3cb4d4919 2024-05-11T00:41:02.420688155Z [2024-05-11T00:41:02.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:41:02.420921640Z [2024-05-11T00:41:02.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:40:00+00:00, run_id=scheduled__2024-05-11T00:40:00+00:00, run_start_date=2024-05-11 00:41:00.813126+00:00, run_end_date=2024-05-11 00:41:02.420591+00:00, run_duration=1.607465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:40:00+00:00, data_interval_end=2024-05-11 00:41:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:41:02.429417836Z [2024-05-11T00:41:02.429+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:41:00+00:00, run_after=2024-05-11T00:42:00+00:00 2024-05-11T00:41:02.478749631Z [2024-05-11T00:41:02.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:41:02.488552870Z [2024-05-11T00:41:02.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:41:01.742849+00:00, run_end_date=2024-05-11 00:41:02.139877+00:00, run_duration=0.397028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:41:00.883008+00:00, queued_by_job_id=2, pid=8682 2024-05-11T00:41:05.893603220Z [2024-05-11T00:41:05.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:41:05.893659316Z [2024-05-11T00:41:05.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:40:00+00:00, run_id=scheduled__2024-05-11T00:40:00+00:00, run_start_date=2024-05-11 00:41:00.814256+00:00, run_end_date=2024-05-11 00:41:05.892270+00:00, run_duration=5.078014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:40:00+00:00, data_interval_end=2024-05-11 00:41:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:41:05.900653006Z [2024-05-11T00:41:05.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:41:00+00:00, run_after=2024-05-11T00:42:00+00:00 2024-05-11T00:41:05.906104847Z [2024-05-11T00:41:05.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:41:05.906481069Z [2024-05-11T00:41:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:40:00+00:00, run_id=scheduled__2024-05-11T00:40:00+00:00, run_start_date=2024-05-11 00:41:00.815228+00:00, run_end_date=2024-05-11 00:41:05.905995+00:00, run_duration=5.090767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:40:00+00:00, data_interval_end=2024-05-11 00:41:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:41:05.915362478Z [2024-05-11T00:41:05.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:41:00+00:00, run_after=2024-05-11T00:42:00+00:00 2024-05-11T00:41:05.942974805Z [2024-05-11T00:41:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:41:05.943009958Z [2024-05-11T00:41:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:41:05.951069709Z [2024-05-11T00:41:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:41:02.922941+00:00, run_end_date=2024-05-11 00:41:05.006658+00:00, run_duration=2.083717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:41:00.883008+00:00, queued_by_job_id=2, pid=8701 2024-05-11T00:41:05.951164486Z [2024-05-11T00:41:05.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:41:02.689352+00:00, run_end_date=2024-05-11 00:41:05.472598+00:00, run_duration=2.783246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:41:00.883008+00:00, queued_by_job_id=2, pid=8700 2024-05-11T00:42:00.686857618Z [2024-05-11T00:42:00.686+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:42:00.698054922Z [2024-05-11T00:42:00.697+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:42:00.716356458Z [2024-05-11T00:42:00.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:42:00+00:00, run_after=2024-05-11T00:43:00+00:00 2024-05-11T00:42:00.728583446Z [2024-05-11T00:42:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:42:00+00:00, run_after=2024-05-11T00:43:00+00:00 2024-05-11T00:42:00.819764785Z [2024-05-11T00:42:00.819+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:42:00.819797090Z 2024-05-11T00:42:00.819810112Z 2024-05-11T00:42:00.819815993Z 2024-05-11T00:42:00.819820997Z 2024-05-11T00:42:00.820109517Z [2024-05-11T00:42:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:42:00.820418683Z [2024-05-11T00:42:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:42:00.820780483Z [2024-05-11T00:42:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:42:00.821083310Z [2024-05-11T00:42:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:42:00.822184077Z [2024-05-11T00:42:00.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:42:00.822198964Z 2024-05-11T00:42:00.822204515Z 2024-05-11T00:42:00.822209721Z 2024-05-11T00:42:00.822215224Z 2024-05-11T00:42:00.831527892Z [2024-05-11T00:42:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:42:00.831758809Z [2024-05-11T00:42:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:42:00.832272492Z [2024-05-11T00:42:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:42:00.832418543Z [2024-05-11T00:42:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:42:00.832833431Z [2024-05-11T00:42:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:42:00.833039759Z [2024-05-11T00:42:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:42:00.833475814Z [2024-05-11T00:42:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:42:00.833810189Z [2024-05-11T00:42:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:42:01.431102547Z [2024-05-11T00:42:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:42:01.431133075Z [2024-05-11T00:42:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:41:00+00:00 exited with status queued for try_number 1 2024-05-11T00:42:01.431199564Z [2024-05-11T00:42:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:41:00+00:00 exited with status queued for try_number 1 2024-05-11T00:42:01.431244418Z [2024-05-11T00:42:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:41:00+00:00 exited with status queued for try_number 1 2024-05-11T00:42:01.447217254Z [2024-05-11T00:42:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fa25fb1-7134-4935-8920-1271f8140056 2024-05-11T00:42:01.447246006Z [2024-05-11T00:42:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2244acd3-8c6e-42c3-b592-426fd58ad4fc 2024-05-11T00:42:01.447347221Z [2024-05-11T00:42:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0861e989-a4ed-45cc-9518-455d27435367 2024-05-11T00:42:01.447444869Z [2024-05-11T00:42:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8e6adfd-9dc8-4d9d-9fe7-5e89ae39ba3e 2024-05-11T00:42:02.734833594Z [2024-05-11T00:42:02.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:42:02.735011216Z [2024-05-11T00:42:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:40:00+00:00, run_id=scheduled__2024-05-11T00:40:00+00:00, run_start_date=2024-05-11 00:42:00.739651+00:00, run_end_date=2024-05-11 00:42:02.734736+00:00, run_duration=1.995085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:40:00+00:00, data_interval_end=2024-05-11 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:42:02.743447660Z [2024-05-11T00:42:02.743+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:42:00+00:00, run_after=2024-05-11T00:44:00+00:00 2024-05-11T00:42:02.750472744Z [2024-05-11T00:42:02.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:42:02.750927507Z [2024-05-11T00:42:02.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:41:00+00:00, run_id=scheduled__2024-05-11T00:41:00+00:00, run_start_date=2024-05-11 00:42:00.740901+00:00, run_end_date=2024-05-11 00:42:02.750567+00:00, run_duration=2.009666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:41:00+00:00, data_interval_end=2024-05-11 00:42:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:42:02.764343931Z [2024-05-11T00:42:02.764+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:42:00+00:00, run_after=2024-05-11T00:43:00+00:00 2024-05-11T00:42:02.807521960Z [2024-05-11T00:42:02.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:42:02.809784417Z [2024-05-11T00:42:02.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:41:00+00:00 exited with status success for try_number 1 2024-05-11T00:42:02.816534389Z [2024-05-11T00:42:02.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:41:00+00:00, map_index=-1, run_start_date=2024-05-11 00:42:01.953409+00:00, run_end_date=2024-05-11 00:42:02.306933+00:00, run_duration=0.353524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:42:00.823854+00:00, queued_by_job_id=2, pid=8742 2024-05-11T00:42:02.816885185Z [2024-05-11T00:42:02.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:42:01.601273+00:00, run_end_date=2024-05-11 00:42:01.972645+00:00, run_duration=0.371372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:42:00.823854+00:00, queued_by_job_id=2, pid=8730 2024-05-11T00:42:04.964564989Z [2024-05-11T00:42:04.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:42:04.964912411Z [2024-05-11T00:42:04.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:41:00+00:00, run_id=scheduled__2024-05-11T00:41:00+00:00, run_start_date=2024-05-11 00:42:00.741894+00:00, run_end_date=2024-05-11 00:42:04.964374+00:00, run_duration=4.22248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:41:00+00:00, data_interval_end=2024-05-11 00:42:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:42:04.975830621Z [2024-05-11T00:42:04.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:42:00+00:00, run_after=2024-05-11T00:43:00+00:00 2024-05-11T00:42:05.011288788Z [2024-05-11T00:42:05.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:41:00+00:00 exited with status success for try_number 1 2024-05-11T00:42:05.020184625Z [2024-05-11T00:42:05.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:41:00+00:00, map_index=-1, run_start_date=2024-05-11 00:42:02.818359+00:00, run_end_date=2024-05-11 00:42:04.357155+00:00, run_duration=1.538796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:42:00.823854+00:00, queued_by_job_id=2, pid=8760 2024-05-11T00:42:06.066293031Z [2024-05-11T00:42:06.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:42:06.066616430Z [2024-05-11T00:42:06.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:41:00+00:00, run_id=scheduled__2024-05-11T00:41:00+00:00, run_start_date=2024-05-11 00:42:00.742845+00:00, run_end_date=2024-05-11 00:42:06.066029+00:00, run_duration=5.323184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:41:00+00:00, data_interval_end=2024-05-11 00:42:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:42:06.083786045Z [2024-05-11T00:42:06.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:42:00+00:00, run_after=2024-05-11T00:43:00+00:00 2024-05-11T00:42:06.115741977Z [2024-05-11T00:42:06.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:41:00+00:00 exited with status success for try_number 1 2024-05-11T00:42:06.126276408Z [2024-05-11T00:42:06.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:41:00+00:00, map_index=-1, run_start_date=2024-05-11 00:42:02.649286+00:00, run_end_date=2024-05-11 00:42:04.831463+00:00, run_duration=2.182177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:42:00.823854+00:00, queued_by_job_id=2, pid=8759 2024-05-11T00:43:00.200409142Z [2024-05-11T00:43:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:43:00+00:00, run_after=2024-05-11T00:44:00+00:00 2024-05-11T00:43:00.213883195Z [2024-05-11T00:43:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:43:00+00:00, run_after=2024-05-11T00:44:00+00:00 2024-05-11T00:43:00.220805712Z [2024-05-11T00:43:00.220+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:43:00.339016609Z [2024-05-11T00:43:00.335+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:43:00.339038542Z 2024-05-11T00:43:00.339041981Z 2024-05-11T00:43:00.339045086Z 2024-05-11T00:43:00.339048120Z [2024-05-11T00:43:00.335+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:43:00.339051278Z [2024-05-11T00:43:00.335+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:43:00.339054139Z [2024-05-11T00:43:00.335+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:43:00.339057596Z [2024-05-11T00:43:00.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:43:00.339060560Z 2024-05-11T00:43:00.339063489Z 2024-05-11T00:43:00.339066460Z 2024-05-11T00:43:00.347468477Z [2024-05-11T00:43:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:43:00.347487119Z [2024-05-11T00:43:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:43:00.347490543Z [2024-05-11T00:43:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:43:00.347493977Z [2024-05-11T00:43:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:43:00.347497398Z [2024-05-11T00:43:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:43:00.347500567Z [2024-05-11T00:43:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:43:00.787038720Z [2024-05-11T00:43:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status queued for try_number 1 2024-05-11T00:43:00.787074835Z [2024-05-11T00:43:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status queued for try_number 1 2024-05-11T00:43:00.787088604Z [2024-05-11T00:43:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status queued for try_number 1 2024-05-11T00:43:00.801265603Z [2024-05-11T00:43:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to a461a6f8-a6c8-4ec2-a873-ebebd79c0959 2024-05-11T00:43:00.801300037Z [2024-05-11T00:43:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 988c8edc-b722-41c2-b866-4eb302279e79 2024-05-11T00:43:00.801426511Z [2024-05-11T00:43:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceeadf32-0b89-4234-9b59-899092d1e399 2024-05-11T00:43:01.919403980Z [2024-05-11T00:43:01.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:43:01.919907774Z [2024-05-11T00:43:01.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:42:00+00:00, run_id=scheduled__2024-05-11T00:42:00+00:00, run_start_date=2024-05-11 00:43:00.230562+00:00, run_end_date=2024-05-11 00:43:01.919345+00:00, run_duration=1.688783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:42:00+00:00, data_interval_end=2024-05-11 00:43:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:43:01.928643826Z [2024-05-11T00:43:01.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:43:00+00:00, run_after=2024-05-11T00:44:00+00:00 2024-05-11T00:43:01.987720877Z [2024-05-11T00:43:01.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status success for try_number 1 2024-05-11T00:43:01.997154901Z [2024-05-11T00:43:01.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:42:00+00:00, map_index=-1, run_start_date=2024-05-11 00:43:01.306745+00:00, run_end_date=2024-05-11 00:43:01.737382+00:00, run_duration=0.430637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:43:00.337540+00:00, queued_by_job_id=2, pid=8792 2024-05-11T00:43:03.546260044Z [2024-05-11T00:43:03.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:43:03.546431108Z [2024-05-11T00:43:03.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:42:00+00:00, run_id=scheduled__2024-05-11T00:42:00+00:00, run_start_date=2024-05-11 00:43:00.231707+00:00, run_end_date=2024-05-11 00:43:03.546141+00:00, run_duration=3.314434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:42:00+00:00, data_interval_end=2024-05-11 00:43:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:43:03.557010471Z [2024-05-11T00:43:03.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:43:00+00:00, run_after=2024-05-11T00:44:00+00:00 2024-05-11T00:43:03.596652671Z [2024-05-11T00:43:03.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status success for try_number 1 2024-05-11T00:43:03.600820252Z [2024-05-11T00:43:03.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:42:00+00:00, map_index=-1, run_start_date=2024-05-11 00:43:02.213456+00:00, run_end_date=2024-05-11 00:43:03.376478+00:00, run_duration=1.163022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:43:00.337540+00:00, queued_by_job_id=2, pid=8810 2024-05-11T00:43:04.649376060Z [2024-05-11T00:43:04.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:43:04.649632325Z [2024-05-11T00:43:04.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:42:00+00:00, run_id=scheduled__2024-05-11T00:42:00+00:00, run_start_date=2024-05-11 00:43:00.232806+00:00, run_end_date=2024-05-11 00:43:04.649307+00:00, run_duration=4.416501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:42:00+00:00, data_interval_end=2024-05-11 00:43:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:43:04.660488922Z [2024-05-11T00:43:04.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:43:00+00:00, run_after=2024-05-11T00:44:00+00:00 2024-05-11T00:43:04.703798827Z [2024-05-11T00:43:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status success for try_number 1 2024-05-11T00:43:04.711204108Z [2024-05-11T00:43:04.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:42:00+00:00, map_index=-1, run_start_date=2024-05-11 00:43:02.335936+00:00, run_end_date=2024-05-11 00:43:04.267740+00:00, run_duration=1.931804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:43:00.337540+00:00, queued_by_job_id=2, pid=8811 2024-05-11T00:44:00.666360003Z [2024-05-11T00:44:00.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:44:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:44:00.683073488Z [2024-05-11T00:44:00.682+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:44:00.703457783Z [2024-05-11T00:44:00.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:44:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:44:00.713548116Z [2024-05-11T00:44:00.713+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:44:00.815424688Z [2024-05-11T00:44:00.815+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:44:00.815451608Z 2024-05-11T00:44:00.815457188Z 2024-05-11T00:44:00.815461759Z 2024-05-11T00:44:00.815466153Z 2024-05-11T00:44:00.815814345Z [2024-05-11T00:44:00.815+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:44:00.816204684Z [2024-05-11T00:44:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:44:00.816928471Z [2024-05-11T00:44:00.816+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:44:00.816954945Z [2024-05-11T00:44:00.816+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:44:00.817926189Z [2024-05-11T00:44:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:44:00.817941712Z 2024-05-11T00:44:00.817945541Z 2024-05-11T00:44:00.817948719Z 2024-05-11T00:44:00.817951716Z 2024-05-11T00:44:00.821966550Z [2024-05-11T00:44:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:44:00.822239777Z [2024-05-11T00:44:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:44:00.822572942Z [2024-05-11T00:44:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:44:00.822785763Z [2024-05-11T00:44:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:44:00.823096471Z [2024-05-11T00:44:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:44:00.823295827Z [2024-05-11T00:44:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:44:00.823660635Z [2024-05-11T00:44:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:44:00.823926208Z [2024-05-11T00:44:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:44:01.441144137Z [2024-05-11T00:44:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status queued for try_number 1 2024-05-11T00:44:01.441176386Z [2024-05-11T00:44:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:43:00+00:00 exited with status queued for try_number 1 2024-05-11T00:44:01.441214417Z [2024-05-11T00:44:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:43:00+00:00 exited with status queued for try_number 1 2024-05-11T00:44:01.441293384Z [2024-05-11T00:44:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:43:00+00:00 exited with status queued for try_number 1 2024-05-11T00:44:01.451626127Z [2024-05-11T00:44:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to df6ec530-ff80-43fc-9eb6-0a4e7c556866 2024-05-11T00:44:01.451688547Z [2024-05-11T00:44:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f63ff8d-a334-4cf6-895d-4395730b3f85 2024-05-11T00:44:01.451761538Z [2024-05-11T00:44:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26263c00-4aef-44b1-93e5-889ca4fe38c2 2024-05-11T00:44:01.451877062Z [2024-05-11T00:44:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2219de3-72b9-4662-a4f2-3c3533a4cd1f 2024-05-11T00:44:02.606064929Z [2024-05-11T00:44:02.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:44:02.606995557Z [2024-05-11T00:44:02.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:42:00+00:00, run_id=scheduled__2024-05-11T00:42:00+00:00, run_start_date=2024-05-11 00:44:00.726726+00:00, run_end_date=2024-05-11 00:44:02.606380+00:00, run_duration=1.879654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:42:00+00:00, data_interval_end=2024-05-11 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:44:02.617935626Z [2024-05-11T00:44:02.617+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:44:00+00:00, run_after=2024-05-11T00:46:00+00:00 2024-05-11T00:44:02.625784226Z [2024-05-11T00:44:02.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:44:02.626194034Z [2024-05-11T00:44:02.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:43:00+00:00, run_id=scheduled__2024-05-11T00:43:00+00:00, run_start_date=2024-05-11 00:44:00.728371+00:00, run_end_date=2024-05-11 00:44:02.625644+00:00, run_duration=1.897273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:43:00+00:00, data_interval_end=2024-05-11 00:44:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:44:02.647739395Z [2024-05-11T00:44:02.647+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:44:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:44:02.707320052Z [2024-05-11T00:44:02.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:42:00+00:00 exited with status success for try_number 1 2024-05-11T00:44:02.707550240Z [2024-05-11T00:44:02.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:43:00+00:00 exited with status success for try_number 1 2024-05-11T00:44:02.716659688Z [2024-05-11T00:44:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:43:00+00:00, map_index=-1, run_start_date=2024-05-11 00:44:01.884845+00:00, run_end_date=2024-05-11 00:44:02.332594+00:00, run_duration=0.447749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:44:00.819052+00:00, queued_by_job_id=2, pid=8846 2024-05-11T00:44:02.717237829Z [2024-05-11T00:44:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:42:00+00:00, map_index=-1, run_start_date=2024-05-11 00:44:01.860177+00:00, run_end_date=2024-05-11 00:44:02.256364+00:00, run_duration=0.396187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:44:00.819052+00:00, queued_by_job_id=2, pid=8845 2024-05-11T00:44:05.714925379Z [2024-05-11T00:44:05.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:44:05.715304059Z [2024-05-11T00:44:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:43:00+00:00, run_id=scheduled__2024-05-11T00:43:00+00:00, run_start_date=2024-05-11 00:44:00.729602+00:00, run_end_date=2024-05-11 00:44:05.714742+00:00, run_duration=4.98514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:43:00+00:00, data_interval_end=2024-05-11 00:44:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:44:05.724680586Z [2024-05-11T00:44:05.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:44:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:44:05.730764700Z [2024-05-11T00:44:05.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:44:05.731150945Z [2024-05-11T00:44:05.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:43:00+00:00, run_id=scheduled__2024-05-11T00:43:00+00:00, run_start_date=2024-05-11 00:44:00.731325+00:00, run_end_date=2024-05-11 00:44:05.730610+00:00, run_duration=4.999285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:43:00+00:00, data_interval_end=2024-05-11 00:44:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:44:05.740057613Z [2024-05-11T00:44:05.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:44:00+00:00, run_after=2024-05-11T00:45:00+00:00 2024-05-11T00:44:05.778507461Z [2024-05-11T00:44:05.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:43:00+00:00 exited with status success for try_number 1 2024-05-11T00:44:05.779304432Z [2024-05-11T00:44:05.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:43:00+00:00 exited with status success for try_number 1 2024-05-11T00:44:05.793215029Z [2024-05-11T00:44:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:43:00+00:00, map_index=-1, run_start_date=2024-05-11 00:44:02.966197+00:00, run_end_date=2024-05-11 00:44:04.836796+00:00, run_duration=1.870599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:44:00.819052+00:00, queued_by_job_id=2, pid=8870 2024-05-11T00:44:05.793741992Z [2024-05-11T00:44:05.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:43:00+00:00, map_index=-1, run_start_date=2024-05-11 00:44:02.872597+00:00, run_end_date=2024-05-11 00:44:05.481738+00:00, run_duration=2.609141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:44:00.819052+00:00, queued_by_job_id=2, pid=8869 2024-05-11T00:45:00.331769291Z [2024-05-11T00:45:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:45:00.356628929Z [2024-05-11T00:45:00.355+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:46:00+00:00 2024-05-11T00:45:00.368327995Z [2024-05-11T00:45:00.365+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:45:00.378901996Z [2024-05-11T00:45:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:46:00+00:00 2024-05-11T00:45:00.476756313Z [2024-05-11T00:45:00.476+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:45:00.476788014Z 2024-05-11T00:45:00.476792760Z 2024-05-11T00:45:00.476796228Z 2024-05-11T00:45:00.476799502Z 2024-05-11T00:45:00.476905966Z [2024-05-11T00:45:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:45:00.477074287Z [2024-05-11T00:45:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:45:00.477332720Z [2024-05-11T00:45:00.477+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:45:00.477532655Z [2024-05-11T00:45:00.477+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:45:00.478251669Z [2024-05-11T00:45:00.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:45:00.478260348Z 2024-05-11T00:45:00.478263705Z 2024-05-11T00:45:00.478266622Z 2024-05-11T00:45:00.478269563Z 2024-05-11T00:45:00.482441814Z [2024-05-11T00:45:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:45:00.482633963Z [2024-05-11T00:45:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:45:00.482973958Z [2024-05-11T00:45:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:45:00.483149835Z [2024-05-11T00:45:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:45:00.483429654Z [2024-05-11T00:45:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:45:00.483562886Z [2024-05-11T00:45:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:45:00.483807096Z [2024-05-11T00:45:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:45:00.483955315Z [2024-05-11T00:45:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:45:01.006232992Z [2024-05-11T00:45:01.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:01.006275394Z [2024-05-11T00:45:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:01.006316789Z [2024-05-11T00:45:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:01.006374397Z [2024-05-11T00:45:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:01.023989389Z [2024-05-11T00:45:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 990d8c7a-f60b-4d2a-ade6-30b3b9b982e8 2024-05-11T00:45:01.024017634Z [2024-05-11T00:45:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73af12da-75e0-4913-85b5-cfc0a6ae3fa1 2024-05-11T00:45:01.024021269Z [2024-05-11T00:45:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 245335f9-8a0f-4e04-b4c5-7a06667601e7 2024-05-11T00:45:01.024036379Z [2024-05-11T00:45:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4de8d7ad-65c6-480f-b41d-e04eea2633cc 2024-05-11T00:45:02.382511909Z [2024-05-11T00:45:02.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:45:02.383706531Z [2024-05-11T00:45:02.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:44:00+00:00, run_id=scheduled__2024-05-11T00:44:00+00:00, run_start_date=2024-05-11 00:45:00.396428+00:00, run_end_date=2024-05-11 00:45:02.382411+00:00, run_duration=1.985983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:44:00+00:00, data_interval_end=2024-05-11 00:45:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:45:02.415459723Z [2024-05-11T00:45:02.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:46:00+00:00 2024-05-11T00:45:02.496731882Z [2024-05-11T00:45:02.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:02.502291842Z [2024-05-11T00:45:02.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:44:00+00:00, map_index=-1, run_start_date=2024-05-11 00:45:01.363483+00:00, run_end_date=2024-05-11 00:45:01.785605+00:00, run_duration=0.422122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:00.479242+00:00, queued_by_job_id=2, pid=8903 2024-05-11T00:45:03.596922559Z [2024-05-11T00:45:03.596+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:45:03.596944614Z 2024-05-11T00:45:03.597116903Z [2024-05-11T00:45:03.596+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:45:03.597844856Z [2024-05-11T00:45:03.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:45:03.597854839Z 2024-05-11T00:45:03.600308196Z [2024-05-11T00:45:03.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:45:03.600573525Z [2024-05-11T00:45:03.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:45:03.648523011Z [2024-05-11T00:45:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:03.648724138Z [2024-05-11T00:45:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:03.654751720Z [2024-05-11T00:45:03.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a4a98ae-77e8-4fa4-b1a1-a462bc83cbfe 2024-05-11T00:45:03.655081934Z [2024-05-11T00:45:03.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:45:02.737044+00:00, run_end_date=2024-05-11 00:45:03.310397+00:00, run_duration=0.573353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:00.479242+00:00, queued_by_job_id=2, pid=8928 2024-05-11T00:45:05.482574945Z [2024-05-11T00:45:05.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:45:05.482971486Z [2024-05-11T00:45:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:44:00+00:00, run_id=scheduled__2024-05-11T00:44:00+00:00, run_start_date=2024-05-11 00:45:00.397497+00:00, run_end_date=2024-05-11 00:45:05.482669+00:00, run_duration=5.085172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:44:00+00:00, data_interval_end=2024-05-11 00:45:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:45:05.494596484Z [2024-05-11T00:45:05.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:46:00+00:00 2024-05-11T00:45:05.501717389Z [2024-05-11T00:45:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:45:05.502333528Z [2024-05-11T00:45:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:44:00+00:00, run_id=scheduled__2024-05-11T00:44:00+00:00, run_start_date=2024-05-11 00:45:00.398492+00:00, run_end_date=2024-05-11 00:45:05.502018+00:00, run_duration=5.103526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:44:00+00:00, data_interval_end=2024-05-11 00:45:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:45:05.513335250Z [2024-05-11T00:45:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:46:00+00:00 2024-05-11T00:45:05.562777068Z [2024-05-11T00:45:05.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:05.563413243Z [2024-05-11T00:45:05.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:05.570100933Z [2024-05-11T00:45:05.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:44:00+00:00, map_index=-1, run_start_date=2024-05-11 00:45:02.670473+00:00, run_end_date=2024-05-11 00:45:04.383807+00:00, run_duration=1.713334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:00.479242+00:00, queued_by_job_id=2, pid=8927 2024-05-11T00:45:05.570774399Z [2024-05-11T00:45:05.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:44:00+00:00, map_index=-1, run_start_date=2024-05-11 00:45:02.879604+00:00, run_end_date=2024-05-11 00:45:04.452981+00:00, run_duration=1.573377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:00.479242+00:00, queued_by_job_id=2, pid=8929 2024-05-11T00:45:06.637790078Z [2024-05-11T00:45:06.637+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:45:06.637833081Z 2024-05-11T00:45:06.637987303Z [2024-05-11T00:45:06.637+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:45:06.638332576Z [2024-05-11T00:45:06.638+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:45:06.638350955Z 2024-05-11T00:45:06.640545868Z [2024-05-11T00:45:06.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:45:06.640572168Z [2024-05-11T00:45:06.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:45:06.698670836Z [2024-05-11T00:45:06.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:06.698717765Z [2024-05-11T00:45:06.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:06.704596330Z [2024-05-11T00:45:06.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef6ae642-ad1e-4f91-8130-89ae79dd9c13 2024-05-11T00:45:06.704674593Z [2024-05-11T00:45:06.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:45:05.244443+00:00, run_end_date=2024-05-11 00:45:05.605252+00:00, run_duration=0.360809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:03.598316+00:00, queued_by_job_id=2, pid=8962 2024-05-11T00:45:08.974570339Z [2024-05-11T00:45:08.974+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:45:08.974629107Z 2024-05-11T00:45:08.974637587Z [2024-05-11T00:45:08.974+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:45:08.974981621Z [2024-05-11T00:45:08.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:45:08.974995927Z 2024-05-11T00:45:08.977047780Z [2024-05-11T00:45:08.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:45:08.977117769Z [2024-05-11T00:45:08.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:45:09.037800338Z [2024-05-11T00:45:09.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status queued for try_number 1 2024-05-11T00:45:09.038098578Z [2024-05-11T00:45:09.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:09.047244327Z [2024-05-11T00:45:09.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to b93a5981-828c-4869-a05d-2a4e63f11d5c 2024-05-11T00:45:09.047510941Z [2024-05-11T00:45:09.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=0, run_start_date=2024-05-11 00:45:08.324565+00:00, run_end_date=2024-05-11 00:45:08.697622+00:00, run_duration=0.373057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:06.638611+00:00, queued_by_job_id=2, pid=8973 2024-05-11T00:45:11.629559530Z [2024-05-11T00:45:11.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:45:11.630122446Z [2024-05-11T00:45:11.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:40:00+00:00, run_id=scheduled__2024-05-11T00:40:00+00:00, run_start_date=2024-05-11 00:45:00.395101+00:00, run_end_date=2024-05-11 00:45:11.629462+00:00, run_duration=11.234361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:40:00+00:00, data_interval_end=2024-05-11 00:45:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:45:11.637508415Z [2024-05-11T00:45:11.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:45:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:45:11.673929198Z [2024-05-11T00:45:11.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:40:00+00:00 exited with status success for try_number 1 2024-05-11T00:45:11.683053838Z [2024-05-11T00:45:11.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:40:00+00:00, map_index=-1, run_start_date=2024-05-11 00:45:10.617180+00:00, run_end_date=2024-05-11 00:45:10.958678+00:00, run_duration=0.341498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:45:08.975248+00:00, queued_by_job_id=2, pid=8981 2024-05-11T00:45:34.991653194Z [2024-05-11T00:45:34.991+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:46:00.163048833Z [2024-05-11T00:46:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:46:00+00:00, run_after=2024-05-11T00:47:00+00:00 2024-05-11T00:46:00.170131387Z [2024-05-11T00:46:00.169+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:46:00.177551732Z [2024-05-11T00:46:00.177+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:46:00.189063229Z [2024-05-11T00:46:00.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:46:00+00:00, run_after=2024-05-11T00:47:00+00:00 2024-05-11T00:46:00.289974146Z [2024-05-11T00:46:00.285+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:46:00.290000575Z 2024-05-11T00:46:00.290010681Z 2024-05-11T00:46:00.290014986Z 2024-05-11T00:46:00.290018878Z 2024-05-11T00:46:00.290024706Z [2024-05-11T00:46:00.285+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:46:00.290028785Z [2024-05-11T00:46:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:46:00.290032699Z [2024-05-11T00:46:00.286+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:46:00.290036527Z [2024-05-11T00:46:00.286+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:46:00.290040442Z [2024-05-11T00:46:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:46:00.290059611Z 2024-05-11T00:46:00.290063637Z 2024-05-11T00:46:00.290067345Z 2024-05-11T00:46:00.290071172Z 2024-05-11T00:46:00.297267226Z [2024-05-11T00:46:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:46:00.297290057Z [2024-05-11T00:46:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:46:00.297295135Z [2024-05-11T00:46:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:46:00.297299577Z [2024-05-11T00:46:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:46:00.297303769Z [2024-05-11T00:46:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:46:00.297307832Z [2024-05-11T00:46:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:46:00.297311769Z [2024-05-11T00:46:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:46:00.297315630Z [2024-05-11T00:46:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:46:00.623088303Z [2024-05-11T00:46:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status queued for try_number 1 2024-05-11T00:46:00.623251097Z [2024-05-11T00:46:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:46:00.623401145Z [2024-05-11T00:46:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:46:00.623543893Z [2024-05-11T00:46:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:46:00.647224510Z [2024-05-11T00:46:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bf2888d-e0e0-483d-9a27-971805604c10 2024-05-11T00:46:00.647455358Z [2024-05-11T00:46:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to b526f780-4bc7-4c07-84f1-886c26011fa7 2024-05-11T00:46:00.647689873Z [2024-05-11T00:46:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51ef3f81-67a9-4b72-b441-0559365c89db 2024-05-11T00:46:00.648013903Z [2024-05-11T00:46:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5127a37-3776-4e76-b875-3d0015bc5ac0 2024-05-11T00:46:01.896847419Z [2024-05-11T00:46:01.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:46:01.897218804Z [2024-05-11T00:46:01.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:44:00+00:00, run_id=scheduled__2024-05-11T00:44:00+00:00, run_start_date=2024-05-11 00:46:00.198465+00:00, run_end_date=2024-05-11 00:46:01.896832+00:00, run_duration=1.698367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:44:00+00:00, data_interval_end=2024-05-11 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:46:01.906812982Z [2024-05-11T00:46:01.906+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:46:00+00:00, run_after=2024-05-11T00:48:00+00:00 2024-05-11T00:46:01.971001071Z [2024-05-11T00:46:01.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:44:00+00:00 exited with status success for try_number 1 2024-05-11T00:46:01.971145633Z [2024-05-11T00:46:01.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:46:01.978242582Z [2024-05-11T00:46:01.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:44:00+00:00, map_index=-1, run_start_date=2024-05-11 00:46:01.245600+00:00, run_end_date=2024-05-11 00:46:01.639199+00:00, run_duration=0.393599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:46:00.288623+00:00, queued_by_job_id=2, pid=8991 2024-05-11T00:46:01.978630618Z [2024-05-11T00:46:01.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=-1, run_start_date=2024-05-11 00:46:01.299707+00:00, run_end_date=2024-05-11 00:46:01.783938+00:00, run_duration=0.484231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:46:00.288623+00:00, queued_by_job_id=2, pid=8992 2024-05-11T00:46:03.021594612Z [2024-05-11T00:46:03.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:46:03.021924974Z [2024-05-11T00:46:03.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:45:00+00:00, run_id=scheduled__2024-05-11T00:45:00+00:00, run_start_date=2024-05-11 00:46:00.199615+00:00, run_end_date=2024-05-11 00:46:03.021470+00:00, run_duration=2.821855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:45:00+00:00, data_interval_end=2024-05-11 00:46:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:46:03.031249587Z [2024-05-11T00:46:03.030+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:46:00+00:00, run_after=2024-05-11T00:47:00+00:00 2024-05-11T00:46:04.132706819Z [2024-05-11T00:46:04.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:46:04.133044151Z [2024-05-11T00:46:04.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:45:00+00:00, run_id=scheduled__2024-05-11T00:45:00+00:00, run_start_date=2024-05-11 00:46:00.200635+00:00, run_end_date=2024-05-11 00:46:04.132689+00:00, run_duration=3.932054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:45:00+00:00, data_interval_end=2024-05-11 00:46:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:46:04.141661206Z [2024-05-11T00:46:04.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:46:00+00:00, run_after=2024-05-11T00:47:00+00:00 2024-05-11T00:46:04.147851431Z [2024-05-11T00:46:04.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:46:04.148143561Z [2024-05-11T00:46:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:45:00+00:00, run_id=scheduled__2024-05-11T00:45:00+00:00, run_start_date=2024-05-11 00:46:00.202434+00:00, run_end_date=2024-05-11 00:46:04.147849+00:00, run_duration=3.945415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:45:00+00:00, data_interval_end=2024-05-11 00:46:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:46:04.156674823Z [2024-05-11T00:46:04.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:46:00+00:00, run_after=2024-05-11T00:47:00+00:00 2024-05-11T00:46:04.185737854Z [2024-05-11T00:46:04.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:46:04.185983500Z [2024-05-11T00:46:04.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:46:04.191757378Z [2024-05-11T00:46:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=-1, run_start_date=2024-05-11 00:46:02.311833+00:00, run_end_date=2024-05-11 00:46:03.500529+00:00, run_duration=1.188696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:46:00.288623+00:00, queued_by_job_id=2, pid=9015 2024-05-11T00:46:04.192092183Z [2024-05-11T00:46:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=-1, run_start_date=2024-05-11 00:46:02.312880+00:00, run_end_date=2024-05-11 00:46:03.991112+00:00, run_duration=1.678232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:46:00.288623+00:00, queued_by_job_id=2, pid=9016 2024-05-11T00:47:00.033667611Z [2024-05-11T00:47:00.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:47:00.048691275Z [2024-05-11T00:47:00.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:47:00+00:00, run_after=2024-05-11T00:48:00+00:00 2024-05-11T00:47:00.061604155Z [2024-05-11T00:47:00.061+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:47:00+00:00, run_after=2024-05-11T00:48:00+00:00 2024-05-11T00:47:00.138103464Z [2024-05-11T00:47:00.137+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:47:00.138143318Z 2024-05-11T00:47:00.138147309Z 2024-05-11T00:47:00.138150439Z 2024-05-11T00:47:00.138636087Z [2024-05-11T00:47:00.138+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:47:00.139075413Z [2024-05-11T00:47:00.138+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:47:00.139261444Z [2024-05-11T00:47:00.139+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:47:00.140004725Z [2024-05-11T00:47:00.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:47:00.140026092Z 2024-05-11T00:47:00.140030129Z 2024-05-11T00:47:00.140060253Z 2024-05-11T00:47:00.143389749Z [2024-05-11T00:47:00.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:47:00.143541542Z [2024-05-11T00:47:00.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:47:00.143810639Z [2024-05-11T00:47:00.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:47:00.144008747Z [2024-05-11T00:47:00.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:47:00.144301264Z [2024-05-11T00:47:00.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:47:00.144524085Z [2024-05-11T00:47:00.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:47:00.528460965Z [2024-05-11T00:47:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status queued for try_number 1 2024-05-11T00:47:00.528817626Z [2024-05-11T00:47:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status queued for try_number 1 2024-05-11T00:47:00.529030629Z [2024-05-11T00:47:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status queued for try_number 1 2024-05-11T00:47:00.538274759Z [2024-05-11T00:47:00.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29b3a13c-f017-4313-b159-20f87709d8cb 2024-05-11T00:47:00.538519080Z [2024-05-11T00:47:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1070c83-ffa3-4a89-bacc-715adebf47d3 2024-05-11T00:47:00.538758397Z [2024-05-11T00:47:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24123de8-0d82-411e-ab9d-b580e73bc27e 2024-05-11T00:47:02.591137755Z [2024-05-11T00:47:02.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:47:02.591786203Z [2024-05-11T00:47:02.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:46:00+00:00, run_id=scheduled__2024-05-11T00:46:00+00:00, run_start_date=2024-05-11 00:47:00.074152+00:00, run_end_date=2024-05-11 00:47:02.591213+00:00, run_duration=2.517061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:46:00+00:00, data_interval_end=2024-05-11 00:47:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:47:02.601185138Z [2024-05-11T00:47:02.600+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:47:00+00:00, run_after=2024-05-11T00:48:00+00:00 2024-05-11T00:47:02.655883488Z [2024-05-11T00:47:02.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status success for try_number 1 2024-05-11T00:47:02.663665032Z [2024-05-11T00:47:02.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:46:00+00:00, map_index=-1, run_start_date=2024-05-11 00:47:00.982770+00:00, run_end_date=2024-05-11 00:47:01.472814+00:00, run_duration=0.490044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:47:00.140813+00:00, queued_by_job_id=2, pid=9047 2024-05-11T00:47:03.712278493Z [2024-05-11T00:47:03.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:47:03.712360166Z [2024-05-11T00:47:03.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:46:00+00:00, run_id=scheduled__2024-05-11T00:46:00+00:00, run_start_date=2024-05-11 00:47:00.075570+00:00, run_end_date=2024-05-11 00:47:03.711958+00:00, run_duration=3.636388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:46:00+00:00, data_interval_end=2024-05-11 00:47:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:47:03.722592285Z [2024-05-11T00:47:03.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:47:00+00:00, run_after=2024-05-11T00:48:00+00:00 2024-05-11T00:47:03.728888694Z [2024-05-11T00:47:03.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:47:03.728943623Z [2024-05-11T00:47:03.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:46:00+00:00, run_id=scheduled__2024-05-11T00:46:00+00:00, run_start_date=2024-05-11 00:47:00.076831+00:00, run_end_date=2024-05-11 00:47:03.728532+00:00, run_duration=3.651701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:46:00+00:00, data_interval_end=2024-05-11 00:47:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:47:03.737610499Z [2024-05-11T00:47:03.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:47:00+00:00, run_after=2024-05-11T00:48:00+00:00 2024-05-11T00:47:03.780520596Z [2024-05-11T00:47:03.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status success for try_number 1 2024-05-11T00:47:03.789685385Z [2024-05-11T00:47:03.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:46:00+00:00, map_index=-1, run_start_date=2024-05-11 00:47:02.045765+00:00, run_end_date=2024-05-11 00:47:03.314355+00:00, run_duration=1.26859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:47:00.140813+00:00, queued_by_job_id=2, pid=9065 2024-05-11T00:47:04.870885684Z [2024-05-11T00:47:04.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status success for try_number 1 2024-05-11T00:47:04.878769140Z [2024-05-11T00:47:04.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:46:00+00:00, map_index=-1, run_start_date=2024-05-11 00:47:02.062021+00:00, run_end_date=2024-05-11 00:47:03.616346+00:00, run_duration=1.554325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:47:00.140813+00:00, queued_by_job_id=2, pid=9066 2024-05-11T00:48:00.135848891Z [2024-05-11T00:48:00.135+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:48:00.142332353Z [2024-05-11T00:48:00.142+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:48:00.154816878Z [2024-05-11T00:48:00.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:48:00+00:00, run_after=2024-05-11T00:49:00+00:00 2024-05-11T00:48:00.171512216Z [2024-05-11T00:48:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:48:00+00:00, run_after=2024-05-11T00:49:00+00:00 2024-05-11T00:48:00.262306213Z [2024-05-11T00:48:00.261+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:48:00.262351576Z 2024-05-11T00:48:00.262361340Z 2024-05-11T00:48:00.262369029Z 2024-05-11T00:48:00.262376491Z 2024-05-11T00:48:00.262934283Z [2024-05-11T00:48:00.262+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:48:00.263805058Z [2024-05-11T00:48:00.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:48:00.264201558Z [2024-05-11T00:48:00.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:48:00.264710238Z [2024-05-11T00:48:00.264+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:48:00.266178326Z [2024-05-11T00:48:00.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:48:00.266232282Z 2024-05-11T00:48:00.266243657Z 2024-05-11T00:48:00.266252411Z 2024-05-11T00:48:00.266260840Z 2024-05-11T00:48:00.272613442Z [2024-05-11T00:48:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:48:00.272973142Z [2024-05-11T00:48:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:48:00.273426213Z [2024-05-11T00:48:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:48:00.275258811Z [2024-05-11T00:48:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:48:00.275284857Z [2024-05-11T00:48:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:48:00.276099024Z [2024-05-11T00:48:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:48:00.279492155Z [2024-05-11T00:48:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:48:00.279509939Z [2024-05-11T00:48:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:48:00.703596801Z [2024-05-11T00:48:00.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status queued for try_number 1 2024-05-11T00:48:00.703691178Z [2024-05-11T00:48:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:47:00+00:00 exited with status queued for try_number 1 2024-05-11T00:48:00.703772873Z [2024-05-11T00:48:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:47:00+00:00 exited with status queued for try_number 1 2024-05-11T00:48:00.705692943Z [2024-05-11T00:48:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:47:00+00:00 exited with status queued for try_number 1 2024-05-11T00:48:00.718112991Z [2024-05-11T00:48:00.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to 172d8030-eb02-4d95-a532-d6949a83e83e 2024-05-11T00:48:00.719420651Z [2024-05-11T00:48:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dcd86ce-0d5c-49eb-b265-45cc2b40844c 2024-05-11T00:48:00.719620717Z [2024-05-11T00:48:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e16a815-129c-4fca-a8d7-02c9835471ba 2024-05-11T00:48:00.719862675Z [2024-05-11T00:48:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29cf6fb7-6fa8-4d3a-9c4d-e9a71f2e074c 2024-05-11T00:48:02.334996946Z [2024-05-11T00:48:02.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:48:02.335434203Z [2024-05-11T00:48:02.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:46:00+00:00, run_id=scheduled__2024-05-11T00:46:00+00:00, run_start_date=2024-05-11 00:48:00.183298+00:00, run_end_date=2024-05-11 00:48:02.334851+00:00, run_duration=2.151553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:46:00+00:00, data_interval_end=2024-05-11 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:48:02.342845913Z [2024-05-11T00:48:02.342+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:48:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:48:02.349039321Z [2024-05-11T00:48:02.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:48:02.349412382Z [2024-05-11T00:48:02.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:47:00+00:00, run_id=scheduled__2024-05-11T00:47:00+00:00, run_start_date=2024-05-11 00:48:00.184598+00:00, run_end_date=2024-05-11 00:48:02.348879+00:00, run_duration=2.164281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:47:00+00:00, data_interval_end=2024-05-11 00:48:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:48:02.361151150Z [2024-05-11T00:48:02.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:48:00+00:00, run_after=2024-05-11T00:49:00+00:00 2024-05-11T00:48:02.442924194Z [2024-05-11T00:48:02.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:46:00+00:00 exited with status success for try_number 1 2024-05-11T00:48:02.448836506Z [2024-05-11T00:48:02.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:46:00+00:00, map_index=-1, run_start_date=2024-05-11 00:48:01.227364+00:00, run_end_date=2024-05-11 00:48:02.155676+00:00, run_duration=0.928312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:48:00.268032+00:00, queued_by_job_id=2, pid=9095 2024-05-11T00:48:03.578906996Z [2024-05-11T00:48:03.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:47:00+00:00 exited with status success for try_number 1 2024-05-11T00:48:03.585319362Z [2024-05-11T00:48:03.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:47:00+00:00, map_index=-1, run_start_date=2024-05-11 00:48:01.648800+00:00, run_end_date=2024-05-11 00:48:02.275939+00:00, run_duration=0.627139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:48:00.268032+00:00, queued_by_job_id=2, pid=9101 2024-05-11T00:48:04.645796505Z [2024-05-11T00:48:04.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:48:04.649098348Z [2024-05-11T00:48:04.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:47:00+00:00, run_id=scheduled__2024-05-11T00:47:00+00:00, run_start_date=2024-05-11 00:48:00.185689+00:00, run_end_date=2024-05-11 00:48:04.648145+00:00, run_duration=4.462456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:47:00+00:00, data_interval_end=2024-05-11 00:48:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:48:04.665284583Z [2024-05-11T00:48:04.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:48:00+00:00, run_after=2024-05-11T00:49:00+00:00 2024-05-11T00:48:04.711238808Z [2024-05-11T00:48:04.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:47:00+00:00 exited with status success for try_number 1 2024-05-11T00:48:04.722301548Z [2024-05-11T00:48:04.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:47:00+00:00, map_index=-1, run_start_date=2024-05-11 00:48:02.852723+00:00, run_end_date=2024-05-11 00:48:04.486127+00:00, run_duration=1.633404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:48:00.268032+00:00, queued_by_job_id=2, pid=9119 2024-05-11T00:48:05.769715160Z [2024-05-11T00:48:05.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:48:05.770580361Z [2024-05-11T00:48:05.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:47:00+00:00, run_id=scheduled__2024-05-11T00:47:00+00:00, run_start_date=2024-05-11 00:48:00.186703+00:00, run_end_date=2024-05-11 00:48:05.770052+00:00, run_duration=5.583349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:47:00+00:00, data_interval_end=2024-05-11 00:48:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:48:05.786527157Z [2024-05-11T00:48:05.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:48:00+00:00, run_after=2024-05-11T00:49:00+00:00 2024-05-11T00:48:05.833965956Z [2024-05-11T00:48:05.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:47:00+00:00 exited with status success for try_number 1 2024-05-11T00:48:05.843526776Z [2024-05-11T00:48:05.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:47:00+00:00, map_index=-1, run_start_date=2024-05-11 00:48:03.569986+00:00, run_end_date=2024-05-11 00:48:05.095043+00:00, run_duration=1.525057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:48:00.268032+00:00, queued_by_job_id=2, pid=9130 2024-05-11T00:49:00.470051854Z [2024-05-11T00:49:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:49:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:49:00.479627514Z [2024-05-11T00:49:00.479+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:49:00.491432781Z [2024-05-11T00:49:00.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:49:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:49:00.584056899Z [2024-05-11T00:49:00.583+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:49:00.584094254Z 2024-05-11T00:49:00.584100817Z 2024-05-11T00:49:00.584106581Z 2024-05-11T00:49:00.584359200Z [2024-05-11T00:49:00.584+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:49:00.584698038Z [2024-05-11T00:49:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:49:00.584964987Z [2024-05-11T00:49:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:49:00.586003711Z [2024-05-11T00:49:00.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:49:00.586013754Z 2024-05-11T00:49:00.586019703Z 2024-05-11T00:49:00.586025348Z 2024-05-11T00:49:00.591770036Z [2024-05-11T00:49:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:49:00.592081957Z [2024-05-11T00:49:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:49:00.592415174Z [2024-05-11T00:49:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:49:00.592647735Z [2024-05-11T00:49:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:49:00.592924866Z [2024-05-11T00:49:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:49:00.593141108Z [2024-05-11T00:49:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:49:00.846904880Z [2024-05-11T00:49:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status queued for try_number 1 2024-05-11T00:49:00.847088359Z [2024-05-11T00:49:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status queued for try_number 1 2024-05-11T00:49:00.847191447Z [2024-05-11T00:49:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status queued for try_number 1 2024-05-11T00:49:00.871842262Z [2024-05-11T00:49:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff7857b7-2c07-44df-bd30-4da8ec57201c 2024-05-11T00:49:00.874427453Z [2024-05-11T00:49:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20542516-55e8-43f5-96a5-b29145adc04c 2024-05-11T00:49:00.874532423Z [2024-05-11T00:49:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba45aa55-8fc3-4eb8-9ab1-2733e6c2889f 2024-05-11T00:49:02.421672226Z [2024-05-11T00:49:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:49:02.422399194Z [2024-05-11T00:49:02.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:48:00+00:00, run_id=scheduled__2024-05-11T00:48:00+00:00, run_start_date=2024-05-11 00:49:00.500272+00:00, run_end_date=2024-05-11 00:49:02.422002+00:00, run_duration=1.92173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:48:00+00:00, data_interval_end=2024-05-11 00:49:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:49:02.433008821Z [2024-05-11T00:49:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:49:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:49:02.507608677Z [2024-05-11T00:49:02.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status success for try_number 1 2024-05-11T00:49:02.519132614Z [2024-05-11T00:49:02.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:48:00+00:00, map_index=-1, run_start_date=2024-05-11 00:49:01.553798+00:00, run_end_date=2024-05-11 00:49:01.905151+00:00, run_duration=0.351353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:49:00.587449+00:00, queued_by_job_id=2, pid=9156 2024-05-11T00:49:04.509142642Z [2024-05-11T00:49:04.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:49:04.509623617Z [2024-05-11T00:49:04.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:48:00+00:00, run_id=scheduled__2024-05-11T00:48:00+00:00, run_start_date=2024-05-11 00:49:00.501391+00:00, run_end_date=2024-05-11 00:49:04.509242+00:00, run_duration=4.007851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:48:00+00:00, data_interval_end=2024-05-11 00:49:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:49:04.519857952Z [2024-05-11T00:49:04.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:49:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:49:04.525634823Z [2024-05-11T00:49:04.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:49:04.525996855Z [2024-05-11T00:49:04.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:48:00+00:00, run_id=scheduled__2024-05-11T00:48:00+00:00, run_start_date=2024-05-11 00:49:00.502460+00:00, run_end_date=2024-05-11 00:49:04.525699+00:00, run_duration=4.023239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:48:00+00:00, data_interval_end=2024-05-11 00:49:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:49:04.534032051Z [2024-05-11T00:49:04.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:49:00+00:00, run_after=2024-05-11T00:50:00+00:00 2024-05-11T00:49:04.568828236Z [2024-05-11T00:49:04.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status success for try_number 1 2024-05-11T00:49:04.569178708Z [2024-05-11T00:49:04.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status success for try_number 1 2024-05-11T00:49:04.578384827Z [2024-05-11T00:49:04.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:48:00+00:00, map_index=-1, run_start_date=2024-05-11 00:49:02.531372+00:00, run_end_date=2024-05-11 00:49:03.912078+00:00, run_duration=1.380706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:49:00.587449+00:00, queued_by_job_id=2, pid=9175 2024-05-11T00:49:04.578966990Z [2024-05-11T00:49:04.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:48:00+00:00, map_index=-1, run_start_date=2024-05-11 00:49:02.472191+00:00, run_end_date=2024-05-11 00:49:04.115554+00:00, run_duration=1.643363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:49:00.587449+00:00, queued_by_job_id=2, pid=9174 2024-05-11T00:50:00.284629695Z [2024-05-11T00:50:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:51:00+00:00 2024-05-11T00:50:00.311297698Z [2024-05-11T00:50:00.306+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:50:00.330020455Z [2024-05-11T00:50:00.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:50:00.342166176Z [2024-05-11T00:50:00.338+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:50:00.360329261Z [2024-05-11T00:50:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:51:00+00:00 2024-05-11T00:50:00.469852965Z [2024-05-11T00:50:00.469+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T00:50:00.469936884Z 2024-05-11T00:50:00.469942611Z 2024-05-11T00:50:00.469952379Z 2024-05-11T00:50:00.469957169Z 2024-05-11T00:50:00.469962020Z 2024-05-11T00:50:00.470370766Z [2024-05-11T00:50:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:50:00.470769696Z [2024-05-11T00:50:00.470+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:50:00.471108368Z [2024-05-11T00:50:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:50:00.471427510Z [2024-05-11T00:50:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:50:00.471697938Z [2024-05-11T00:50:00.471+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:50:00.472883629Z [2024-05-11T00:50:00.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:50:00.472900628Z 2024-05-11T00:50:00.472910484Z 2024-05-11T00:50:00.472919244Z 2024-05-11T00:50:00.472927598Z 2024-05-11T00:50:00.472935929Z 2024-05-11T00:50:00.479258775Z [2024-05-11T00:50:00.478+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:50:00.479628950Z [2024-05-11T00:50:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:50:00.480080459Z [2024-05-11T00:50:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:50:00.480307590Z [2024-05-11T00:50:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:50:00.480755382Z [2024-05-11T00:50:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:50:00.480995083Z [2024-05-11T00:50:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:50:00.481484647Z [2024-05-11T00:50:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:50:00.481754326Z [2024-05-11T00:50:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:50:00.482231003Z [2024-05-11T00:50:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:50:00.482399235Z [2024-05-11T00:50:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:50:00.999006682Z [2024-05-11T00:50:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:00.999194816Z [2024-05-11T00:50:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:00.999358491Z [2024-05-11T00:50:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:49:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:00.999558128Z [2024-05-11T00:50:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:49:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:00.999973689Z [2024-05-11T00:50:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:49:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:01.025894614Z [2024-05-11T00:50:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae01f785-879f-4166-8314-f940a99e84f2 2024-05-11T00:50:01.025916663Z [2024-05-11T00:50:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99122680-a964-45b7-ab93-a354ddd2cb40 2024-05-11T00:50:01.025933786Z [2024-05-11T00:50:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to a38c5f4f-1b58-41c2-abf8-4ef2fae39263 2024-05-11T00:50:01.025937882Z [2024-05-11T00:50:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5533702d-47d0-4c70-931a-5ca47911be10 2024-05-11T00:50:01.025941112Z [2024-05-11T00:50:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to b03f6284-a6c1-4aff-9b14-49b020f10c85 2024-05-11T00:50:01.830413471Z [2024-05-11T00:50:01.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:50:01.830441545Z [2024-05-11T00:50:01.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:48:00+00:00, run_id=scheduled__2024-05-11T00:48:00+00:00, run_start_date=2024-05-11 00:50:00.376822+00:00, run_end_date=2024-05-11 00:50:01.829745+00:00, run_duration=1.452923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:48:00+00:00, data_interval_end=2024-05-11 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:50:01.847094003Z [2024-05-11T00:50:01.845+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:52:00+00:00 2024-05-11T00:50:03.099460121Z [2024-05-11T00:50:03.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:50:03.101452097Z [2024-05-11T00:50:03.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:49:00+00:00, run_id=scheduled__2024-05-11T00:49:00+00:00, run_start_date=2024-05-11 00:50:00.377853+00:00, run_end_date=2024-05-11 00:50:03.101061+00:00, run_duration=2.723208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:49:00+00:00, data_interval_end=2024-05-11 00:50:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:50:03.115301218Z [2024-05-11T00:50:03.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:51:00+00:00 2024-05-11T00:50:03.186435274Z [2024-05-11T00:50:03.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:48:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:03.186531539Z [2024-05-11T00:50:03.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:49:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:03.197068758Z [2024-05-11T00:50:03.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:48:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:01.395122+00:00, run_end_date=2024-05-11 00:50:01.802068+00:00, run_duration=0.406946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:00.474529+00:00, queued_by_job_id=2, pid=9209 2024-05-11T00:50:03.197175432Z [2024-05-11T00:50:03.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:49:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:01.687945+00:00, run_end_date=2024-05-11 00:50:02.218793+00:00, run_duration=0.530848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:00.474529+00:00, queued_by_job_id=2, pid=9210 2024-05-11T00:50:04.297717099Z [2024-05-11T00:50:04.296+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:50:04.297738802Z 2024-05-11T00:50:04.298011455Z [2024-05-11T00:50:04.297+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:50:04.298634720Z [2024-05-11T00:50:04.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:50:04.298645328Z 2024-05-11T00:50:04.301685343Z [2024-05-11T00:50:04.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:50:04.301996539Z [2024-05-11T00:50:04.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:50:04.362239030Z [2024-05-11T00:50:04.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:04.362518332Z [2024-05-11T00:50:04.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:04.374367323Z [2024-05-11T00:50:04.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c84abd1-9ce4-4507-8e9c-5f891c3baae6 2024-05-11T00:50:04.374812928Z [2024-05-11T00:50:04.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:02.782600+00:00, run_end_date=2024-05-11 00:50:03.138985+00:00, run_duration=0.356385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:00.474529+00:00, queued_by_job_id=2, pid=9235 2024-05-11T00:50:04.425806414Z [2024-05-11T00:50:04.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:50:04.426308776Z [2024-05-11T00:50:04.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:49:00+00:00, run_id=scheduled__2024-05-11T00:49:00+00:00, run_start_date=2024-05-11 00:50:00.378885+00:00, run_end_date=2024-05-11 00:50:04.426012+00:00, run_duration=4.047127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:49:00+00:00, data_interval_end=2024-05-11 00:50:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:50:04.436169364Z [2024-05-11T00:50:04.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:51:00+00:00 2024-05-11T00:50:04.498385490Z [2024-05-11T00:50:04.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:49:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:04.504223227Z [2024-05-11T00:50:04.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:49:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:03.084328+00:00, run_end_date=2024-05-11 00:50:04.303438+00:00, run_duration=1.21911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:00.474529+00:00, queued_by_job_id=2, pid=9246 2024-05-11T00:50:05.559925300Z [2024-05-11T00:50:05.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:50:05.560070685Z [2024-05-11T00:50:05.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:49:00+00:00, run_id=scheduled__2024-05-11T00:49:00+00:00, run_start_date=2024-05-11 00:50:00.380124+00:00, run_end_date=2024-05-11 00:50:05.559825+00:00, run_duration=5.179701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:49:00+00:00, data_interval_end=2024-05-11 00:50:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:50:05.569125714Z [2024-05-11T00:50:05.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:51:00+00:00 2024-05-11T00:50:05.626467811Z [2024-05-11T00:50:05.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:49:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:05.633172041Z [2024-05-11T00:50:05.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:49:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:02.782644+00:00, run_end_date=2024-05-11 00:50:04.424511+00:00, run_duration=1.641867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:00.474529+00:00, queued_by_job_id=2, pid=9234 2024-05-11T00:50:06.729696520Z [2024-05-11T00:50:06.729+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:50:06.729763919Z 2024-05-11T00:50:06.730094052Z [2024-05-11T00:50:06.729+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:50:06.731239473Z [2024-05-11T00:50:06.730+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:50:06.731289642Z 2024-05-11T00:50:06.735158889Z [2024-05-11T00:50:06.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:50:06.735626673Z [2024-05-11T00:50:06.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:50:06.862765325Z [2024-05-11T00:50:06.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:06.864879559Z [2024-05-11T00:50:06.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:06.878454238Z [2024-05-11T00:50:06.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a6cb2a8-37b7-420f-ac17-316de7d6aed4 2024-05-11T00:50:06.882028018Z [2024-05-11T00:50:06.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:05.966245+00:00, run_end_date=2024-05-11 00:50:06.298108+00:00, run_duration=0.331863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:04.299126+00:00, queued_by_job_id=2, pid=9274 2024-05-11T00:50:09.150957845Z [2024-05-11T00:50:09.150+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:50:09.151010208Z 2024-05-11T00:50:09.151021411Z [2024-05-11T00:50:09.150+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:50:09.151950931Z [2024-05-11T00:50:09.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:50:09.151978275Z 2024-05-11T00:50:09.154919327Z [2024-05-11T00:50:09.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:50:09.154962460Z [2024-05-11T00:50:09.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:50:09.207238708Z [2024-05-11T00:50:09.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status queued for try_number 1 2024-05-11T00:50:09.207604796Z [2024-05-11T00:50:09.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:09.214551479Z [2024-05-11T00:50:09.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1a67210-e439-4124-89dd-da6b70e09eb4 2024-05-11T00:50:09.214673986Z [2024-05-11T00:50:09.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=0, run_start_date=2024-05-11 00:50:08.542456+00:00, run_end_date=2024-05-11 00:50:08.885756+00:00, run_duration=0.3433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:06.731933+00:00, queued_by_job_id=2, pid=9285 2024-05-11T00:50:11.632399823Z [2024-05-11T00:50:11.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:50:11.632653894Z [2024-05-11T00:50:11.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:45:00+00:00, run_id=scheduled__2024-05-11T00:45:00+00:00, run_start_date=2024-05-11 00:50:00.375093+00:00, run_end_date=2024-05-11 00:50:11.632238+00:00, run_duration=11.257145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:45:00+00:00, data_interval_end=2024-05-11 00:50:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:50:11.638545408Z [2024-05-11T00:50:11.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:50:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:50:11.667876996Z [2024-05-11T00:50:11.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:45:00+00:00 exited with status success for try_number 1 2024-05-11T00:50:11.672722561Z [2024-05-11T00:50:11.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:45:00+00:00, map_index=-1, run_start_date=2024-05-11 00:50:10.819333+00:00, run_end_date=2024-05-11 00:50:11.208244+00:00, run_duration=0.388911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:50:09.152197+00:00, queued_by_job_id=2, pid=9293 2024-05-11T00:50:35.057511943Z [2024-05-11T00:50:35.056+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:51:00.270246533Z [2024-05-11T00:51:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:51:00+00:00, run_after=2024-05-11T00:52:00+00:00 2024-05-11T00:51:00.286206434Z [2024-05-11T00:51:00.285+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:51:00+00:00, run_after=2024-05-11T00:52:00+00:00 2024-05-11T00:51:00.293589257Z [2024-05-11T00:51:00.293+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:51:00.356144750Z [2024-05-11T00:51:00.355+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:51:00.356196826Z 2024-05-11T00:51:00.356203709Z 2024-05-11T00:51:00.356209358Z 2024-05-11T00:51:00.356214709Z [2024-05-11T00:51:00.356+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:51:00.356238863Z [2024-05-11T00:51:00.356+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:51:00.356370895Z [2024-05-11T00:51:00.356+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:51:00.356942843Z [2024-05-11T00:51:00.356+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:51:00.356953205Z 2024-05-11T00:51:00.356958816Z 2024-05-11T00:51:00.356964126Z 2024-05-11T00:51:00.360550685Z [2024-05-11T00:51:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:51:00.360569559Z [2024-05-11T00:51:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:51:00.360575738Z [2024-05-11T00:51:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:51:00.360582470Z [2024-05-11T00:51:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:51:00.360596841Z [2024-05-11T00:51:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:51:00.360663092Z [2024-05-11T00:51:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:51:00.624276035Z [2024-05-11T00:51:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:51:00.624454254Z [2024-05-11T00:51:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:51:00.624613930Z [2024-05-11T00:51:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:51:00.632001001Z [2024-05-11T00:51:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5045daf9-f8a4-4615-8ebf-b51a4adeb8fd 2024-05-11T00:51:00.632029204Z [2024-05-11T00:51:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f9d9476-6eab-4343-a350-5f3c132ce31a 2024-05-11T00:51:00.632155171Z [2024-05-11T00:51:00.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4742057b-ea59-4c63-8906-54a7566e27df 2024-05-11T00:51:01.779442388Z [2024-05-11T00:51:01.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:51:01.779840043Z [2024-05-11T00:51:01.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:50:00+00:00, run_id=scheduled__2024-05-11T00:50:00+00:00, run_start_date=2024-05-11 00:51:00.304375+00:00, run_end_date=2024-05-11 00:51:01.779350+00:00, run_duration=1.474975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:50:00+00:00, data_interval_end=2024-05-11 00:51:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:51:01.789278794Z [2024-05-11T00:51:01.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:51:00+00:00, run_after=2024-05-11T00:52:00+00:00 2024-05-11T00:51:01.838685617Z [2024-05-11T00:51:01.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:51:01.845489692Z [2024-05-11T00:51:01.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:51:01.246975+00:00, run_end_date=2024-05-11 00:51:01.623961+00:00, run_duration=0.376986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:51:00.357727+00:00, queued_by_job_id=2, pid=9302 2024-05-11T00:51:04.666705699Z [2024-05-11T00:51:04.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:51:04.667056486Z [2024-05-11T00:51:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:50:00+00:00, run_id=scheduled__2024-05-11T00:50:00+00:00, run_start_date=2024-05-11 00:51:00.305586+00:00, run_end_date=2024-05-11 00:51:04.666515+00:00, run_duration=4.360929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:50:00+00:00, data_interval_end=2024-05-11 00:51:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:51:04.679212433Z [2024-05-11T00:51:04.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:51:00+00:00, run_after=2024-05-11T00:52:00+00:00 2024-05-11T00:51:04.687796665Z [2024-05-11T00:51:04.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:51:04.688028648Z [2024-05-11T00:51:04.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:50:00+00:00, run_id=scheduled__2024-05-11T00:50:00+00:00, run_start_date=2024-05-11 00:51:00.306623+00:00, run_end_date=2024-05-11 00:51:04.687603+00:00, run_duration=4.38098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:50:00+00:00, data_interval_end=2024-05-11 00:51:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:51:04.697221695Z [2024-05-11T00:51:04.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:51:00+00:00, run_after=2024-05-11T00:52:00+00:00 2024-05-11T00:51:04.752700435Z [2024-05-11T00:51:04.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:51:04.753129176Z [2024-05-11T00:51:04.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:51:04.764653114Z [2024-05-11T00:51:04.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:51:02.190591+00:00, run_end_date=2024-05-11 00:51:04.432498+00:00, run_duration=2.241907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:51:00.357727+00:00, queued_by_job_id=2, pid=9320 2024-05-11T00:51:04.764861724Z [2024-05-11T00:51:04.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:51:02.187961+00:00, run_end_date=2024-05-11 00:51:03.751748+00:00, run_duration=1.563787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:51:00.357727+00:00, queued_by_job_id=2, pid=9321 2024-05-11T00:52:00.125361177Z [2024-05-11T00:52:00.125+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:52:00.145455358Z [2024-05-11T00:52:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:52:00+00:00, run_after=2024-05-11T00:53:00+00:00 2024-05-11T00:52:00.158182453Z [2024-05-11T00:52:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:52:00+00:00, run_after=2024-05-11T00:53:00+00:00 2024-05-11T00:52:00.164535296Z [2024-05-11T00:52:00.164+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:52:00.238911593Z [2024-05-11T00:52:00.238+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:52:00.238935200Z 2024-05-11T00:52:00.238943336Z 2024-05-11T00:52:00.238946684Z 2024-05-11T00:52:00.238949820Z 2024-05-11T00:52:00.239261114Z [2024-05-11T00:52:00.239+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:52:00.239478177Z [2024-05-11T00:52:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:52:00.239663085Z [2024-05-11T00:52:00.239+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:52:00.239828885Z [2024-05-11T00:52:00.239+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:52:00.240415646Z [2024-05-11T00:52:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:52:00.240429474Z 2024-05-11T00:52:00.240433100Z 2024-05-11T00:52:00.240436251Z 2024-05-11T00:52:00.240439258Z 2024-05-11T00:52:00.243728874Z [2024-05-11T00:52:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:52:00.244044699Z [2024-05-11T00:52:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:52:00.244587472Z [2024-05-11T00:52:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:52:00.244837488Z [2024-05-11T00:52:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:52:00.245171081Z [2024-05-11T00:52:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:52:00.245391283Z [2024-05-11T00:52:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:52:00.245708885Z [2024-05-11T00:52:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:52:00.245969361Z [2024-05-11T00:52:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:52:00.652778096Z [2024-05-11T00:52:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:52:00.653071630Z [2024-05-11T00:52:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:51:00+00:00 exited with status queued for try_number 1 2024-05-11T00:52:00.653289298Z [2024-05-11T00:52:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:51:00+00:00 exited with status queued for try_number 1 2024-05-11T00:52:00.653477236Z [2024-05-11T00:52:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:51:00+00:00 exited with status queued for try_number 1 2024-05-11T00:52:00.664043702Z [2024-05-11T00:52:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75e14185-44d1-489a-a7f6-9d20aaac317a 2024-05-11T00:52:00.664412415Z [2024-05-11T00:52:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16dd0b82-89bd-4ed4-9d92-fbadc3a29783 2024-05-11T00:52:00.664803786Z [2024-05-11T00:52:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7e7034a-0693-44a6-a6b2-a533cb7d6831 2024-05-11T00:52:00.665074219Z [2024-05-11T00:52:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00136c92-bd70-4f06-807a-018ff438fe28 2024-05-11T00:52:02.839336766Z [2024-05-11T00:52:02.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:52:02.839662887Z [2024-05-11T00:52:02.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:50:00+00:00, run_id=scheduled__2024-05-11T00:50:00+00:00, run_start_date=2024-05-11 00:52:00.174860+00:00, run_end_date=2024-05-11 00:52:02.839184+00:00, run_duration=2.664324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:50:00+00:00, data_interval_end=2024-05-11 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:52:02.850293196Z [2024-05-11T00:52:02.849+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:52:00+00:00, run_after=2024-05-11T00:54:00+00:00 2024-05-11T00:52:02.864611568Z [2024-05-11T00:52:02.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:52:02.864720755Z [2024-05-11T00:52:02.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:51:00+00:00, run_id=scheduled__2024-05-11T00:51:00+00:00, run_start_date=2024-05-11 00:52:00.176025+00:00, run_end_date=2024-05-11 00:52:02.864427+00:00, run_duration=2.688402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:51:00+00:00, data_interval_end=2024-05-11 00:52:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:52:02.885933268Z [2024-05-11T00:52:02.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:52:00+00:00, run_after=2024-05-11T00:53:00+00:00 2024-05-11T00:52:02.942155610Z [2024-05-11T00:52:02.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:52:02.942233108Z [2024-05-11T00:52:02.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:51:00+00:00 exited with status success for try_number 1 2024-05-11T00:52:02.949581474Z [2024-05-11T00:52:02.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:52:01.376391+00:00, run_end_date=2024-05-11 00:52:01.701244+00:00, run_duration=0.324853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:52:00.241335+00:00, queued_by_job_id=2, pid=9354 2024-05-11T00:52:02.949688405Z [2024-05-11T00:52:02.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:51:00+00:00, map_index=-1, run_start_date=2024-05-11 00:52:01.536240+00:00, run_end_date=2024-05-11 00:52:01.936204+00:00, run_duration=0.399964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:52:00.241335+00:00, queued_by_job_id=2, pid=9355 2024-05-11T00:52:05.121698683Z [2024-05-11T00:52:05.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:52:05.122040131Z [2024-05-11T00:52:05.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:51:00+00:00, run_id=scheduled__2024-05-11T00:51:00+00:00, run_start_date=2024-05-11 00:52:00.177944+00:00, run_end_date=2024-05-11 00:52:05.121580+00:00, run_duration=4.943636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:51:00+00:00, data_interval_end=2024-05-11 00:52:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:52:05.130905613Z [2024-05-11T00:52:05.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:52:00+00:00, run_after=2024-05-11T00:53:00+00:00 2024-05-11T00:52:05.138901245Z [2024-05-11T00:52:05.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:52:05.139020125Z [2024-05-11T00:52:05.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:51:00+00:00, run_id=scheduled__2024-05-11T00:51:00+00:00, run_start_date=2024-05-11 00:52:00.176997+00:00, run_end_date=2024-05-11 00:52:05.138715+00:00, run_duration=4.961718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:51:00+00:00, data_interval_end=2024-05-11 00:52:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:52:05.155400867Z [2024-05-11T00:52:05.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:52:00+00:00, run_after=2024-05-11T00:53:00+00:00 2024-05-11T00:52:05.231167116Z [2024-05-11T00:52:05.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:51:00+00:00 exited with status success for try_number 1 2024-05-11T00:52:05.231211880Z [2024-05-11T00:52:05.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:51:00+00:00 exited with status success for try_number 1 2024-05-11T00:52:05.238245272Z [2024-05-11T00:52:05.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:51:00+00:00, map_index=-1, run_start_date=2024-05-11 00:52:03.217435+00:00, run_end_date=2024-05-11 00:52:04.705830+00:00, run_duration=1.488395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:52:00.241335+00:00, queued_by_job_id=2, pid=9384 2024-05-11T00:52:05.238394022Z [2024-05-11T00:52:05.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:51:00+00:00, map_index=-1, run_start_date=2024-05-11 00:52:02.655973+00:00, run_end_date=2024-05-11 00:52:04.282373+00:00, run_duration=1.6264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:52:00.241335+00:00, queued_by_job_id=2, pid=9373 2024-05-11T00:53:00.376515412Z [2024-05-11T00:53:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:53:00+00:00, run_after=2024-05-11T00:54:00+00:00 2024-05-11T00:53:00.387705017Z [2024-05-11T00:53:00.387+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:53:00.400923558Z [2024-05-11T00:53:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:53:00+00:00, run_after=2024-05-11T00:54:00+00:00 2024-05-11T00:53:00.469906324Z [2024-05-11T00:53:00.469+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:53:00.469937420Z 2024-05-11T00:53:00.469941235Z 2024-05-11T00:53:00.469944443Z 2024-05-11T00:53:00.470385401Z [2024-05-11T00:53:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:53:00.470782406Z [2024-05-11T00:53:00.470+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:53:00.471135836Z [2024-05-11T00:53:00.470+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:53:00.473380247Z [2024-05-11T00:53:00.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:53:00.473394659Z 2024-05-11T00:53:00.473399424Z 2024-05-11T00:53:00.473402567Z 2024-05-11T00:53:00.479840903Z [2024-05-11T00:53:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:53:00.480221225Z [2024-05-11T00:53:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:53:00.480696512Z [2024-05-11T00:53:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:53:00.480950375Z [2024-05-11T00:53:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:53:00.481334853Z [2024-05-11T00:53:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:53:00.481592539Z [2024-05-11T00:53:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:53:00.803190139Z [2024-05-11T00:53:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status queued for try_number 1 2024-05-11T00:53:00.803277955Z [2024-05-11T00:53:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status queued for try_number 1 2024-05-11T00:53:00.803296384Z [2024-05-11T00:53:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status queued for try_number 1 2024-05-11T00:53:00.812935371Z [2024-05-11T00:53:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c14df5a-34db-4f60-b846-2b282dace8f7 2024-05-11T00:53:00.812967667Z [2024-05-11T00:53:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ebe5223-9a73-4e8b-81e4-1021fa289840 2024-05-11T00:53:00.813093332Z [2024-05-11T00:53:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2410e44b-695e-4cd5-bd63-d5b0f7b1a015 2024-05-11T00:53:01.967277680Z [2024-05-11T00:53:01.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:53:01.967507316Z [2024-05-11T00:53:01.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:52:00+00:00, run_id=scheduled__2024-05-11T00:52:00+00:00, run_start_date=2024-05-11 00:53:00.410825+00:00, run_end_date=2024-05-11 00:53:01.967192+00:00, run_duration=1.556367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:52:00+00:00, data_interval_end=2024-05-11 00:53:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:53:01.976575459Z [2024-05-11T00:53:01.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:53:00+00:00, run_after=2024-05-11T00:54:00+00:00 2024-05-11T00:53:02.026686096Z [2024-05-11T00:53:02.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status success for try_number 1 2024-05-11T00:53:02.035944887Z [2024-05-11T00:53:02.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:52:00+00:00, map_index=-1, run_start_date=2024-05-11 00:53:01.551198+00:00, run_end_date=2024-05-11 00:53:01.865121+00:00, run_duration=0.313923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:53:00.475448+00:00, queued_by_job_id=2, pid=9411 2024-05-11T00:53:04.463891464Z [2024-05-11T00:53:04.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:53:04.464041628Z [2024-05-11T00:53:04.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:52:00+00:00, run_id=scheduled__2024-05-11T00:52:00+00:00, run_start_date=2024-05-11 00:53:00.411935+00:00, run_end_date=2024-05-11 00:53:04.463793+00:00, run_duration=4.051858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:52:00+00:00, data_interval_end=2024-05-11 00:53:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:53:04.473562631Z [2024-05-11T00:53:04.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:53:00+00:00, run_after=2024-05-11T00:54:00+00:00 2024-05-11T00:53:04.480291705Z [2024-05-11T00:53:04.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:53:04.480366166Z [2024-05-11T00:53:04.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:52:00+00:00, run_id=scheduled__2024-05-11T00:52:00+00:00, run_start_date=2024-05-11 00:53:00.412924+00:00, run_end_date=2024-05-11 00:53:04.480031+00:00, run_duration=4.067107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:52:00+00:00, data_interval_end=2024-05-11 00:53:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:53:04.491494574Z [2024-05-11T00:53:04.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:53:00+00:00, run_after=2024-05-11T00:54:00+00:00 2024-05-11T00:53:04.529234325Z [2024-05-11T00:53:04.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status success for try_number 1 2024-05-11T00:53:04.529393273Z [2024-05-11T00:53:04.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status success for try_number 1 2024-05-11T00:53:04.539215441Z [2024-05-11T00:53:04.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:52:00+00:00, map_index=-1, run_start_date=2024-05-11 00:53:02.486925+00:00, run_end_date=2024-05-11 00:53:03.652385+00:00, run_duration=1.16546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:53:00.475448+00:00, queued_by_job_id=2, pid=9430 2024-05-11T00:53:04.539531272Z [2024-05-11T00:53:04.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:52:00+00:00, map_index=-1, run_start_date=2024-05-11 00:53:02.431381+00:00, run_end_date=2024-05-11 00:53:04.003138+00:00, run_duration=1.571757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:53:00.475448+00:00, queued_by_job_id=2, pid=9429 2024-05-11T00:54:00.614006160Z [2024-05-11T00:54:00.612+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:54:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:54:00.625401046Z [2024-05-11T00:54:00.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:54:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:54:00.631355447Z [2024-05-11T00:54:00.631+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:54:00.637985488Z [2024-05-11T00:54:00.637+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:54:00.727085809Z [2024-05-11T00:54:00.726+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:54:00.727113317Z 2024-05-11T00:54:00.727120042Z 2024-05-11T00:54:00.727124376Z 2024-05-11T00:54:00.727128870Z 2024-05-11T00:54:00.727383866Z [2024-05-11T00:54:00.726+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:54:00.727651382Z [2024-05-11T00:54:00.727+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:54:00.727890358Z [2024-05-11T00:54:00.727+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:54:00.728118795Z [2024-05-11T00:54:00.727+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:54:00.729081034Z [2024-05-11T00:54:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:54:00.729097155Z 2024-05-11T00:54:00.729102250Z 2024-05-11T00:54:00.729106530Z 2024-05-11T00:54:00.729129120Z 2024-05-11T00:54:00.733007733Z [2024-05-11T00:54:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:54:00.733205378Z [2024-05-11T00:54:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:54:00.733592295Z [2024-05-11T00:54:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:54:00.733810627Z [2024-05-11T00:54:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:54:00.734168828Z [2024-05-11T00:54:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:54:00.734398484Z [2024-05-11T00:54:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:54:00.734735620Z [2024-05-11T00:54:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:54:00.734968608Z [2024-05-11T00:54:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:54:01.258717912Z [2024-05-11T00:54:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status queued for try_number 1 2024-05-11T00:54:01.258967984Z [2024-05-11T00:54:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:53:00+00:00 exited with status queued for try_number 1 2024-05-11T00:54:01.259159978Z [2024-05-11T00:54:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:53:00+00:00 exited with status queued for try_number 1 2024-05-11T00:54:01.259341421Z [2024-05-11T00:54:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:53:00+00:00 exited with status queued for try_number 1 2024-05-11T00:54:01.273973062Z [2024-05-11T00:54:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74babc61-4fd6-40ae-8313-5052b97b1a2d 2024-05-11T00:54:01.278365876Z [2024-05-11T00:54:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4fb5ebe-02b2-4d0d-ac82-097deebe6ce0 2024-05-11T00:54:01.278676624Z [2024-05-11T00:54:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48643e97-7781-443a-ab3d-5136c0b3bdbb 2024-05-11T00:54:01.278908518Z [2024-05-11T00:54:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0425ca9-327a-4cf7-8640-a1f52796866d 2024-05-11T00:54:02.436589350Z [2024-05-11T00:54:02.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:54:02.437256413Z [2024-05-11T00:54:02.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:52:00+00:00, run_id=scheduled__2024-05-11T00:52:00+00:00, run_start_date=2024-05-11 00:54:00.657965+00:00, run_end_date=2024-05-11 00:54:02.436766+00:00, run_duration=1.778801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:52:00+00:00, data_interval_end=2024-05-11 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:54:02.450151087Z [2024-05-11T00:54:02.449+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:54:00+00:00, run_after=2024-05-11T00:56:00+00:00 2024-05-11T00:54:02.460662989Z [2024-05-11T00:54:02.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:54:02.461282454Z [2024-05-11T00:54:02.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:53:00+00:00, run_id=scheduled__2024-05-11T00:53:00+00:00, run_start_date=2024-05-11 00:54:00.659876+00:00, run_end_date=2024-05-11 00:54:02.460950+00:00, run_duration=1.801074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:53:00+00:00, data_interval_end=2024-05-11 00:54:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:54:02.473470222Z [2024-05-11T00:54:02.473+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:54:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:54:02.582777455Z [2024-05-11T00:54:02.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:52:00+00:00 exited with status success for try_number 1 2024-05-11T00:54:02.582835300Z [2024-05-11T00:54:02.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:53:00+00:00 exited with status success for try_number 1 2024-05-11T00:54:02.591536109Z [2024-05-11T00:54:02.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:53:00+00:00, map_index=-1, run_start_date=2024-05-11 00:54:01.939084+00:00, run_end_date=2024-05-11 00:54:02.443498+00:00, run_duration=0.504414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:54:00.730215+00:00, queued_by_job_id=2, pid=9468 2024-05-11T00:54:02.591649080Z [2024-05-11T00:54:02.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:52:00+00:00, map_index=-1, run_start_date=2024-05-11 00:54:01.663802+00:00, run_end_date=2024-05-11 00:54:01.999395+00:00, run_duration=0.335593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:54:00.730215+00:00, queued_by_job_id=2, pid=9462 2024-05-11T00:54:04.917735030Z [2024-05-11T00:54:04.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:54:04.918161150Z [2024-05-11T00:54:04.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:53:00+00:00, run_id=scheduled__2024-05-11T00:53:00+00:00, run_start_date=2024-05-11 00:54:00.661953+00:00, run_end_date=2024-05-11 00:54:04.917669+00:00, run_duration=4.255716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:53:00+00:00, data_interval_end=2024-05-11 00:54:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:54:04.932007304Z [2024-05-11T00:54:04.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:54:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:54:04.941893915Z [2024-05-11T00:54:04.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:54:04.943780703Z [2024-05-11T00:54:04.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:53:00+00:00, run_id=scheduled__2024-05-11T00:53:00+00:00, run_start_date=2024-05-11 00:54:00.663600+00:00, run_end_date=2024-05-11 00:54:04.941775+00:00, run_duration=4.278175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:53:00+00:00, data_interval_end=2024-05-11 00:54:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:54:04.964282823Z [2024-05-11T00:54:04.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:54:00+00:00, run_after=2024-05-11T00:55:00+00:00 2024-05-11T00:54:05.041614478Z [2024-05-11T00:54:05.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:53:00+00:00 exited with status success for try_number 1 2024-05-11T00:54:05.041843079Z [2024-05-11T00:54:05.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:53:00+00:00 exited with status success for try_number 1 2024-05-11T00:54:05.048277861Z [2024-05-11T00:54:05.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:53:00+00:00, map_index=-1, run_start_date=2024-05-11 00:54:03.033158+00:00, run_end_date=2024-05-11 00:54:04.446338+00:00, run_duration=1.41318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:54:00.730215+00:00, queued_by_job_id=2, pid=9487 2024-05-11T00:54:05.048567724Z [2024-05-11T00:54:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:53:00+00:00, map_index=-1, run_start_date=2024-05-11 00:54:02.952717+00:00, run_end_date=2024-05-11 00:54:04.714484+00:00, run_duration=1.761767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:54:00.730215+00:00, queued_by_job_id=2, pid=9486 2024-05-11T00:55:00.870706295Z [2024-05-11T00:55:00.870+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:55:00.882654959Z [2024-05-11T00:55:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T00:56:00+00:00 2024-05-11T00:55:00.898984175Z [2024-05-11T00:55:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:55:00.910404552Z [2024-05-11T00:55:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T00:56:00+00:00 2024-05-11T00:55:01.023513480Z [2024-05-11T00:55:01.023+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:55:01.023538330Z 2024-05-11T00:55:01.023546171Z 2024-05-11T00:55:01.023550027Z 2024-05-11T00:55:01.023553362Z 2024-05-11T00:55:01.026746164Z [2024-05-11T00:55:01.023+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:55:01.026767442Z [2024-05-11T00:55:01.023+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:55:01.026770762Z [2024-05-11T00:55:01.024+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:55:01.026773869Z [2024-05-11T00:55:01.024+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:55:01.026777360Z [2024-05-11T00:55:01.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:55:01.026781651Z 2024-05-11T00:55:01.026796904Z 2024-05-11T00:55:01.026800002Z 2024-05-11T00:55:01.026802934Z 2024-05-11T00:55:01.034141474Z [2024-05-11T00:55:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T00:55:01.034176408Z [2024-05-11T00:55:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:55:01.034179976Z [2024-05-11T00:55:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:55:01.034183793Z [2024-05-11T00:55:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:55:01.034187077Z [2024-05-11T00:55:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:55:01.034190747Z [2024-05-11T00:55:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:55:01.034193968Z [2024-05-11T00:55:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:55:01.034197042Z [2024-05-11T00:55:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:55:01.526906348Z [2024-05-11T00:55:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:01.526954413Z [2024-05-11T00:55:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:01.527043335Z [2024-05-11T00:55:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:01.527202550Z [2024-05-11T00:55:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:01.540714248Z [2024-05-11T00:55:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94f3f3e6-6c29-4792-96f4-e919d2481e00 2024-05-11T00:55:01.540830888Z [2024-05-11T00:55:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8b8a9a5-385b-4e34-acd7-5f7acab45ea5 2024-05-11T00:55:01.540983396Z [2024-05-11T00:55:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to d081ff3c-0450-4814-9fbd-ba49fdd95457 2024-05-11T00:55:01.541109040Z [2024-05-11T00:55:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63200cd4-6f6a-4cee-9d96-20692f5b768c 2024-05-11T00:55:02.811697814Z [2024-05-11T00:55:02.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:55:02.812523310Z [2024-05-11T00:55:02.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:54:00+00:00, run_id=scheduled__2024-05-11T00:54:00+00:00, run_start_date=2024-05-11 00:55:00.924571+00:00, run_end_date=2024-05-11 00:55:02.811633+00:00, run_duration=1.887062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:54:00+00:00, data_interval_end=2024-05-11 00:55:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:55:02.833145219Z [2024-05-11T00:55:02.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T00:56:00+00:00 2024-05-11T00:55:02.894990758Z [2024-05-11T00:55:02.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:02.903276357Z [2024-05-11T00:55:02.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:54:00+00:00, map_index=-1, run_start_date=2024-05-11 00:55:02.107555+00:00, run_end_date=2024-05-11 00:55:02.488827+00:00, run_duration=0.381272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:01.025593+00:00, queued_by_job_id=2, pid=9520 2024-05-11T00:55:03.998190206Z [2024-05-11T00:55:03.997+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:55:03.998248185Z 2024-05-11T00:55:03.998318417Z [2024-05-11T00:55:03.998+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:55:03.999473294Z [2024-05-11T00:55:03.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:55:03.999501984Z 2024-05-11T00:55:04.008232013Z [2024-05-11T00:55:04.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T00:55:04.009030070Z [2024-05-11T00:55:04.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:55:04.095801605Z [2024-05-11T00:55:04.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:04.095841344Z [2024-05-11T00:55:04.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:04.104049521Z [2024-05-11T00:55:04.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a707bf2-fb1f-4efd-af2f-353b587f3f36 2024-05-11T00:55:04.104151453Z [2024-05-11T00:55:04.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:55:03.311172+00:00, run_end_date=2024-05-11 00:55:03.706275+00:00, run_duration=0.395103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:01.025593+00:00, queued_by_job_id=2, pid=9545 2024-05-11T00:55:05.414130032Z [2024-05-11T00:55:05.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:55:05.414992976Z [2024-05-11T00:55:05.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:54:00+00:00, run_id=scheduled__2024-05-11T00:54:00+00:00, run_start_date=2024-05-11 00:55:00.926165+00:00, run_end_date=2024-05-11 00:55:05.414590+00:00, run_duration=4.488425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:54:00+00:00, data_interval_end=2024-05-11 00:55:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:55:05.424057852Z [2024-05-11T00:55:05.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T00:56:00+00:00 2024-05-11T00:55:05.432091318Z [2024-05-11T00:55:05.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:55:05.432671218Z [2024-05-11T00:55:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:54:00+00:00, run_id=scheduled__2024-05-11T00:54:00+00:00, run_start_date=2024-05-11 00:55:00.927798+00:00, run_end_date=2024-05-11 00:55:05.431971+00:00, run_duration=4.504173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:54:00+00:00, data_interval_end=2024-05-11 00:55:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:55:05.443699668Z [2024-05-11T00:55:05.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T00:56:00+00:00 2024-05-11T00:55:05.489214789Z [2024-05-11T00:55:05.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:05.490073991Z [2024-05-11T00:55:05.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:05.498281174Z [2024-05-11T00:55:05.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:54:00+00:00, map_index=-1, run_start_date=2024-05-11 00:55:03.248266+00:00, run_end_date=2024-05-11 00:55:04.500705+00:00, run_duration=1.252439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:01.025593+00:00, queued_by_job_id=2, pid=9544 2024-05-11T00:55:05.498580684Z [2024-05-11T00:55:05.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:54:00+00:00, map_index=-1, run_start_date=2024-05-11 00:55:03.353485+00:00, run_end_date=2024-05-11 00:55:05.063629+00:00, run_duration=1.710144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:01.025593+00:00, queued_by_job_id=2, pid=9546 2024-05-11T00:55:06.585660143Z [2024-05-11T00:55:06.585+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:55:06.585688853Z 2024-05-11T00:55:06.585939010Z [2024-05-11T00:55:06.585+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:55:06.586598495Z [2024-05-11T00:55:06.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:55:06.586612537Z 2024-05-11T00:55:06.589000836Z [2024-05-11T00:55:06.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T00:55:06.589225570Z [2024-05-11T00:55:06.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:55:06.704630988Z [2024-05-11T00:55:06.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:06.704893891Z [2024-05-11T00:55:06.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:06.712286768Z [2024-05-11T00:55:06.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2179f6b3-a2cd-4ab2-978a-c28fb5fb9fd5 2024-05-11T00:55:06.712605236Z [2024-05-11T00:55:06.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:55:05.591741+00:00, run_end_date=2024-05-11 00:55:05.935124+00:00, run_duration=0.343383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:03.999974+00:00, queued_by_job_id=2, pid=9580 2024-05-11T00:55:08.988232553Z [2024-05-11T00:55:08.987+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T00:55:08.988279835Z 2024-05-11T00:55:08.988291092Z [2024-05-11T00:55:08.987+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:55:08.988667614Z [2024-05-11T00:55:08.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:55:08.988689727Z 2024-05-11T00:55:08.990812214Z [2024-05-11T00:55:08.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:55:08.990826318Z [2024-05-11T00:55:08.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:55:09.038567432Z [2024-05-11T00:55:09.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status queued for try_number 1 2024-05-11T00:55:09.038629238Z [2024-05-11T00:55:09.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:09.044576640Z [2024-05-11T00:55:09.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd55cc45-231b-481e-8ae4-548c92be7be2 2024-05-11T00:55:09.044742653Z [2024-05-11T00:55:09.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=0, run_start_date=2024-05-11 00:55:08.386789+00:00, run_end_date=2024-05-11 00:55:08.752169+00:00, run_duration=0.36538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:06.587132+00:00, queued_by_job_id=2, pid=9591 2024-05-11T00:55:11.578534312Z [2024-05-11T00:55:11.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:55:11.579023433Z [2024-05-11T00:55:11.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:50:00+00:00, run_id=scheduled__2024-05-11T00:50:00+00:00, run_start_date=2024-05-11 00:55:00.922768+00:00, run_end_date=2024-05-11 00:55:11.578721+00:00, run_duration=10.655953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:50:00+00:00, data_interval_end=2024-05-11 00:55:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T00:55:11.584666823Z [2024-05-11T00:55:11.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:55:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:55:11.617494555Z [2024-05-11T00:55:11.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:50:00+00:00 exited with status success for try_number 1 2024-05-11T00:55:11.623831417Z [2024-05-11T00:55:11.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:50:00+00:00, map_index=-1, run_start_date=2024-05-11 00:55:10.521448+00:00, run_end_date=2024-05-11 00:55:10.868908+00:00, run_duration=0.34746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:55:08.988869+00:00, queued_by_job_id=2, pid=9599 2024-05-11T00:55:35.147610194Z [2024-05-11T00:55:35.147+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T00:56:00.029027455Z [2024-05-11T00:56:00.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:56:00+00:00, run_after=2024-05-11T00:57:00+00:00 2024-05-11T00:56:00.036700227Z [2024-05-11T00:56:00.035+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:56:00.045930833Z [2024-05-11T00:56:00.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:56:00.065967272Z [2024-05-11T00:56:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:56:00+00:00, run_after=2024-05-11T00:57:00+00:00 2024-05-11T00:56:00.152965061Z [2024-05-11T00:56:00.152+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:56:00.152991786Z 2024-05-11T00:56:00.152995950Z 2024-05-11T00:56:00.153014248Z 2024-05-11T00:56:00.153017498Z 2024-05-11T00:56:00.153140431Z [2024-05-11T00:56:00.152+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:56:00.153357331Z [2024-05-11T00:56:00.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:56:00.153550663Z [2024-05-11T00:56:00.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:56:00.153716705Z [2024-05-11T00:56:00.153+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:56:00.154505275Z [2024-05-11T00:56:00.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:56:00.154516244Z 2024-05-11T00:56:00.154519508Z 2024-05-11T00:56:00.154522497Z 2024-05-11T00:56:00.154525390Z 2024-05-11T00:56:00.159280488Z [2024-05-11T00:56:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:56:00.159513023Z [2024-05-11T00:56:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:56:00.159958351Z [2024-05-11T00:56:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:56:00.160222721Z [2024-05-11T00:56:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:56:00.160500793Z [2024-05-11T00:56:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:56:00.160644151Z [2024-05-11T00:56:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:56:00.160871094Z [2024-05-11T00:56:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:56:00.160995988Z [2024-05-11T00:56:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:56:00.731053493Z [2024-05-11T00:56:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status queued for try_number 1 2024-05-11T00:56:00.731135315Z [2024-05-11T00:56:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:56:00.731140410Z [2024-05-11T00:56:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:56:00.731183477Z [2024-05-11T00:56:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T00:56:00.755395276Z [2024-05-11T00:56:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to f510658b-4520-4aae-8937-3e13c8ef9d52 2024-05-11T00:56:00.755483842Z [2024-05-11T00:56:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4782c71-929e-4ab3-910e-6376c0a57d53 2024-05-11T00:56:00.755542833Z [2024-05-11T00:56:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d0cec69-530c-4e4b-8156-6093d8dbf340 2024-05-11T00:56:00.755665897Z [2024-05-11T00:56:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 554c6c68-21ff-4198-80c1-e01389c8bd09 2024-05-11T00:56:02.063104722Z [2024-05-11T00:56:02.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:56:02.063627674Z [2024-05-11T00:56:02.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:54:00+00:00, run_id=scheduled__2024-05-11T00:54:00+00:00, run_start_date=2024-05-11 00:56:00.081429+00:00, run_end_date=2024-05-11 00:56:02.063180+00:00, run_duration=1.981751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:54:00+00:00, data_interval_end=2024-05-11 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:56:02.077120720Z [2024-05-11T00:56:02.076+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:56:00+00:00, run_after=2024-05-11T00:58:00+00:00 2024-05-11T00:56:02.087419879Z [2024-05-11T00:56:02.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:56:02.087856180Z [2024-05-11T00:56:02.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:55:00+00:00, run_id=scheduled__2024-05-11T00:55:00+00:00, run_start_date=2024-05-11 00:56:00.082620+00:00, run_end_date=2024-05-11 00:56:02.087373+00:00, run_duration=2.004753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:55:00+00:00, data_interval_end=2024-05-11 00:56:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:56:02.105298355Z [2024-05-11T00:56:02.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:56:00+00:00, run_after=2024-05-11T00:57:00+00:00 2024-05-11T00:56:02.194899890Z [2024-05-11T00:56:02.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:54:00+00:00 exited with status success for try_number 1 2024-05-11T00:56:02.195148175Z [2024-05-11T00:56:02.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:56:02.204627926Z [2024-05-11T00:56:02.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:54:00+00:00, map_index=-1, run_start_date=2024-05-11 00:56:00.963795+00:00, run_end_date=2024-05-11 00:56:01.453060+00:00, run_duration=0.489265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:56:00.155700+00:00, queued_by_job_id=2, pid=9609 2024-05-11T00:56:02.205169360Z [2024-05-11T00:56:02.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=-1, run_start_date=2024-05-11 00:56:01.194008+00:00, run_end_date=2024-05-11 00:56:01.615061+00:00, run_duration=0.421053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:56:00.155700+00:00, queued_by_job_id=2, pid=9610 2024-05-11T00:56:04.339144626Z [2024-05-11T00:56:04.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:56:04.339477889Z [2024-05-11T00:56:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:55:00+00:00, run_id=scheduled__2024-05-11T00:55:00+00:00, run_start_date=2024-05-11 00:56:00.084585+00:00, run_end_date=2024-05-11 00:56:04.339032+00:00, run_duration=4.254447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:55:00+00:00, data_interval_end=2024-05-11 00:56:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:56:04.348372192Z [2024-05-11T00:56:04.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:56:00+00:00, run_after=2024-05-11T00:57:00+00:00 2024-05-11T00:56:04.354502657Z [2024-05-11T00:56:04.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:56:04.354847253Z [2024-05-11T00:56:04.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:55:00+00:00, run_id=scheduled__2024-05-11T00:55:00+00:00, run_start_date=2024-05-11 00:56:00.083585+00:00, run_end_date=2024-05-11 00:56:04.354424+00:00, run_duration=4.270839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:55:00+00:00, data_interval_end=2024-05-11 00:56:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:56:04.364230534Z [2024-05-11T00:56:04.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:56:00+00:00, run_after=2024-05-11T00:57:00+00:00 2024-05-11T00:56:04.391855013Z [2024-05-11T00:56:04.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:56:04.392073949Z [2024-05-11T00:56:04.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T00:56:04.397818466Z [2024-05-11T00:56:04.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=-1, run_start_date=2024-05-11 00:56:02.103576+00:00, run_end_date=2024-05-11 00:56:03.449078+00:00, run_duration=1.345502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:56:00.155700+00:00, queued_by_job_id=2, pid=9633 2024-05-11T00:56:04.398172501Z [2024-05-11T00:56:04.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=-1, run_start_date=2024-05-11 00:56:02.161399+00:00, run_end_date=2024-05-11 00:56:04.251075+00:00, run_duration=2.089676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:56:00.155700+00:00, queued_by_job_id=2, pid=9634 2024-05-11T00:57:00.833110971Z [2024-05-11T00:57:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:57:00.846872189Z [2024-05-11T00:57:00.846+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:57:00+00:00, run_after=2024-05-11T00:58:00+00:00 2024-05-11T00:57:00.860340469Z [2024-05-11T00:57:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:57:00+00:00, run_after=2024-05-11T00:58:00+00:00 2024-05-11T00:57:00.962375134Z [2024-05-11T00:57:00.961+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:57:00.962416785Z 2024-05-11T00:57:00.962423538Z 2024-05-11T00:57:00.962429696Z 2024-05-11T00:57:00.962684837Z [2024-05-11T00:57:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:57:00.963181739Z [2024-05-11T00:57:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:57:00.963773277Z [2024-05-11T00:57:00.963+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:57:00.965269102Z [2024-05-11T00:57:00.964+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:57:00.965293284Z 2024-05-11T00:57:00.965302610Z 2024-05-11T00:57:00.965318597Z 2024-05-11T00:57:00.972685315Z [2024-05-11T00:57:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:57:00.973158018Z [2024-05-11T00:57:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:57:00.973548657Z [2024-05-11T00:57:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:57:00.973821439Z [2024-05-11T00:57:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:57:00.974441525Z [2024-05-11T00:57:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:57:00.974811240Z [2024-05-11T00:57:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:57:01.339665070Z [2024-05-11T00:57:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status queued for try_number 1 2024-05-11T00:57:01.342468358Z [2024-05-11T00:57:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status queued for try_number 1 2024-05-11T00:57:01.343436614Z [2024-05-11T00:57:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status queued for try_number 1 2024-05-11T00:57:01.355002295Z [2024-05-11T00:57:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1821dab8-b6ef-41ce-b986-8f02af9fcb2c 2024-05-11T00:57:01.355335289Z [2024-05-11T00:57:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3ea593d-d708-404c-ad58-ebe4d65cad23 2024-05-11T00:57:01.355564475Z [2024-05-11T00:57:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08065b8c-8b6c-49dc-9134-8ce78ba8bd09 2024-05-11T00:57:02.834597174Z [2024-05-11T00:57:02.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:57:02.835025857Z [2024-05-11T00:57:02.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:56:00+00:00, run_id=scheduled__2024-05-11T00:56:00+00:00, run_start_date=2024-05-11 00:57:00.881771+00:00, run_end_date=2024-05-11 00:57:02.834460+00:00, run_duration=1.952689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:56:00+00:00, data_interval_end=2024-05-11 00:57:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:57:02.844332724Z [2024-05-11T00:57:02.843+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:57:00+00:00, run_after=2024-05-11T00:58:00+00:00 2024-05-11T00:57:02.897974152Z [2024-05-11T00:57:02.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status success for try_number 1 2024-05-11T00:57:02.904338353Z [2024-05-11T00:57:02.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:56:00+00:00, map_index=-1, run_start_date=2024-05-11 00:57:01.829840+00:00, run_end_date=2024-05-11 00:57:02.267394+00:00, run_duration=0.437554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:57:00.967094+00:00, queued_by_job_id=2, pid=9666 2024-05-11T00:57:05.074569999Z [2024-05-11T00:57:05.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:57:05.075294875Z [2024-05-11T00:57:05.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:56:00+00:00, run_id=scheduled__2024-05-11T00:56:00+00:00, run_start_date=2024-05-11 00:57:00.884286+00:00, run_end_date=2024-05-11 00:57:05.074576+00:00, run_duration=4.19029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:56:00+00:00, data_interval_end=2024-05-11 00:57:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:57:05.094703338Z [2024-05-11T00:57:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:57:00+00:00, run_after=2024-05-11T00:58:00+00:00 2024-05-11T00:57:05.106318566Z [2024-05-11T00:57:05.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:57:05.107122963Z [2024-05-11T00:57:05.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:56:00+00:00, run_id=scheduled__2024-05-11T00:56:00+00:00, run_start_date=2024-05-11 00:57:00.886493+00:00, run_end_date=2024-05-11 00:57:05.106458+00:00, run_duration=4.219965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:56:00+00:00, data_interval_end=2024-05-11 00:57:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:57:05.120816769Z [2024-05-11T00:57:05.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:57:00+00:00, run_after=2024-05-11T00:58:00+00:00 2024-05-11T00:57:05.174203352Z [2024-05-11T00:57:05.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status success for try_number 1 2024-05-11T00:57:05.174368375Z [2024-05-11T00:57:05.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status success for try_number 1 2024-05-11T00:57:05.192585783Z [2024-05-11T00:57:05.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:56:00+00:00, map_index=-1, run_start_date=2024-05-11 00:57:02.943119+00:00, run_end_date=2024-05-11 00:57:04.752208+00:00, run_duration=1.809089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:57:00.967094+00:00, queued_by_job_id=2, pid=9685 2024-05-11T00:57:05.192633092Z [2024-05-11T00:57:05.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:56:00+00:00, map_index=-1, run_start_date=2024-05-11 00:57:02.891475+00:00, run_end_date=2024-05-11 00:57:04.752278+00:00, run_duration=1.860803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:57:00.967094+00:00, queued_by_job_id=2, pid=9684 2024-05-11T00:58:00.765048332Z [2024-05-11T00:58:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:58:00+00:00, run_after=2024-05-11T00:59:00+00:00 2024-05-11T00:58:00.773066298Z [2024-05-11T00:58:00.772+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:58:00.781237891Z [2024-05-11T00:58:00.780+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:58:00.801596137Z [2024-05-11T00:58:00.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:58:00+00:00, run_after=2024-05-11T00:59:00+00:00 2024-05-11T00:58:00.899346386Z [2024-05-11T00:58:00.898+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T00:58:00.899390344Z 2024-05-11T00:58:00.899401557Z 2024-05-11T00:58:00.899410081Z 2024-05-11T00:58:00.899418275Z 2024-05-11T00:58:00.899729720Z [2024-05-11T00:58:00.899+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T00:58:00.900196817Z [2024-05-11T00:58:00.899+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:58:00.900711895Z [2024-05-11T00:58:00.900+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:58:00.901443874Z [2024-05-11T00:58:00.900+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:58:00.906218343Z [2024-05-11T00:58:00.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:58:00.906255617Z 2024-05-11T00:58:00.906265474Z 2024-05-11T00:58:00.906274019Z 2024-05-11T00:58:00.906282093Z 2024-05-11T00:58:00.914886964Z [2024-05-11T00:58:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:58:00.915315480Z [2024-05-11T00:58:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:58:00.915883300Z [2024-05-11T00:58:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:58:00.916439649Z [2024-05-11T00:58:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:58:00.916771711Z [2024-05-11T00:58:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:58:00.917073406Z [2024-05-11T00:58:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:58:00.917637165Z [2024-05-11T00:58:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:58:00.918135895Z [2024-05-11T00:58:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:58:01.492354657Z [2024-05-11T00:58:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status queued for try_number 1 2024-05-11T00:58:01.492725927Z [2024-05-11T00:58:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:57:00+00:00 exited with status queued for try_number 1 2024-05-11T00:58:01.492894685Z [2024-05-11T00:58:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:57:00+00:00 exited with status queued for try_number 1 2024-05-11T00:58:01.493031314Z [2024-05-11T00:58:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:57:00+00:00 exited with status queued for try_number 1 2024-05-11T00:58:01.507771909Z [2024-05-11T00:58:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75ec72a4-4f02-4911-9346-ace2b1905dab 2024-05-11T00:58:01.507968872Z [2024-05-11T00:58:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f82dced-67a9-4847-8699-2cb487244cd1 2024-05-11T00:58:01.508151536Z [2024-05-11T00:58:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70a06f73-f908-4159-9c30-4f97bdac9d7e 2024-05-11T00:58:01.508382172Z [2024-05-11T00:58:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f38b030-ecfe-44d3-af26-e0a4d0119503 2024-05-11T00:58:02.653219305Z [2024-05-11T00:58:02.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:58:02.654271749Z [2024-05-11T00:58:02.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:56:00+00:00, run_id=scheduled__2024-05-11T00:56:00+00:00, run_start_date=2024-05-11 00:58:00.815211+00:00, run_end_date=2024-05-11 00:58:02.653622+00:00, run_duration=1.838411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:56:00+00:00, data_interval_end=2024-05-11 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T00:58:02.663548329Z [2024-05-11T00:58:02.663+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T00:58:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:58:02.670855726Z [2024-05-11T00:58:02.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:58:02.671257971Z [2024-05-11T00:58:02.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:57:00+00:00, run_id=scheduled__2024-05-11T00:57:00+00:00, run_start_date=2024-05-11 00:58:00.816632+00:00, run_end_date=2024-05-11 00:58:02.670940+00:00, run_duration=1.854308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:57:00+00:00, data_interval_end=2024-05-11 00:58:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:58:02.682290864Z [2024-05-11T00:58:02.681+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:58:00+00:00, run_after=2024-05-11T00:59:00+00:00 2024-05-11T00:58:02.736358122Z [2024-05-11T00:58:02.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:56:00+00:00 exited with status success for try_number 1 2024-05-11T00:58:02.736621269Z [2024-05-11T00:58:02.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:57:00+00:00 exited with status success for try_number 1 2024-05-11T00:58:02.743653353Z [2024-05-11T00:58:02.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:57:00+00:00, map_index=-1, run_start_date=2024-05-11 00:58:01.870996+00:00, run_end_date=2024-05-11 00:58:02.319720+00:00, run_duration=0.448724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:58:00.909401+00:00, queued_by_job_id=2, pid=9718 2024-05-11T00:58:02.743983625Z [2024-05-11T00:58:02.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:56:00+00:00, map_index=-1, run_start_date=2024-05-11 00:58:01.803593+00:00, run_end_date=2024-05-11 00:58:02.211123+00:00, run_duration=0.40753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:58:00.909401+00:00, queued_by_job_id=2, pid=9717 2024-05-11T00:58:04.923562311Z [2024-05-11T00:58:04.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:58:04.923999930Z [2024-05-11T00:58:04.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:57:00+00:00, run_id=scheduled__2024-05-11T00:57:00+00:00, run_start_date=2024-05-11 00:58:00.817859+00:00, run_end_date=2024-05-11 00:58:04.923410+00:00, run_duration=4.105551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:57:00+00:00, data_interval_end=2024-05-11 00:58:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:58:04.936579217Z [2024-05-11T00:58:04.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:58:00+00:00, run_after=2024-05-11T00:59:00+00:00 2024-05-11T00:58:04.983702507Z [2024-05-11T00:58:04.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:57:00+00:00 exited with status success for try_number 1 2024-05-11T00:58:04.996437138Z [2024-05-11T00:58:04.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:57:00+00:00, map_index=-1, run_start_date=2024-05-11 00:58:02.987001+00:00, run_end_date=2024-05-11 00:58:04.713596+00:00, run_duration=1.726595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:58:00.909401+00:00, queued_by_job_id=2, pid=9742 2024-05-11T00:58:05.682028550Z [2024-05-11T00:58:05.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:58:05.682552423Z [2024-05-11T00:58:05.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:57:00+00:00, run_id=scheduled__2024-05-11T00:57:00+00:00, run_start_date=2024-05-11 00:58:00.819074+00:00, run_end_date=2024-05-11 00:58:05.682186+00:00, run_duration=4.863112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:57:00+00:00, data_interval_end=2024-05-11 00:58:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:58:05.694836968Z [2024-05-11T00:58:05.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:58:00+00:00, run_after=2024-05-11T00:59:00+00:00 2024-05-11T00:58:05.754078532Z [2024-05-11T00:58:05.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:57:00+00:00 exited with status success for try_number 1 2024-05-11T00:58:05.760028648Z [2024-05-11T00:58:05.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:57:00+00:00, map_index=-1, run_start_date=2024-05-11 00:58:02.821221+00:00, run_end_date=2024-05-11 00:58:05.250699+00:00, run_duration=2.429478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:58:00.909401+00:00, queued_by_job_id=2, pid=9741 2024-05-11T00:59:00.652361974Z [2024-05-11T00:59:00.651+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T00:59:00.669845701Z [2024-05-11T00:59:00.669+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:59:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:59:00.683263774Z [2024-05-11T00:59:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:59:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:59:00.770553886Z [2024-05-11T00:59:00.770+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T00:59:00.770585193Z 2024-05-11T00:59:00.770591000Z 2024-05-11T00:59:00.770598536Z 2024-05-11T00:59:00.770659629Z [2024-05-11T00:59:00.770+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:59:00.770840554Z [2024-05-11T00:59:00.770+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T00:59:00.770951868Z [2024-05-11T00:59:00.770+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T00:59:00.771514140Z [2024-05-11T00:59:00.771+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T00:59:00.771521533Z 2024-05-11T00:59:00.771526704Z 2024-05-11T00:59:00.771531642Z 2024-05-11T00:59:00.774954415Z [2024-05-11T00:59:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:59:00.775069591Z [2024-05-11T00:59:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:59:00.775484988Z [2024-05-11T00:59:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:59:00.775711856Z [2024-05-11T00:59:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:59:00.776107062Z [2024-05-11T00:59:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T00:59:00.776340623Z [2024-05-11T00:59:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:59:01.077838901Z [2024-05-11T00:59:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status queued for try_number 1 2024-05-11T00:59:01.077930755Z [2024-05-11T00:59:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status queued for try_number 1 2024-05-11T00:59:01.077935351Z [2024-05-11T00:59:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status queued for try_number 1 2024-05-11T00:59:01.087621401Z [2024-05-11T00:59:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to de0f2eeb-4743-4913-af88-3c20ea8b0937 2024-05-11T00:59:01.091552661Z [2024-05-11T00:59:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to b52954c8-c4d1-4dc2-aa81-699bf6e840ea 2024-05-11T00:59:01.091599002Z [2024-05-11T00:59:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ded10bf-00bd-4aaa-a091-abc6c4382a70 2024-05-11T00:59:02.882706998Z [2024-05-11T00:59:02.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:59:02.883116205Z [2024-05-11T00:59:02.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:58:00+00:00, run_id=scheduled__2024-05-11T00:58:00+00:00, run_start_date=2024-05-11 00:59:00.696532+00:00, run_end_date=2024-05-11 00:59:02.882617+00:00, run_duration=2.186085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:58:00+00:00, data_interval_end=2024-05-11 00:59:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T00:59:02.894400570Z [2024-05-11T00:59:02.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T00:59:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:59:02.950855362Z [2024-05-11T00:59:02.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status success for try_number 1 2024-05-11T00:59:02.956051133Z [2024-05-11T00:59:02.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:58:00+00:00, map_index=-1, run_start_date=2024-05-11 00:59:01.631053+00:00, run_end_date=2024-05-11 00:59:02.005651+00:00, run_duration=0.374598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:59:00.772181+00:00, queued_by_job_id=2, pid=9773 2024-05-11T00:59:04.695916501Z [2024-05-11T00:59:04.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:59:04.696460166Z [2024-05-11T00:59:04.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:58:00+00:00, run_id=scheduled__2024-05-11T00:58:00+00:00, run_start_date=2024-05-11 00:59:00.697896+00:00, run_end_date=2024-05-11 00:59:04.695703+00:00, run_duration=3.997807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:58:00+00:00, data_interval_end=2024-05-11 00:59:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T00:59:04.706809832Z [2024-05-11T00:59:04.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:59:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:59:04.714070351Z [2024-05-11T00:59:04.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T00:59:04.714441796Z [2024-05-11T00:59:04.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:58:00+00:00, run_id=scheduled__2024-05-11T00:58:00+00:00, run_start_date=2024-05-11 00:59:00.699031+00:00, run_end_date=2024-05-11 00:59:04.713900+00:00, run_duration=4.014869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:58:00+00:00, data_interval_end=2024-05-11 00:59:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T00:59:04.724002028Z [2024-05-11T00:59:04.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T00:59:00+00:00, run_after=2024-05-11T01:00:00+00:00 2024-05-11T00:59:04.767158575Z [2024-05-11T00:59:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status success for try_number 1 2024-05-11T00:59:04.767203485Z [2024-05-11T00:59:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status success for try_number 1 2024-05-11T00:59:04.775337260Z [2024-05-11T00:59:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:58:00+00:00, map_index=-1, run_start_date=2024-05-11 00:59:02.584872+00:00, run_end_date=2024-05-11 00:59:03.908066+00:00, run_duration=1.323194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:59:00.772181+00:00, queued_by_job_id=2, pid=9791 2024-05-11T00:59:04.775536264Z [2024-05-11T00:59:04.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:58:00+00:00, map_index=-1, run_start_date=2024-05-11 00:59:02.680490+00:00, run_end_date=2024-05-11 00:59:04.390808+00:00, run_duration=1.710318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 00:59:00.772181+00:00, queued_by_job_id=2, pid=9792 2024-05-11T01:00:00.519260336Z [2024-05-11T01:00:00.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:01:00+00:00 2024-05-11T01:00:00.525815249Z [2024-05-11T01:00:00.525+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:00:00.537517514Z [2024-05-11T01:00:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:01:00+00:00 2024-05-11T01:00:00.543483148Z [2024-05-11T01:00:00.543+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:00:00.554209686Z [2024-05-11T01:00:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:00:00.680707888Z [2024-05-11T01:00:00.680+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:00:00.680776242Z 2024-05-11T01:00:00.680797638Z 2024-05-11T01:00:00.680814974Z 2024-05-11T01:00:00.680828968Z 2024-05-11T01:00:00.680843115Z 2024-05-11T01:00:00.680914129Z [2024-05-11T01:00:00.680+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:00:00.681234599Z [2024-05-11T01:00:00.680+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:00:00.681686587Z [2024-05-11T01:00:00.681+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:00:00.681719263Z [2024-05-11T01:00:00.681+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:00:00.684372848Z [2024-05-11T01:00:00.681+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:00:00.684480948Z [2024-05-11T01:00:00.682+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:00:00.684498314Z 2024-05-11T01:00:00.684513352Z 2024-05-11T01:00:00.684525994Z 2024-05-11T01:00:00.684538979Z 2024-05-11T01:00:00.684551817Z 2024-05-11T01:00:00.690485663Z [2024-05-11T01:00:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:00:00.690516778Z [2024-05-11T01:00:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:00:00.690525771Z [2024-05-11T01:00:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:00:00.690552200Z [2024-05-11T01:00:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:00:00.690880867Z [2024-05-11T01:00:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:00:00.690977685Z [2024-05-11T01:00:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:00:00.691324301Z [2024-05-11T01:00:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:00:00.691406859Z [2024-05-11T01:00:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:00:00.691705739Z [2024-05-11T01:00:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:00:00.691874567Z [2024-05-11T01:00:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:00:01.419706697Z [2024-05-11T01:00:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:01.419761702Z [2024-05-11T01:00:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:01.419822232Z [2024-05-11T01:00:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:59:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:01.419851417Z [2024-05-11T01:00:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:59:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:01.419919395Z [2024-05-11T01:00:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:59:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:01.445591206Z [2024-05-11T01:00:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed7d0629-16ca-4bf5-9b89-02058dbe5efa 2024-05-11T01:00:01.445615341Z [2024-05-11T01:00:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6647f067-a084-4760-84c4-ab1202f10006 2024-05-11T01:00:01.445619113Z [2024-05-11T01:00:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ff885ef-9cd4-4b7c-9f4d-98201cf655ba 2024-05-11T01:00:01.445622425Z [2024-05-11T01:00:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b04554c-6f2a-4797-90eb-e0edbf7de52b 2024-05-11T01:00:01.445625598Z [2024-05-11T01:00:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ddcf0d7-7438-46fc-aebe-08981e674acd 2024-05-11T01:00:03.349939852Z [2024-05-11T01:00:03.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:00:03.350320605Z [2024-05-11T01:00:03.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 00:58:00+00:00, run_id=scheduled__2024-05-11T00:58:00+00:00, run_start_date=2024-05-11 01:00:00.567272+00:00, run_end_date=2024-05-11 01:00:03.349836+00:00, run_duration=2.782564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:58:00+00:00, data_interval_end=2024-05-11 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:00:03.358573399Z [2024-05-11T01:00:03.358+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:02:00+00:00 2024-05-11T01:00:03.366613576Z [2024-05-11T01:00:03.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:00:03.368758794Z [2024-05-11T01:00:03.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 00:59:00+00:00, run_id=scheduled__2024-05-11T00:59:00+00:00, run_start_date=2024-05-11 01:00:00.568337+00:00, run_end_date=2024-05-11 01:00:03.367437+00:00, run_duration=2.7991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:59:00+00:00, data_interval_end=2024-05-11 01:00:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:00:03.383343773Z [2024-05-11T01:00:03.383+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:01:00+00:00 2024-05-11T01:00:03.459834324Z [2024-05-11T01:00:03.459+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:00:03.459855586Z 2024-05-11T01:00:03.460126305Z [2024-05-11T01:00:03.459+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:00:03.462207493Z [2024-05-11T01:00:03.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:00:03.462221203Z 2024-05-11T01:00:03.468352733Z [2024-05-11T01:00:03.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:00:03.468370845Z [2024-05-11T01:00:03.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:00:03.580491848Z [2024-05-11T01:00:03.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:03.580514136Z [2024-05-11T01:00:03.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:03.580519267Z [2024-05-11T01:00:03.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T00:58:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:03.580522684Z [2024-05-11T01:00:03.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:59:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:03.586110232Z [2024-05-11T01:00:03.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59fb1527-bcb3-44a9-a984-c30b3df6a152 2024-05-11T01:00:03.586249357Z [2024-05-11T01:00:03.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:59:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:01.848576+00:00, run_end_date=2024-05-11 01:00:02.402287+00:00, run_duration=0.553711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:00.685257+00:00, queued_by_job_id=2, pid=9826 2024-05-11T01:00:03.586379201Z [2024-05-11T01:00:03.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T00:58:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:01.964790+00:00, run_end_date=2024-05-11 01:00:02.409978+00:00, run_duration=0.445188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:00.685257+00:00, queued_by_job_id=2, pid=9828 2024-05-11T01:00:03.586516580Z [2024-05-11T01:00:03.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:02.871452+00:00, run_end_date=2024-05-11 01:00:03.279598+00:00, run_duration=0.408146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:00.685257+00:00, queued_by_job_id=2, pid=9847 2024-05-11T01:00:05.656289833Z [2024-05-11T01:00:05.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:00:05.656529793Z [2024-05-11T01:00:05.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:59:00+00:00, run_id=scheduled__2024-05-11T00:59:00+00:00, run_start_date=2024-05-11 01:00:00.569357+00:00, run_end_date=2024-05-11 01:00:05.656195+00:00, run_duration=5.086838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:59:00+00:00, data_interval_end=2024-05-11 01:00:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:00:05.669928940Z [2024-05-11T01:00:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:01:00+00:00 2024-05-11T01:00:05.677614099Z [2024-05-11T01:00:05.677+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:00:05.677845474Z [2024-05-11T01:00:05.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:59:00+00:00, run_id=scheduled__2024-05-11T00:59:00+00:00, run_start_date=2024-05-11 01:00:00.570386+00:00, run_end_date=2024-05-11 01:00:05.677539+00:00, run_duration=5.107153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:59:00+00:00, data_interval_end=2024-05-11 01:00:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:00:05.690687955Z [2024-05-11T01:00:05.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:01:00+00:00 2024-05-11T01:00:05.744496822Z [2024-05-11T01:00:05.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:59:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:05.744858475Z [2024-05-11T01:00:05.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T00:59:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:05.756831271Z [2024-05-11T01:00:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:59:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:03.177565+00:00, run_end_date=2024-05-11 01:00:04.520186+00:00, run_duration=1.342621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:00.685257+00:00, queued_by_job_id=2, pid=9860 2024-05-11T01:00:05.757144301Z [2024-05-11T01:00:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T00:59:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:03.104009+00:00, run_end_date=2024-05-11 01:00:04.762512+00:00, run_duration=1.658503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:00.685257+00:00, queued_by_job_id=2, pid=9857 2024-05-11T01:00:06.550668458Z [2024-05-11T01:00:06.550+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:00:06.550743752Z 2024-05-11T01:00:06.550861834Z [2024-05-11T01:00:06.550+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:00:06.551852663Z [2024-05-11T01:00:06.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:00:06.551869275Z 2024-05-11T01:00:06.555460627Z [2024-05-11T01:00:06.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:00:06.555803335Z [2024-05-11T01:00:06.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:00:06.630555321Z [2024-05-11T01:00:06.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:06.630851097Z [2024-05-11T01:00:06.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:06.639007655Z [2024-05-11T01:00:06.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 410c87e2-e258-402d-8944-0610fe27a8b4 2024-05-11T01:00:06.639420670Z [2024-05-11T01:00:06.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:05.342312+00:00, run_end_date=2024-05-11 01:00:05.713998+00:00, run_duration=0.371686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:03.462766+00:00, queued_by_job_id=2, pid=9891 2024-05-11T01:00:08.954405828Z [2024-05-11T01:00:08.953+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:00:08.954442921Z 2024-05-11T01:00:08.954565870Z [2024-05-11T01:00:08.954+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:00:08.955109176Z [2024-05-11T01:00:08.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:00:08.955121607Z 2024-05-11T01:00:08.957756929Z [2024-05-11T01:00:08.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:00:08.957967314Z [2024-05-11T01:00:08.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:00:09.034017226Z [2024-05-11T01:00:09.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:00:09.034607915Z [2024-05-11T01:00:09.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:09.046281827Z [2024-05-11T01:00:09.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 924c2a56-50b6-4687-93e7-720cb1023a3f 2024-05-11T01:00:09.047709571Z [2024-05-11T01:00:09.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=0, run_start_date=2024-05-11 01:00:08.270194+00:00, run_end_date=2024-05-11 01:00:08.616072+00:00, run_duration=0.345878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:06.552550+00:00, queued_by_job_id=2, pid=9902 2024-05-11T01:00:11.888451268Z [2024-05-11T01:00:11.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:00:11.888946980Z [2024-05-11T01:00:11.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 00:55:00+00:00, run_id=scheduled__2024-05-11T00:55:00+00:00, run_start_date=2024-05-11 01:00:00.565660+00:00, run_end_date=2024-05-11 01:00:11.888559+00:00, run_duration=11.322899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 00:55:00+00:00, data_interval_end=2024-05-11 01:00:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:00:11.896994511Z [2024-05-11T01:00:11.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:00:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:00:11.935198440Z [2024-05-11T01:00:11.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T00:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:00:11.941096278Z [2024-05-11T01:00:11.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T00:55:00+00:00, map_index=-1, run_start_date=2024-05-11 01:00:10.579548+00:00, run_end_date=2024-05-11 01:00:10.945109+00:00, run_duration=0.365561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:00:08.955619+00:00, queued_by_job_id=2, pid=9910 2024-05-11T01:00:35.210727585Z [2024-05-11T01:00:35.210+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:01:00.088751154Z [2024-05-11T01:01:00.088+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:01:00+00:00, run_after=2024-05-11T01:02:00+00:00 2024-05-11T01:01:00.109360283Z [2024-05-11T01:01:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:01:00+00:00, run_after=2024-05-11T01:02:00+00:00 2024-05-11T01:01:00.116773337Z [2024-05-11T01:01:00.116+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:01:00.184097463Z [2024-05-11T01:01:00.183+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:01:00.184126117Z 2024-05-11T01:01:00.184130175Z 2024-05-11T01:01:00.184133128Z 2024-05-11T01:01:00.184136248Z [2024-05-11T01:01:00.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:01:00.184139183Z [2024-05-11T01:01:00.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:01:00.184141971Z [2024-05-11T01:01:00.183+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:01:00.184894631Z [2024-05-11T01:01:00.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:01:00.184906848Z 2024-05-11T01:01:00.184910709Z 2024-05-11T01:01:00.184914149Z 2024-05-11T01:01:00.189289812Z [2024-05-11T01:01:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:01:00.190425343Z [2024-05-11T01:01:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:01:00.191118887Z [2024-05-11T01:01:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:01:00.191513138Z [2024-05-11T01:01:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:01:00.192168318Z [2024-05-11T01:01:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:01:00.192591420Z [2024-05-11T01:01:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:01:00.594942773Z [2024-05-11T01:01:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:01:00.595096930Z [2024-05-11T01:01:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:01:00.595165972Z [2024-05-11T01:01:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:01:00.631157906Z [2024-05-11T01:01:00.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21cdc0fe-dbbd-4c6e-9598-8c5061e84a34 2024-05-11T01:01:00.631426604Z [2024-05-11T01:01:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ff393d9-bfc2-4759-ac02-f4580ca8ff6f 2024-05-11T01:01:00.631741073Z [2024-05-11T01:01:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69aeb142-92b1-4f69-a6f0-85f94a14e1db 2024-05-11T01:01:02.565209376Z [2024-05-11T01:01:02.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:01:02.565770791Z [2024-05-11T01:01:02.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:00:00+00:00, run_id=scheduled__2024-05-11T01:00:00+00:00, run_start_date=2024-05-11 01:01:00.129922+00:00, run_end_date=2024-05-11 01:01:02.565342+00:00, run_duration=2.43542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:00:00+00:00, data_interval_end=2024-05-11 01:01:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:01:02.576244651Z [2024-05-11T01:01:02.575+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:01:00+00:00, run_after=2024-05-11T01:02:00+00:00 2024-05-11T01:01:02.648947105Z [2024-05-11T01:01:02.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:01:02.653529921Z [2024-05-11T01:01:02.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:01:01.407841+00:00, run_end_date=2024-05-11 01:01:01.912692+00:00, run_duration=0.504851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:01:00.185682+00:00, queued_by_job_id=2, pid=9919 2024-05-11T01:01:05.731358272Z [2024-05-11T01:01:05.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:01:05.731407099Z [2024-05-11T01:01:05.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:00:00+00:00, run_id=scheduled__2024-05-11T01:00:00+00:00, run_start_date=2024-05-11 01:01:00.131182+00:00, run_end_date=2024-05-11 01:01:05.730974+00:00, run_duration=5.599792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:00:00+00:00, data_interval_end=2024-05-11 01:01:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:01:05.743035171Z [2024-05-11T01:01:05.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:01:00+00:00, run_after=2024-05-11T01:02:00+00:00 2024-05-11T01:01:05.751506839Z [2024-05-11T01:01:05.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:01:05.751992713Z [2024-05-11T01:01:05.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:00:00+00:00, run_id=scheduled__2024-05-11T01:00:00+00:00, run_start_date=2024-05-11 01:01:00.132158+00:00, run_end_date=2024-05-11 01:01:05.751382+00:00, run_duration=5.619224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:00:00+00:00, data_interval_end=2024-05-11 01:01:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:01:05.766106540Z [2024-05-11T01:01:05.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:01:00+00:00, run_after=2024-05-11T01:02:00+00:00 2024-05-11T01:01:05.820586617Z [2024-05-11T01:01:05.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:01:05.820888494Z [2024-05-11T01:01:05.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:01:05.827489821Z [2024-05-11T01:01:05.827+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:01:02.934120+00:00, run_end_date=2024-05-11 01:01:04.795515+00:00, run_duration=1.861395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:01:00.185682+00:00, queued_by_job_id=2, pid=9938 2024-05-11T01:01:05.827944591Z [2024-05-11T01:01:05.827+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:01:02.874750+00:00, run_end_date=2024-05-11 01:01:05.120121+00:00, run_duration=2.245371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:01:00.185682+00:00, queued_by_job_id=2, pid=9937 2024-05-11T01:02:00.584378623Z [2024-05-11T01:02:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:02:00+00:00, run_after=2024-05-11T01:03:00+00:00 2024-05-11T01:02:00.591264389Z [2024-05-11T01:02:00.590+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:02:00.602102502Z [2024-05-11T01:02:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:02:00+00:00, run_after=2024-05-11T01:03:00+00:00 2024-05-11T01:02:00.609164809Z [2024-05-11T01:02:00.608+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:02:00.710736366Z [2024-05-11T01:02:00.710+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:02:00.710782148Z 2024-05-11T01:02:00.710792911Z 2024-05-11T01:02:00.710801822Z 2024-05-11T01:02:00.710810706Z 2024-05-11T01:02:00.710824505Z [2024-05-11T01:02:00.710+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:02:00.710888853Z [2024-05-11T01:02:00.710+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:02:00.711046610Z [2024-05-11T01:02:00.710+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:02:00.711175392Z [2024-05-11T01:02:00.710+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:02:00.711846259Z [2024-05-11T01:02:00.711+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:02:00.711895194Z 2024-05-11T01:02:00.711905836Z 2024-05-11T01:02:00.711914922Z 2024-05-11T01:02:00.711923888Z 2024-05-11T01:02:00.717141388Z [2024-05-11T01:02:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:02:00.717205037Z [2024-05-11T01:02:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:02:00.717513767Z [2024-05-11T01:02:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:02:00.717622827Z [2024-05-11T01:02:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:02:00.718015179Z [2024-05-11T01:02:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:02:00.718184615Z [2024-05-11T01:02:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:02:00.718527349Z [2024-05-11T01:02:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:02:00.718745999Z [2024-05-11T01:02:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:02:01.267624566Z [2024-05-11T01:02:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:02:01.267825336Z [2024-05-11T01:02:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:01:00+00:00 exited with status queued for try_number 1 2024-05-11T01:02:01.267947843Z [2024-05-11T01:02:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:01:00+00:00 exited with status queued for try_number 1 2024-05-11T01:02:01.268070782Z [2024-05-11T01:02:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:01:00+00:00 exited with status queued for try_number 1 2024-05-11T01:02:01.279431464Z [2024-05-11T01:02:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to fac0e6a2-2162-46b8-9822-864126fe5bd3 2024-05-11T01:02:01.279558639Z [2024-05-11T01:02:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7074ca4-65af-41a8-acbf-eb86070250aa 2024-05-11T01:02:01.279705973Z [2024-05-11T01:02:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e5ee293-399e-425d-b0fe-6a6d0d97e55a 2024-05-11T01:02:01.279862927Z [2024-05-11T01:02:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to f24719e0-24c0-4cd4-87d6-3bc1043d67a9 2024-05-11T01:02:02.907832384Z [2024-05-11T01:02:02.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:02:02.908174364Z [2024-05-11T01:02:02.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:00:00+00:00, run_id=scheduled__2024-05-11T01:00:00+00:00, run_start_date=2024-05-11 01:02:00.621616+00:00, run_end_date=2024-05-11 01:02:02.907811+00:00, run_duration=2.286195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:00:00+00:00, data_interval_end=2024-05-11 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:02:02.917431285Z [2024-05-11T01:02:02.917+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:02:00+00:00, run_after=2024-05-11T01:04:00+00:00 2024-05-11T01:02:02.929170716Z [2024-05-11T01:02:02.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:02:02.929394428Z [2024-05-11T01:02:02.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:01:00+00:00, run_id=scheduled__2024-05-11T01:01:00+00:00, run_start_date=2024-05-11 01:02:00.623926+00:00, run_end_date=2024-05-11 01:02:02.929124+00:00, run_duration=2.305198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:01:00+00:00, data_interval_end=2024-05-11 01:02:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:02:02.941921842Z [2024-05-11T01:02:02.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:02:00+00:00, run_after=2024-05-11T01:03:00+00:00 2024-05-11T01:02:03.025067526Z [2024-05-11T01:02:03.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:02:03.025119728Z [2024-05-11T01:02:03.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:01:00+00:00 exited with status success for try_number 1 2024-05-11T01:02:03.035209701Z [2024-05-11T01:02:03.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:02:01.623675+00:00, run_end_date=2024-05-11 01:02:01.991388+00:00, run_duration=0.367713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:02:00.712877+00:00, queued_by_job_id=2, pid=9970 2024-05-11T01:02:03.036438848Z [2024-05-11T01:02:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:01:00+00:00, map_index=-1, run_start_date=2024-05-11 01:02:01.808024+00:00, run_end_date=2024-05-11 01:02:02.220467+00:00, run_duration=0.412443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:02:00.712877+00:00, queued_by_job_id=2, pid=9971 2024-05-11T01:02:05.209853140Z [2024-05-11T01:02:05.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:02:05.209940860Z [2024-05-11T01:02:05.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:01:00+00:00, run_id=scheduled__2024-05-11T01:01:00+00:00, run_start_date=2024-05-11 01:02:00.625051+00:00, run_end_date=2024-05-11 01:02:05.200871+00:00, run_duration=4.57582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:01:00+00:00, data_interval_end=2024-05-11 01:02:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:02:05.217033482Z [2024-05-11T01:02:05.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:02:00+00:00, run_after=2024-05-11T01:03:00+00:00 2024-05-11T01:02:05.302773005Z [2024-05-11T01:02:05.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:01:00+00:00 exited with status success for try_number 1 2024-05-11T01:02:05.308641637Z [2024-05-11T01:02:05.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:01:00+00:00, map_index=-1, run_start_date=2024-05-11 01:02:02.865202+00:00, run_end_date=2024-05-11 01:02:04.157774+00:00, run_duration=1.292572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:02:00.712877+00:00, queued_by_job_id=2, pid=9995 2024-05-11T01:02:06.347424492Z [2024-05-11T01:02:06.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:02:06.347776196Z [2024-05-11T01:02:06.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:01:00+00:00, run_id=scheduled__2024-05-11T01:01:00+00:00, run_start_date=2024-05-11 01:02:00.626486+00:00, run_end_date=2024-05-11 01:02:06.347282+00:00, run_duration=5.720796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:01:00+00:00, data_interval_end=2024-05-11 01:02:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:02:06.356760922Z [2024-05-11T01:02:06.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:02:00+00:00, run_after=2024-05-11T01:03:00+00:00 2024-05-11T01:02:06.385461857Z [2024-05-11T01:02:06.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:01:00+00:00 exited with status success for try_number 1 2024-05-11T01:02:06.390663836Z [2024-05-11T01:02:06.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:01:00+00:00, map_index=-1, run_start_date=2024-05-11 01:02:02.845574+00:00, run_end_date=2024-05-11 01:02:06.015394+00:00, run_duration=3.16982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:02:00.712877+00:00, queued_by_job_id=2, pid=9994 2024-05-11T01:03:01.057325783Z [2024-05-11T01:03:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:03:00+00:00, run_after=2024-05-11T01:04:00+00:00 2024-05-11T01:03:01.065426377Z [2024-05-11T01:03:01.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:03:01.082318658Z [2024-05-11T01:03:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:03:00+00:00, run_after=2024-05-11T01:04:00+00:00 2024-05-11T01:03:01.171725000Z [2024-05-11T01:03:01.171+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:03:01.171756402Z 2024-05-11T01:03:01.171760142Z 2024-05-11T01:03:01.171763355Z 2024-05-11T01:03:01.171965133Z [2024-05-11T01:03:01.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:03:01.172167329Z [2024-05-11T01:03:01.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:03:01.172335890Z [2024-05-11T01:03:01.172+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:03:01.173049094Z [2024-05-11T01:03:01.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:03:01.173058448Z 2024-05-11T01:03:01.173062062Z 2024-05-11T01:03:01.173077381Z 2024-05-11T01:03:01.176336419Z [2024-05-11T01:03:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:03:01.176591678Z [2024-05-11T01:03:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:03:01.176906730Z [2024-05-11T01:03:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:03:01.177093079Z [2024-05-11T01:03:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:03:01.177374764Z [2024-05-11T01:03:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:03:01.177545585Z [2024-05-11T01:03:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:03:01.359470244Z [2024-05-11T01:03:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status queued for try_number 1 2024-05-11T01:03:01.359796696Z [2024-05-11T01:03:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status queued for try_number 1 2024-05-11T01:03:01.360000071Z [2024-05-11T01:03:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status queued for try_number 1 2024-05-11T01:03:01.370956460Z [2024-05-11T01:03:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d8b5dd0-aa33-49af-9390-f4c429cd2039 2024-05-11T01:03:01.371321630Z [2024-05-11T01:03:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c957711-e6ec-4ad4-8918-75b19e2cbaae 2024-05-11T01:03:01.371720719Z [2024-05-11T01:03:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea725833-7960-4fa0-97c1-12fee914b549 2024-05-11T01:03:02.571495101Z [2024-05-11T01:03:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:03:02.571947396Z [2024-05-11T01:03:02.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:02:00+00:00, run_id=scheduled__2024-05-11T01:02:00+00:00, run_start_date=2024-05-11 01:03:01.095550+00:00, run_end_date=2024-05-11 01:03:02.571410+00:00, run_duration=1.47586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:02:00+00:00, data_interval_end=2024-05-11 01:03:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:03:02.585286389Z [2024-05-11T01:03:02.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:03:00+00:00, run_after=2024-05-11T01:04:00+00:00 2024-05-11T01:03:02.719270810Z [2024-05-11T01:03:02.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status success for try_number 1 2024-05-11T01:03:02.728768208Z [2024-05-11T01:03:02.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:02:00+00:00, map_index=-1, run_start_date=2024-05-11 01:03:01.871705+00:00, run_end_date=2024-05-11 01:03:02.237578+00:00, run_duration=0.365873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:03:01.173963+00:00, queued_by_job_id=2, pid=10027 2024-05-11T01:03:04.369289221Z [2024-05-11T01:03:04.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:03:04.370353003Z [2024-05-11T01:03:04.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:02:00+00:00, run_id=scheduled__2024-05-11T01:02:00+00:00, run_start_date=2024-05-11 01:03:01.096856+00:00, run_end_date=2024-05-11 01:03:04.369496+00:00, run_duration=3.27264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:02:00+00:00, data_interval_end=2024-05-11 01:03:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:03:04.383418491Z [2024-05-11T01:03:04.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:03:00+00:00, run_after=2024-05-11T01:04:00+00:00 2024-05-11T01:03:04.463962401Z [2024-05-11T01:03:04.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status success for try_number 1 2024-05-11T01:03:04.474817665Z [2024-05-11T01:03:04.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:02:00+00:00, map_index=-1, run_start_date=2024-05-11 01:03:02.784084+00:00, run_end_date=2024-05-11 01:03:03.957243+00:00, run_duration=1.173159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:03:01.173963+00:00, queued_by_job_id=2, pid=10045 2024-05-11T01:03:05.536072146Z [2024-05-11T01:03:05.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:03:05.536196185Z [2024-05-11T01:03:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:02:00+00:00, run_id=scheduled__2024-05-11T01:02:00+00:00, run_start_date=2024-05-11 01:03:01.106277+00:00, run_end_date=2024-05-11 01:03:05.535898+00:00, run_duration=4.429621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:02:00+00:00, data_interval_end=2024-05-11 01:03:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:03:05.546183118Z [2024-05-11T01:03:05.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:03:00+00:00, run_after=2024-05-11T01:04:00+00:00 2024-05-11T01:03:05.580302745Z [2024-05-11T01:03:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status success for try_number 1 2024-05-11T01:03:05.589249281Z [2024-05-11T01:03:05.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:02:00+00:00, map_index=-1, run_start_date=2024-05-11 01:03:02.881294+00:00, run_end_date=2024-05-11 01:03:04.456217+00:00, run_duration=1.574923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:03:01.173963+00:00, queued_by_job_id=2, pid=10046 2024-05-11T01:04:00.699813403Z [2024-05-11T01:04:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:04:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:04:00.706959070Z [2024-05-11T01:04:00.706+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:04:00.712676691Z [2024-05-11T01:04:00.712+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:04:00.723643482Z [2024-05-11T01:04:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:04:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:04:00.795902485Z [2024-05-11T01:04:00.795+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:04:00.795937729Z 2024-05-11T01:04:00.795963368Z 2024-05-11T01:04:00.795972416Z 2024-05-11T01:04:00.795981178Z 2024-05-11T01:04:00.796123164Z [2024-05-11T01:04:00.795+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:04:00.796380105Z [2024-05-11T01:04:00.796+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:04:00.796629536Z [2024-05-11T01:04:00.796+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:04:00.796872456Z [2024-05-11T01:04:00.796+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:04:00.797613051Z [2024-05-11T01:04:00.797+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:04:00.797621183Z 2024-05-11T01:04:00.797624720Z 2024-05-11T01:04:00.797627850Z 2024-05-11T01:04:00.797631006Z 2024-05-11T01:04:00.801706628Z [2024-05-11T01:04:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:04:00.802002449Z [2024-05-11T01:04:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:04:00.802403181Z [2024-05-11T01:04:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:04:00.802615060Z [2024-05-11T01:04:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:04:00.802923426Z [2024-05-11T01:04:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:04:00.803129170Z [2024-05-11T01:04:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:04:00.803434227Z [2024-05-11T01:04:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:04:00.803619238Z [2024-05-11T01:04:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:04:01.159790265Z [2024-05-11T01:04:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status queued for try_number 1 2024-05-11T01:04:01.159835874Z [2024-05-11T01:04:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:03:00+00:00 exited with status queued for try_number 1 2024-05-11T01:04:01.159927446Z [2024-05-11T01:04:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:03:00+00:00 exited with status queued for try_number 1 2024-05-11T01:04:01.159933822Z [2024-05-11T01:04:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:03:00+00:00 exited with status queued for try_number 1 2024-05-11T01:04:01.175226924Z [2024-05-11T01:04:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 367ca1ae-b3cc-4abe-9b93-03b9d33e1d7b 2024-05-11T01:04:01.175312051Z [2024-05-11T01:04:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bbfc9d4-87e1-4def-9730-17ad46a84a01 2024-05-11T01:04:01.175415714Z [2024-05-11T01:04:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08cb3996-a5af-44bd-96b7-6ce6801cd895 2024-05-11T01:04:01.175494078Z [2024-05-11T01:04:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ad417cb-a17a-4da4-ad47-1181487d29f5 2024-05-11T01:04:02.334759043Z [2024-05-11T01:04:02.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:04:02.335247439Z [2024-05-11T01:04:02.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:02:00+00:00, run_id=scheduled__2024-05-11T01:02:00+00:00, run_start_date=2024-05-11 01:04:00.732386+00:00, run_end_date=2024-05-11 01:04:02.334889+00:00, run_duration=1.602503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:02:00+00:00, data_interval_end=2024-05-11 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:04:02.343183460Z [2024-05-11T01:04:02.342+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:04:00+00:00, run_after=2024-05-11T01:06:00+00:00 2024-05-11T01:04:02.350839523Z [2024-05-11T01:04:02.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:04:02.351226487Z [2024-05-11T01:04:02.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:03:00+00:00, run_id=scheduled__2024-05-11T01:03:00+00:00, run_start_date=2024-05-11 01:04:00.733625+00:00, run_end_date=2024-05-11 01:04:02.350933+00:00, run_duration=1.617308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:03:00+00:00, data_interval_end=2024-05-11 01:04:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:04:02.364521638Z [2024-05-11T01:04:02.363+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:04:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:04:02.427195141Z [2024-05-11T01:04:02.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:02:00+00:00 exited with status success for try_number 1 2024-05-11T01:04:02.427475786Z [2024-05-11T01:04:02.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:03:00+00:00 exited with status success for try_number 1 2024-05-11T01:04:02.435847967Z [2024-05-11T01:04:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:02:00+00:00, map_index=-1, run_start_date=2024-05-11 01:04:01.683445+00:00, run_end_date=2024-05-11 01:04:02.059130+00:00, run_duration=0.375685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:04:00.798747+00:00, queued_by_job_id=2, pid=10080 2024-05-11T01:04:02.436235833Z [2024-05-11T01:04:02.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:03:00+00:00, map_index=-1, run_start_date=2024-05-11 01:04:01.725507+00:00, run_end_date=2024-05-11 01:04:02.135076+00:00, run_duration=0.409569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:04:00.798747+00:00, queued_by_job_id=2, pid=10081 2024-05-11T01:04:04.789246183Z [2024-05-11T01:04:04.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:04:04.789530881Z [2024-05-11T01:04:04.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:03:00+00:00, run_id=scheduled__2024-05-11T01:03:00+00:00, run_start_date=2024-05-11 01:04:00.734760+00:00, run_end_date=2024-05-11 01:04:04.789081+00:00, run_duration=4.054321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:03:00+00:00, data_interval_end=2024-05-11 01:04:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:04:04.797921830Z [2024-05-11T01:04:04.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:04:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:04:04.803546109Z [2024-05-11T01:04:04.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:04:04.803755817Z [2024-05-11T01:04:04.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:03:00+00:00, run_id=scheduled__2024-05-11T01:03:00+00:00, run_start_date=2024-05-11 01:04:00.735794+00:00, run_end_date=2024-05-11 01:04:04.803288+00:00, run_duration=4.067494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:03:00+00:00, data_interval_end=2024-05-11 01:04:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:04:04.812733625Z [2024-05-11T01:04:04.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:04:00+00:00, run_after=2024-05-11T01:05:00+00:00 2024-05-11T01:04:04.846501289Z [2024-05-11T01:04:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:03:00+00:00 exited with status success for try_number 1 2024-05-11T01:04:04.846527177Z [2024-05-11T01:04:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:03:00+00:00 exited with status success for try_number 1 2024-05-11T01:04:04.853325508Z [2024-05-11T01:04:04.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:03:00+00:00, map_index=-1, run_start_date=2024-05-11 01:04:02.795739+00:00, run_end_date=2024-05-11 01:04:04.033687+00:00, run_duration=1.237948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:04:00.798747+00:00, queued_by_job_id=2, pid=10104 2024-05-11T01:04:04.853557444Z [2024-05-11T01:04:04.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:03:00+00:00, map_index=-1, run_start_date=2024-05-11 01:04:02.866728+00:00, run_end_date=2024-05-11 01:04:04.516367+00:00, run_duration=1.649639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:04:00.798747+00:00, queued_by_job_id=2, pid=10105 2024-05-11T01:05:00.584244333Z [2024-05-11T01:05:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:06:00+00:00 2024-05-11T01:05:00.599035502Z [2024-05-11T01:05:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:06:00+00:00 2024-05-11T01:05:00.607295194Z [2024-05-11T01:05:00.606+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:05:00.620149671Z [2024-05-11T01:05:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:05:00.711111977Z [2024-05-11T01:05:00.710+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:05:00.711155456Z 2024-05-11T01:05:00.711164131Z 2024-05-11T01:05:00.711170109Z 2024-05-11T01:05:00.711175886Z 2024-05-11T01:05:00.711376983Z [2024-05-11T01:05:00.711+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:05:00.711631630Z [2024-05-11T01:05:00.711+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:05:00.711840149Z [2024-05-11T01:05:00.711+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:05:00.712049316Z [2024-05-11T01:05:00.711+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:05:00.712777262Z [2024-05-11T01:05:00.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:05:00.712790523Z 2024-05-11T01:05:00.712796652Z 2024-05-11T01:05:00.712801081Z 2024-05-11T01:05:00.712805347Z 2024-05-11T01:05:00.716676176Z [2024-05-11T01:05:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:05:00.716977013Z [2024-05-11T01:05:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:05:00.717282349Z [2024-05-11T01:05:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:05:00.717511597Z [2024-05-11T01:05:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:05:00.717798395Z [2024-05-11T01:05:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:05:00.717992415Z [2024-05-11T01:05:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:05:00.718240983Z [2024-05-11T01:05:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:05:00.718418504Z [2024-05-11T01:05:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:05:01.260820541Z [2024-05-11T01:05:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:01.261294768Z [2024-05-11T01:05:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:01.261437250Z [2024-05-11T01:05:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:01.261541957Z [2024-05-11T01:05:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:01.271452901Z [2024-05-11T01:05:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to db9ff17c-6b95-418c-925d-e2801f4ad408 2024-05-11T01:05:01.271584293Z [2024-05-11T01:05:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe57169d-9ca1-42df-b6ef-0b2adbd83775 2024-05-11T01:05:01.271774728Z [2024-05-11T01:05:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to 472e0156-de08-4bd2-b1bf-feb075da2f41 2024-05-11T01:05:01.271925628Z [2024-05-11T01:05:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05ee1ea0-5bfd-4380-a8cc-b4e438e923e2 2024-05-11T01:05:02.575923600Z [2024-05-11T01:05:02.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:05:02.576116640Z [2024-05-11T01:05:02.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:04:00+00:00, run_id=scheduled__2024-05-11T01:04:00+00:00, run_start_date=2024-05-11 01:05:00.631578+00:00, run_end_date=2024-05-11 01:05:02.575834+00:00, run_duration=1.944256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:04:00+00:00, data_interval_end=2024-05-11 01:05:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:05:02.585413100Z [2024-05-11T01:05:02.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:06:00+00:00 2024-05-11T01:05:02.653948922Z [2024-05-11T01:05:02.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:02.663521371Z [2024-05-11T01:05:02.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:04:00+00:00, map_index=-1, run_start_date=2024-05-11 01:05:01.655653+00:00, run_end_date=2024-05-11 01:05:02.059109+00:00, run_duration=0.403456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:00.713666+00:00, queued_by_job_id=2, pid=10138 2024-05-11T01:05:03.769631231Z [2024-05-11T01:05:03.769+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:05:03.769661044Z 2024-05-11T01:05:03.769843149Z [2024-05-11T01:05:03.769+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:05:03.771254746Z [2024-05-11T01:05:03.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:05:03.771270489Z 2024-05-11T01:05:03.776552940Z [2024-05-11T01:05:03.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:05:03.776913057Z [2024-05-11T01:05:03.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:05:03.845915201Z [2024-05-11T01:05:03.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:03.845970971Z [2024-05-11T01:05:03.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:03.852198239Z [2024-05-11T01:05:03.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fea503e-7f7e-4fa2-84a1-cdd0e945f5e6 2024-05-11T01:05:03.852304418Z [2024-05-11T01:05:03.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:05:02.584197+00:00, run_end_date=2024-05-11 01:05:02.920242+00:00, run_duration=0.336045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:00.713666+00:00, queued_by_job_id=2, pid=10162 2024-05-11T01:05:04.591887532Z [2024-05-11T01:05:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:05:04.592093794Z [2024-05-11T01:05:04.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:04:00+00:00, run_id=scheduled__2024-05-11T01:04:00+00:00, run_start_date=2024-05-11 01:05:00.632691+00:00, run_end_date=2024-05-11 01:05:04.591773+00:00, run_duration=3.959082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:04:00+00:00, data_interval_end=2024-05-11 01:05:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:05:04.602779775Z [2024-05-11T01:05:04.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:06:00+00:00 2024-05-11T01:05:04.610754515Z [2024-05-11T01:05:04.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:05:04.610937552Z [2024-05-11T01:05:04.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:04:00+00:00, run_id=scheduled__2024-05-11T01:04:00+00:00, run_start_date=2024-05-11 01:05:00.633746+00:00, run_end_date=2024-05-11 01:05:04.610656+00:00, run_duration=3.97691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:04:00+00:00, data_interval_end=2024-05-11 01:05:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:05:04.620947072Z [2024-05-11T01:05:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:06:00+00:00 2024-05-11T01:05:04.682815711Z [2024-05-11T01:05:04.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:04.682870070Z [2024-05-11T01:05:04.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:04.692161985Z [2024-05-11T01:05:04.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:04:00+00:00, map_index=-1, run_start_date=2024-05-11 01:05:02.629417+00:00, run_end_date=2024-05-11 01:05:03.961320+00:00, run_duration=1.331903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:00.713666+00:00, queued_by_job_id=2, pid=10163 2024-05-11T01:05:04.692494467Z [2024-05-11T01:05:04.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:04:00+00:00, map_index=-1, run_start_date=2024-05-11 01:05:02.632629+00:00, run_end_date=2024-05-11 01:05:04.333228+00:00, run_duration=1.700599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:00.713666+00:00, queued_by_job_id=2, pid=10164 2024-05-11T01:05:05.804911530Z [2024-05-11T01:05:05.804+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:05:05.804946851Z 2024-05-11T01:05:05.804992069Z [2024-05-11T01:05:05.804+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:05:05.805614840Z [2024-05-11T01:05:05.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:05:05.805635550Z 2024-05-11T01:05:05.809058325Z [2024-05-11T01:05:05.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:05:05.809212181Z [2024-05-11T01:05:05.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:05:05.902989915Z [2024-05-11T01:05:05.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:05.903057663Z [2024-05-11T01:05:05.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:05.911704616Z [2024-05-11T01:05:05.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5241ff30-eb45-4f46-93a9-b7009007cf75 2024-05-11T01:05:05.912278942Z [2024-05-11T01:05:05.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:05:05.382576+00:00, run_end_date=2024-05-11 01:05:05.690868+00:00, run_duration=0.308292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:03.771968+00:00, queued_by_job_id=2, pid=10197 2024-05-11T01:05:08.195411421Z [2024-05-11T01:05:08.194+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:05:08.195450933Z 2024-05-11T01:05:08.195673448Z [2024-05-11T01:05:08.195+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:05:08.196724398Z [2024-05-11T01:05:08.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:05:08.196733452Z 2024-05-11T01:05:08.199756397Z [2024-05-11T01:05:08.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:05:08.200077227Z [2024-05-11T01:05:08.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:05:08.272578101Z [2024-05-11T01:05:08.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status queued for try_number 1 2024-05-11T01:05:08.272794580Z [2024-05-11T01:05:08.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:08.283336926Z [2024-05-11T01:05:08.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7510dc96-ebc4-4c5d-880f-66c0e5acc1b4 2024-05-11T01:05:08.283822153Z [2024-05-11T01:05:08.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=0, run_start_date=2024-05-11 01:05:07.423189+00:00, run_end_date=2024-05-11 01:05:07.787299+00:00, run_duration=0.36411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:05.805999+00:00, queued_by_job_id=2, pid=10208 2024-05-11T01:05:10.866514500Z [2024-05-11T01:05:10.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:05:10.866761920Z [2024-05-11T01:05:10.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:00:00+00:00, run_id=scheduled__2024-05-11T01:00:00+00:00, run_start_date=2024-05-11 01:05:00.630082+00:00, run_end_date=2024-05-11 01:05:10.866338+00:00, run_duration=10.236256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:00:00+00:00, data_interval_end=2024-05-11 01:05:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:05:10.872343065Z [2024-05-11T01:05:10.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:05:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:05:10.909450140Z [2024-05-11T01:05:10.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:00:00+00:00 exited with status success for try_number 1 2024-05-11T01:05:10.917101630Z [2024-05-11T01:05:10.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:00:00+00:00, map_index=-1, run_start_date=2024-05-11 01:05:09.751897+00:00, run_end_date=2024-05-11 01:05:10.118423+00:00, run_duration=0.366526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:05:08.197276+00:00, queued_by_job_id=2, pid=10216 2024-05-11T01:05:35.289701844Z [2024-05-11T01:05:35.288+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:06:00.113468806Z [2024-05-11T01:06:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:06:00+00:00, run_after=2024-05-11T01:07:00+00:00 2024-05-11T01:06:00.122283106Z [2024-05-11T01:06:00.121+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:06:00.140095576Z [2024-05-11T01:06:00.139+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:06:00.158756851Z [2024-05-11T01:06:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:06:00+00:00, run_after=2024-05-11T01:07:00+00:00 2024-05-11T01:06:00.231301236Z [2024-05-11T01:06:00.230+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:06:00.231327121Z 2024-05-11T01:06:00.231332817Z 2024-05-11T01:06:00.231336289Z 2024-05-11T01:06:00.231339627Z 2024-05-11T01:06:00.231939532Z [2024-05-11T01:06:00.231+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:06:00.232411487Z [2024-05-11T01:06:00.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:06:00.232889112Z [2024-05-11T01:06:00.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:06:00.233323005Z [2024-05-11T01:06:00.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:06:00.234894046Z [2024-05-11T01:06:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:06:00.234903240Z 2024-05-11T01:06:00.234906721Z 2024-05-11T01:06:00.234910261Z 2024-05-11T01:06:00.234913548Z 2024-05-11T01:06:00.241931157Z [2024-05-11T01:06:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:06:00.242341498Z [2024-05-11T01:06:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:06:00.243916206Z [2024-05-11T01:06:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:06:00.244149358Z [2024-05-11T01:06:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:06:00.244627012Z [2024-05-11T01:06:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:06:00.244925425Z [2024-05-11T01:06:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:06:00.245327949Z [2024-05-11T01:06:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:06:00.245579848Z [2024-05-11T01:06:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:06:00.514074731Z [2024-05-11T01:06:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status queued for try_number 1 2024-05-11T01:06:00.514310164Z [2024-05-11T01:06:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:06:00.514463649Z [2024-05-11T01:06:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:06:00.514613539Z [2024-05-11T01:06:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:06:00.522767101Z [2024-05-11T01:06:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c37c32c-e919-4c02-83f1-197e911dca0d 2024-05-11T01:06:00.522996383Z [2024-05-11T01:06:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fb8bf33-398c-4eaa-b043-3b332ba9932b 2024-05-11T01:06:00.523206819Z [2024-05-11T01:06:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to b03de4af-3cae-498a-9e39-021d151129d1 2024-05-11T01:06:00.523397738Z [2024-05-11T01:06:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2828e140-39b7-4d04-8091-27200819cf49 2024-05-11T01:06:01.707107678Z [2024-05-11T01:06:01.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:06:01.707574829Z [2024-05-11T01:06:01.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:04:00+00:00, run_id=scheduled__2024-05-11T01:04:00+00:00, run_start_date=2024-05-11 01:06:00.169018+00:00, run_end_date=2024-05-11 01:06:01.707212+00:00, run_duration=1.538194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:04:00+00:00, data_interval_end=2024-05-11 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:06:01.717040609Z [2024-05-11T01:06:01.716+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:06:00+00:00, run_after=2024-05-11T01:08:00+00:00 2024-05-11T01:06:01.724624072Z [2024-05-11T01:06:01.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:06:01.724977276Z [2024-05-11T01:06:01.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:05:00+00:00, run_id=scheduled__2024-05-11T01:05:00+00:00, run_start_date=2024-05-11 01:06:00.170291+00:00, run_end_date=2024-05-11 01:06:01.724701+00:00, run_duration=1.55441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:05:00+00:00, data_interval_end=2024-05-11 01:06:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:06:01.736289369Z [2024-05-11T01:06:01.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:06:00+00:00, run_after=2024-05-11T01:07:00+00:00 2024-05-11T01:06:01.787781279Z [2024-05-11T01:06:01.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:06:01.793352608Z [2024-05-11T01:06:01.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=-1, run_start_date=2024-05-11 01:06:01.005374+00:00, run_end_date=2024-05-11 01:06:01.418008+00:00, run_duration=0.412634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:06:00.237361+00:00, queued_by_job_id=2, pid=10226 2024-05-11T01:06:02.911742297Z [2024-05-11T01:06:02.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:04:00+00:00 exited with status success for try_number 1 2024-05-11T01:06:02.920600106Z [2024-05-11T01:06:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:04:00+00:00, map_index=-1, run_start_date=2024-05-11 01:06:01.263225+00:00, run_end_date=2024-05-11 01:06:01.676756+00:00, run_duration=0.413531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:06:00.237361+00:00, queued_by_job_id=2, pid=10227 2024-05-11T01:06:03.977051557Z [2024-05-11T01:06:03.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:06:03.977531294Z [2024-05-11T01:06:03.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:05:00+00:00, run_id=scheduled__2024-05-11T01:05:00+00:00, run_start_date=2024-05-11 01:06:00.171249+00:00, run_end_date=2024-05-11 01:06:03.977180+00:00, run_duration=3.805931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:05:00+00:00, data_interval_end=2024-05-11 01:06:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:06:03.986027500Z [2024-05-11T01:06:03.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:06:00+00:00, run_after=2024-05-11T01:07:00+00:00 2024-05-11T01:06:03.991593081Z [2024-05-11T01:06:03.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:06:03.991858748Z [2024-05-11T01:06:03.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:05:00+00:00, run_id=scheduled__2024-05-11T01:05:00+00:00, run_start_date=2024-05-11 01:06:00.172136+00:00, run_end_date=2024-05-11 01:06:03.991552+00:00, run_duration=3.819416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:05:00+00:00, data_interval_end=2024-05-11 01:06:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:06:03.999899185Z [2024-05-11T01:06:03.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:06:00+00:00, run_after=2024-05-11T01:07:00+00:00 2024-05-11T01:06:04.049755699Z [2024-05-11T01:06:04.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:06:04.056147848Z [2024-05-11T01:06:04.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=-1, run_start_date=2024-05-11 01:06:02.265218+00:00, run_end_date=2024-05-11 01:06:03.501718+00:00, run_duration=1.2365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:06:00.237361+00:00, queued_by_job_id=2, pid=10251 2024-05-11T01:06:04.132683467Z [2024-05-11T01:06:04.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:06:04.137266711Z [2024-05-11T01:06:04.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=-1, run_start_date=2024-05-11 01:06:02.207423+00:00, run_end_date=2024-05-11 01:06:03.890799+00:00, run_duration=1.683376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:06:00.237361+00:00, queued_by_job_id=2, pid=10250 2024-05-11T01:07:00.506719736Z [2024-05-11T01:07:00.506+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:07:00.519978323Z [2024-05-11T01:07:00.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:07:00+00:00, run_after=2024-05-11T01:08:00+00:00 2024-05-11T01:07:00.531650619Z [2024-05-11T01:07:00.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:07:00+00:00, run_after=2024-05-11T01:08:00+00:00 2024-05-11T01:07:00.638288925Z [2024-05-11T01:07:00.637+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:07:00.638351305Z 2024-05-11T01:07:00.638362620Z 2024-05-11T01:07:00.638371424Z 2024-05-11T01:07:00.638764056Z [2024-05-11T01:07:00.638+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:07:00.639219074Z [2024-05-11T01:07:00.638+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:07:00.641678082Z [2024-05-11T01:07:00.639+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:07:00.641705482Z [2024-05-11T01:07:00.640+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:07:00.641714606Z 2024-05-11T01:07:00.641722471Z 2024-05-11T01:07:00.641730091Z 2024-05-11T01:07:00.648208723Z [2024-05-11T01:07:00.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:07:00.648736519Z [2024-05-11T01:07:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:07:00.649318640Z [2024-05-11T01:07:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:07:00.649526872Z [2024-05-11T01:07:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:07:00.650021246Z [2024-05-11T01:07:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:07:00.650512994Z [2024-05-11T01:07:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:07:00.834939865Z [2024-05-11T01:07:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status queued for try_number 1 2024-05-11T01:07:00.835091676Z [2024-05-11T01:07:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status queued for try_number 1 2024-05-11T01:07:00.835260472Z [2024-05-11T01:07:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status queued for try_number 1 2024-05-11T01:07:00.843624551Z [2024-05-11T01:07:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7bcab44-1054-4cb2-aa28-9dee0b697631 2024-05-11T01:07:00.843867098Z [2024-05-11T01:07:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6621179-5c83-4177-9290-2841767a1b4e 2024-05-11T01:07:00.844055289Z [2024-05-11T01:07:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 625057c6-15b6-4a49-99b1-11614a6dc7b4 2024-05-11T01:07:02.679803941Z [2024-05-11T01:07:02.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:07:02.680179241Z [2024-05-11T01:07:02.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:06:00+00:00, run_id=scheduled__2024-05-11T01:06:00+00:00, run_start_date=2024-05-11 01:07:00.540587+00:00, run_end_date=2024-05-11 01:07:02.679799+00:00, run_duration=2.139212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:06:00+00:00, data_interval_end=2024-05-11 01:07:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:07:02.690331672Z [2024-05-11T01:07:02.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:07:00+00:00, run_after=2024-05-11T01:08:00+00:00 2024-05-11T01:07:02.811211070Z [2024-05-11T01:07:02.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status success for try_number 1 2024-05-11T01:07:02.818037852Z [2024-05-11T01:07:02.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:06:00+00:00, map_index=-1, run_start_date=2024-05-11 01:07:01.463429+00:00, run_end_date=2024-05-11 01:07:01.896373+00:00, run_duration=0.432944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:07:00.643101+00:00, queued_by_job_id=2, pid=10283 2024-05-11T01:07:03.879884380Z [2024-05-11T01:07:03.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:07:03.880390947Z [2024-05-11T01:07:03.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:06:00+00:00, run_id=scheduled__2024-05-11T01:06:00+00:00, run_start_date=2024-05-11 01:07:00.541673+00:00, run_end_date=2024-05-11 01:07:03.879946+00:00, run_duration=3.338273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:06:00+00:00, data_interval_end=2024-05-11 01:07:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:07:03.892176878Z [2024-05-11T01:07:03.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:07:00+00:00, run_after=2024-05-11T01:08:00+00:00 2024-05-11T01:07:03.945549794Z [2024-05-11T01:07:03.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status success for try_number 1 2024-05-11T01:07:03.951750273Z [2024-05-11T01:07:03.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:06:00+00:00, map_index=-1, run_start_date=2024-05-11 01:07:02.384353+00:00, run_end_date=2024-05-11 01:07:03.589671+00:00, run_duration=1.205318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:07:00.643101+00:00, queued_by_job_id=2, pid=10301 2024-05-11T01:07:04.437581431Z [2024-05-11T01:07:04.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:07:04.438154711Z [2024-05-11T01:07:04.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:06:00+00:00, run_id=scheduled__2024-05-11T01:06:00+00:00, run_start_date=2024-05-11 01:07:00.542680+00:00, run_end_date=2024-05-11 01:07:04.437541+00:00, run_duration=3.894861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:06:00+00:00, data_interval_end=2024-05-11 01:07:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:07:04.448343115Z [2024-05-11T01:07:04.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:07:00+00:00, run_after=2024-05-11T01:08:00+00:00 2024-05-11T01:07:04.490076597Z [2024-05-11T01:07:04.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status success for try_number 1 2024-05-11T01:07:04.497305042Z [2024-05-11T01:07:04.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:06:00+00:00, map_index=-1, run_start_date=2024-05-11 01:07:02.606883+00:00, run_end_date=2024-05-11 01:07:04.136976+00:00, run_duration=1.530093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:07:00.643101+00:00, queued_by_job_id=2, pid=10302 2024-05-11T01:08:00.917502985Z [2024-05-11T01:08:00.916+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:08:00.939046395Z [2024-05-11T01:08:00.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:08:00+00:00, run_after=2024-05-11T01:09:00+00:00 2024-05-11T01:08:00.954794344Z [2024-05-11T01:08:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:08:00+00:00, run_after=2024-05-11T01:09:00+00:00 2024-05-11T01:08:00.963860467Z [2024-05-11T01:08:00.963+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:08:01.092334023Z [2024-05-11T01:08:01.091+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:08:01.092360611Z 2024-05-11T01:08:01.092365332Z 2024-05-11T01:08:01.092369485Z 2024-05-11T01:08:01.092373688Z 2024-05-11T01:08:01.092779027Z [2024-05-11T01:08:01.092+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:08:01.094092347Z [2024-05-11T01:08:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:08:01.096078767Z [2024-05-11T01:08:01.094+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:08:01.096936487Z [2024-05-11T01:08:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:08:01.099030200Z [2024-05-11T01:08:01.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:08:01.099043097Z 2024-05-11T01:08:01.099047075Z 2024-05-11T01:08:01.099050705Z 2024-05-11T01:08:01.099053773Z 2024-05-11T01:08:01.107178541Z [2024-05-11T01:08:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:08:01.107554027Z [2024-05-11T01:08:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:08:01.108018483Z [2024-05-11T01:08:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:08:01.108673609Z [2024-05-11T01:08:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:08:01.109399797Z [2024-05-11T01:08:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:08:01.109778403Z [2024-05-11T01:08:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:08:01.110206909Z [2024-05-11T01:08:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:08:01.110478908Z [2024-05-11T01:08:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:08:01.585620887Z [2024-05-11T01:08:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status queued for try_number 1 2024-05-11T01:08:01.585937847Z [2024-05-11T01:08:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:07:00+00:00 exited with status queued for try_number 1 2024-05-11T01:08:01.586159314Z [2024-05-11T01:08:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:07:00+00:00 exited with status queued for try_number 1 2024-05-11T01:08:01.586489628Z [2024-05-11T01:08:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:07:00+00:00 exited with status queued for try_number 1 2024-05-11T01:08:01.613158971Z [2024-05-11T01:08:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a9548c8-2fd9-45d2-8a0d-012a22cc9fa7 2024-05-11T01:08:01.613360305Z [2024-05-11T01:08:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96d1e998-b0e1-4d6a-b6f9-e6ee89af19f6 2024-05-11T01:08:01.613618225Z [2024-05-11T01:08:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to e155d097-09d8-4c70-b455-c4de002eed20 2024-05-11T01:08:01.613816168Z [2024-05-11T01:08:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb504209-4ba8-481d-b8b9-27d5eee9352d 2024-05-11T01:08:02.535802877Z [2024-05-11T01:08:02.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:08:02.536003810Z [2024-05-11T01:08:02.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:06:00+00:00, run_id=scheduled__2024-05-11T01:06:00+00:00, run_start_date=2024-05-11 01:08:00.988514+00:00, run_end_date=2024-05-11 01:08:02.535623+00:00, run_duration=1.547109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:06:00+00:00, data_interval_end=2024-05-11 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:08:02.544504586Z [2024-05-11T01:08:02.544+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:08:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:08:02.551367744Z [2024-05-11T01:08:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:08:02.551539973Z [2024-05-11T01:08:02.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:07:00+00:00, run_id=scheduled__2024-05-11T01:07:00+00:00, run_start_date=2024-05-11 01:08:00.990774+00:00, run_end_date=2024-05-11 01:08:02.551293+00:00, run_duration=1.560519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:07:00+00:00, data_interval_end=2024-05-11 01:08:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:08:02.560792031Z [2024-05-11T01:08:02.560+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:08:00+00:00, run_after=2024-05-11T01:09:00+00:00 2024-05-11T01:08:02.612408119Z [2024-05-11T01:08:02.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:06:00+00:00 exited with status success for try_number 1 2024-05-11T01:08:02.612430395Z [2024-05-11T01:08:02.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:07:00+00:00 exited with status success for try_number 1 2024-05-11T01:08:02.619394353Z [2024-05-11T01:08:02.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:06:00+00:00, map_index=-1, run_start_date=2024-05-11 01:08:01.923657+00:00, run_end_date=2024-05-11 01:08:02.317565+00:00, run_duration=0.393908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:08:01.101279+00:00, queued_by_job_id=2, pid=10335 2024-05-11T01:08:02.619452473Z [2024-05-11T01:08:02.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:07:00+00:00, map_index=-1, run_start_date=2024-05-11 01:08:02.035275+00:00, run_end_date=2024-05-11 01:08:02.406543+00:00, run_duration=0.371268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:08:01.101279+00:00, queued_by_job_id=2, pid=10336 2024-05-11T01:08:04.814995214Z [2024-05-11T01:08:04.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:08:04.815651000Z [2024-05-11T01:08:04.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:07:00+00:00, run_id=scheduled__2024-05-11T01:07:00+00:00, run_start_date=2024-05-11 01:08:00.992761+00:00, run_end_date=2024-05-11 01:08:04.814768+00:00, run_duration=3.822007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:07:00+00:00, data_interval_end=2024-05-11 01:08:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:08:04.836399065Z [2024-05-11T01:08:04.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:08:00+00:00, run_after=2024-05-11T01:09:00+00:00 2024-05-11T01:08:04.908586824Z [2024-05-11T01:08:04.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:07:00+00:00 exited with status success for try_number 1 2024-05-11T01:08:04.920756628Z [2024-05-11T01:08:04.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:07:00+00:00, map_index=-1, run_start_date=2024-05-11 01:08:02.911772+00:00, run_end_date=2024-05-11 01:08:04.505227+00:00, run_duration=1.593455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:08:01.101279+00:00, queued_by_job_id=2, pid=10359 2024-05-11T01:08:05.977500253Z [2024-05-11T01:08:05.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:08:05.978052220Z [2024-05-11T01:08:05.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:07:00+00:00, run_id=scheduled__2024-05-11T01:07:00+00:00, run_start_date=2024-05-11 01:08:00.994298+00:00, run_end_date=2024-05-11 01:08:05.977346+00:00, run_duration=4.983048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:07:00+00:00, data_interval_end=2024-05-11 01:08:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:08:05.985840583Z [2024-05-11T01:08:05.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:08:00+00:00, run_after=2024-05-11T01:09:00+00:00 2024-05-11T01:08:06.014083269Z [2024-05-11T01:08:06.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:07:00+00:00 exited with status success for try_number 1 2024-05-11T01:08:06.019504977Z [2024-05-11T01:08:06.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:07:00+00:00, map_index=-1, run_start_date=2024-05-11 01:08:02.988786+00:00, run_end_date=2024-05-11 01:08:04.907956+00:00, run_duration=1.91917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:08:01.101279+00:00, queued_by_job_id=2, pid=10360 2024-05-11T01:09:00.215007200Z [2024-05-11T01:09:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:09:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:09:00.221892214Z [2024-05-11T01:09:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:09:00.232566486Z [2024-05-11T01:09:00.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:09:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:09:00.328058739Z [2024-05-11T01:09:00.327+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:09:00.328080515Z 2024-05-11T01:09:00.328083951Z 2024-05-11T01:09:00.328086846Z 2024-05-11T01:09:00.329175977Z [2024-05-11T01:09:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:09:00.329949025Z [2024-05-11T01:09:00.329+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:09:00.329960517Z [2024-05-11T01:09:00.329+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:09:00.330117322Z [2024-05-11T01:09:00.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:09:00.330124148Z 2024-05-11T01:09:00.330127316Z 2024-05-11T01:09:00.330130454Z 2024-05-11T01:09:00.336808601Z [2024-05-11T01:09:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:09:00.336827121Z [2024-05-11T01:09:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:09:00.336830494Z [2024-05-11T01:09:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:09:00.337561128Z [2024-05-11T01:09:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:09:00.337577965Z [2024-05-11T01:09:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:09:00.337581516Z [2024-05-11T01:09:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:09:00.730571472Z [2024-05-11T01:09:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status queued for try_number 1 2024-05-11T01:09:00.730733242Z [2024-05-11T01:09:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status queued for try_number 1 2024-05-11T01:09:00.730844053Z [2024-05-11T01:09:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status queued for try_number 1 2024-05-11T01:09:00.749155548Z [2024-05-11T01:09:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f1f0e75-b4c9-47aa-9abe-190cb7c10780 2024-05-11T01:09:00.749255289Z [2024-05-11T01:09:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d723398-75c5-4ca1-bafb-93b761000c2c 2024-05-11T01:09:00.749433252Z [2024-05-11T01:09:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to a56771c3-d59f-4f10-8092-c1bef8036c4c 2024-05-11T01:09:03.074471779Z [2024-05-11T01:09:03.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:09:03.074732029Z [2024-05-11T01:09:03.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:08:00+00:00, run_id=scheduled__2024-05-11T01:08:00+00:00, run_start_date=2024-05-11 01:09:00.250858+00:00, run_end_date=2024-05-11 01:09:03.074275+00:00, run_duration=2.823417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:08:00+00:00, data_interval_end=2024-05-11 01:09:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:09:03.083337029Z [2024-05-11T01:09:03.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:09:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:09:03.130723201Z [2024-05-11T01:09:03.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status success for try_number 1 2024-05-11T01:09:03.135285821Z [2024-05-11T01:09:03.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:08:00+00:00, map_index=-1, run_start_date=2024-05-11 01:09:01.521292+00:00, run_end_date=2024-05-11 01:09:02.024880+00:00, run_duration=0.503588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:09:00.331099+00:00, queued_by_job_id=2, pid=10393 2024-05-11T01:09:04.765425467Z [2024-05-11T01:09:04.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:09:04.765924850Z [2024-05-11T01:09:04.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:08:00+00:00, run_id=scheduled__2024-05-11T01:08:00+00:00, run_start_date=2024-05-11 01:09:00.251995+00:00, run_end_date=2024-05-11 01:09:04.765222+00:00, run_duration=4.513227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:08:00+00:00, data_interval_end=2024-05-11 01:09:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:09:04.777412810Z [2024-05-11T01:09:04.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:09:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:09:04.822795888Z [2024-05-11T01:09:04.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status success for try_number 1 2024-05-11T01:09:04.829044542Z [2024-05-11T01:09:04.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:08:00+00:00, map_index=-1, run_start_date=2024-05-11 01:09:02.632966+00:00, run_end_date=2024-05-11 01:09:04.267536+00:00, run_duration=1.63457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:09:00.331099+00:00, queued_by_job_id=2, pid=10411 2024-05-11T01:09:06.285507320Z [2024-05-11T01:09:06.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:09:06.285933150Z [2024-05-11T01:09:06.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:08:00+00:00, run_id=scheduled__2024-05-11T01:08:00+00:00, run_start_date=2024-05-11 01:09:00.253030+00:00, run_end_date=2024-05-11 01:09:06.285494+00:00, run_duration=6.032464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:08:00+00:00, data_interval_end=2024-05-11 01:09:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:09:06.298525566Z [2024-05-11T01:09:06.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:09:00+00:00, run_after=2024-05-11T01:10:00+00:00 2024-05-11T01:09:06.354338369Z [2024-05-11T01:09:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status success for try_number 1 2024-05-11T01:09:06.360796965Z [2024-05-11T01:09:06.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:08:00+00:00, map_index=-1, run_start_date=2024-05-11 01:09:02.725859+00:00, run_end_date=2024-05-11 01:09:06.054274+00:00, run_duration=3.328415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:09:00.331099+00:00, queued_by_job_id=2, pid=10412 2024-05-11T01:10:00.711736201Z [2024-05-11T01:10:00.711+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:10:00.730523491Z [2024-05-11T01:10:00.730+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:11:00+00:00 2024-05-11T01:10:00.749796736Z [2024-05-11T01:10:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:11:00+00:00 2024-05-11T01:10:00.760680027Z [2024-05-11T01:10:00.760+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:10:00.774964555Z [2024-05-11T01:10:00.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:10:00.888212907Z [2024-05-11T01:10:00.887+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:10:00.888242151Z 2024-05-11T01:10:00.888247061Z 2024-05-11T01:10:00.888251885Z 2024-05-11T01:10:00.888255905Z 2024-05-11T01:10:00.888260142Z 2024-05-11T01:10:00.888355778Z [2024-05-11T01:10:00.888+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:10:00.888572833Z [2024-05-11T01:10:00.888+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:10:00.888805215Z [2024-05-11T01:10:00.888+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:10:00.889105318Z [2024-05-11T01:10:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:10:00.889310060Z [2024-05-11T01:10:00.889+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:10:00.890850919Z [2024-05-11T01:10:00.890+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:10:00.890909860Z 2024-05-11T01:10:00.890916337Z 2024-05-11T01:10:00.890920789Z 2024-05-11T01:10:00.890924759Z 2024-05-11T01:10:00.890928712Z 2024-05-11T01:10:00.896967135Z [2024-05-11T01:10:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:10:00.897150798Z [2024-05-11T01:10:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:10:00.897480138Z [2024-05-11T01:10:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:10:00.897608655Z [2024-05-11T01:10:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:10:00.897927267Z [2024-05-11T01:10:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:10:00.898084301Z [2024-05-11T01:10:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:10:00.898382661Z [2024-05-11T01:10:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:10:00.898520052Z [2024-05-11T01:10:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:10:00.898792224Z [2024-05-11T01:10:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:10:00.898940738Z [2024-05-11T01:10:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:10:01.503157444Z [2024-05-11T01:10:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:01.505515761Z [2024-05-11T01:10:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:01.505705719Z [2024-05-11T01:10:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:09:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:01.505907889Z [2024-05-11T01:10:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:09:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:01.506082452Z [2024-05-11T01:10:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:09:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:01.518697097Z [2024-05-11T01:10:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1428d98b-a04a-4b11-9d67-c8b72f509a46 2024-05-11T01:10:01.518900000Z [2024-05-11T01:10:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to f881e98a-8963-478b-b23e-5938159779d8 2024-05-11T01:10:01.519091473Z [2024-05-11T01:10:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6aced1b4-6839-409d-b209-609e40a6ad0d 2024-05-11T01:10:01.519293974Z [2024-05-11T01:10:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa7f27c1-05c1-4792-bb08-7b91808dea68 2024-05-11T01:10:01.519561125Z [2024-05-11T01:10:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41cebfd5-98c1-4da8-ae39-253263404ac7 2024-05-11T01:10:02.815823398Z [2024-05-11T01:10:02.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:10:02.820474647Z [2024-05-11T01:10:02.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:08:00+00:00, run_id=scheduled__2024-05-11T01:08:00+00:00, run_start_date=2024-05-11 01:10:00.788792+00:00, run_end_date=2024-05-11 01:10:02.815738+00:00, run_duration=2.026946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:08:00+00:00, data_interval_end=2024-05-11 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:10:02.842726176Z [2024-05-11T01:10:02.842+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:12:00+00:00 2024-05-11T01:10:02.862614363Z [2024-05-11T01:10:02.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:10:02.863285440Z [2024-05-11T01:10:02.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:09:00+00:00, run_id=scheduled__2024-05-11T01:09:00+00:00, run_start_date=2024-05-11 01:10:00.789997+00:00, run_end_date=2024-05-11 01:10:02.862817+00:00, run_duration=2.07282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:09:00+00:00, data_interval_end=2024-05-11 01:10:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:10:02.888638061Z [2024-05-11T01:10:02.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:11:00+00:00 2024-05-11T01:10:03.036803175Z [2024-05-11T01:10:03.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:08:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:03.036877662Z [2024-05-11T01:10:03.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:09:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:03.050093734Z [2024-05-11T01:10:03.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:08:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:01.995915+00:00, run_end_date=2024-05-11 01:10:02.425343+00:00, run_duration=0.429428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:00.892617+00:00, queued_by_job_id=2, pid=10445 2024-05-11T01:10:03.050321719Z [2024-05-11T01:10:03.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:09:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:02.210899+00:00, run_end_date=2024-05-11 01:10:02.619688+00:00, run_duration=0.408789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:00.892617+00:00, queued_by_job_id=2, pid=10447 2024-05-11T01:10:04.739763581Z [2024-05-11T01:10:04.738+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:10:04.739789444Z 2024-05-11T01:10:04.743109347Z [2024-05-11T01:10:04.742+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:10:04.744575838Z [2024-05-11T01:10:04.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:10:04.744593303Z 2024-05-11T01:10:04.750490597Z [2024-05-11T01:10:04.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:10:04.750989479Z [2024-05-11T01:10:04.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:10:04.803385226Z [2024-05-11T01:10:04.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:04.803555173Z [2024-05-11T01:10:04.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:04.814833782Z [2024-05-11T01:10:04.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b2e859b-8340-4b34-8744-57e47c9c2b4d 2024-05-11T01:10:04.815111811Z [2024-05-11T01:10:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:03.768133+00:00, run_end_date=2024-05-11 01:10:04.129601+00:00, run_duration=0.361468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:00.892617+00:00, queued_by_job_id=2, pid=10482 2024-05-11T01:10:05.484066306Z [2024-05-11T01:10:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:10:05.484427949Z [2024-05-11T01:10:05.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:09:00+00:00, run_id=scheduled__2024-05-11T01:09:00+00:00, run_start_date=2024-05-11 01:10:00.792204+00:00, run_end_date=2024-05-11 01:10:05.484125+00:00, run_duration=4.691921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:09:00+00:00, data_interval_end=2024-05-11 01:10:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:10:05.495304788Z [2024-05-11T01:10:05.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:11:00+00:00 2024-05-11T01:10:05.506071763Z [2024-05-11T01:10:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:10:05.506304661Z [2024-05-11T01:10:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:09:00+00:00, run_id=scheduled__2024-05-11T01:09:00+00:00, run_start_date=2024-05-11 01:10:00.791065+00:00, run_end_date=2024-05-11 01:10:05.506031+00:00, run_duration=4.714966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:09:00+00:00, data_interval_end=2024-05-11 01:10:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:10:05.515639043Z [2024-05-11T01:10:05.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:11:00+00:00 2024-05-11T01:10:05.570804756Z [2024-05-11T01:10:05.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:09:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:05.571077902Z [2024-05-11T01:10:05.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:09:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:05.579893849Z [2024-05-11T01:10:05.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:09:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:03.128240+00:00, run_end_date=2024-05-11 01:10:05.277405+00:00, run_duration=2.149165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:00.892617+00:00, queued_by_job_id=2, pid=10470 2024-05-11T01:10:05.580351987Z [2024-05-11T01:10:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:09:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:03.388207+00:00, run_end_date=2024-05-11 01:10:04.958993+00:00, run_duration=1.570786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:00.892617+00:00, queued_by_job_id=2, pid=10471 2024-05-11T01:10:07.789490684Z [2024-05-11T01:10:07.788+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:10:07.789526822Z 2024-05-11T01:10:07.789974847Z [2024-05-11T01:10:07.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:10:07.791193048Z [2024-05-11T01:10:07.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:10:07.791208976Z 2024-05-11T01:10:07.795627500Z [2024-05-11T01:10:07.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:10:07.795727466Z [2024-05-11T01:10:07.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:10:07.872705132Z [2024-05-11T01:10:07.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:07.873220373Z [2024-05-11T01:10:07.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:07.884115599Z [2024-05-11T01:10:07.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74be63c8-b77f-437e-a99a-af492bd023d0 2024-05-11T01:10:07.884473506Z [2024-05-11T01:10:07.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:06.466189+00:00, run_end_date=2024-05-11 01:10:06.859805+00:00, run_duration=0.393616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:04.746211+00:00, queued_by_job_id=2, pid=10510 2024-05-11T01:10:09.899499444Z [2024-05-11T01:10:09.899+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:10:09.899527783Z 2024-05-11T01:10:09.899546607Z [2024-05-11T01:10:09.899+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:10:09.900207103Z [2024-05-11T01:10:09.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:10:09.900218809Z 2024-05-11T01:10:09.902317440Z [2024-05-11T01:10:09.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:10:09.902434632Z [2024-05-11T01:10:09.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:10:09.951520131Z [2024-05-11T01:10:09.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status queued for try_number 1 2024-05-11T01:10:09.951543907Z [2024-05-11T01:10:09.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:09.957231629Z [2024-05-11T01:10:09.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to 970604a0-8656-4b58-bb77-68f5c65fe2ae 2024-05-11T01:10:09.957392842Z [2024-05-11T01:10:09.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=0, run_start_date=2024-05-11 01:10:09.405009+00:00, run_end_date=2024-05-11 01:10:09.765678+00:00, run_duration=0.360669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:07.792001+00:00, queued_by_job_id=2, pid=10521 2024-05-11T01:10:12.705997097Z [2024-05-11T01:10:12.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:10:12.706716321Z [2024-05-11T01:10:12.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:05:00+00:00, run_id=scheduled__2024-05-11T01:05:00+00:00, run_start_date=2024-05-11 01:10:00.787491+00:00, run_end_date=2024-05-11 01:10:12.706164+00:00, run_duration=11.918673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:05:00+00:00, data_interval_end=2024-05-11 01:10:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:10:12.716800283Z [2024-05-11T01:10:12.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:10:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:10:12.760236840Z [2024-05-11T01:10:12.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:05:00+00:00 exited with status success for try_number 1 2024-05-11T01:10:12.766468298Z [2024-05-11T01:10:12.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:05:00+00:00, map_index=-1, run_start_date=2024-05-11 01:10:11.508042+00:00, run_end_date=2024-05-11 01:10:11.936997+00:00, run_duration=0.428955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:10:09.900436+00:00, queued_by_job_id=2, pid=10529 2024-05-11T01:10:35.370559263Z [2024-05-11T01:10:35.370+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:11:00.710223611Z [2024-05-11T01:11:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:11:00+00:00, run_after=2024-05-11T01:12:00+00:00 2024-05-11T01:11:00.718827211Z [2024-05-11T01:11:00.718+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:11:00.731810896Z [2024-05-11T01:11:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:11:00+00:00, run_after=2024-05-11T01:12:00+00:00 2024-05-11T01:11:00.802218692Z [2024-05-11T01:11:00.801+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:11:00.802255037Z 2024-05-11T01:11:00.802261025Z 2024-05-11T01:11:00.802265834Z 2024-05-11T01:11:00.802355884Z [2024-05-11T01:11:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:11:00.802525596Z [2024-05-11T01:11:00.802+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:11:00.802686922Z [2024-05-11T01:11:00.802+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:11:00.803282362Z [2024-05-11T01:11:00.803+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:11:00.803295716Z 2024-05-11T01:11:00.803301530Z 2024-05-11T01:11:00.803305756Z 2024-05-11T01:11:00.806243677Z [2024-05-11T01:11:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:11:00.806395155Z [2024-05-11T01:11:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:11:00.806674920Z [2024-05-11T01:11:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:11:00.806819596Z [2024-05-11T01:11:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:11:00.807077660Z [2024-05-11T01:11:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:11:00.807221295Z [2024-05-11T01:11:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:11:01.194923441Z [2024-05-11T01:11:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:11:01.194951724Z [2024-05-11T01:11:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:11:01.195002723Z [2024-05-11T01:11:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:11:01.218337243Z [2024-05-11T01:11:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0b8d7f4-9350-4ea1-a1c7-3895f0882515 2024-05-11T01:11:01.218445827Z [2024-05-11T01:11:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to f62e8d2a-5595-46a2-84e5-9c20160ef246 2024-05-11T01:11:01.218512513Z [2024-05-11T01:11:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64d57fdf-bb02-4f3c-88c3-436076d52a03 2024-05-11T01:11:03.084467418Z [2024-05-11T01:11:03.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:11:03.084621246Z [2024-05-11T01:11:03.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:10:00+00:00, run_id=scheduled__2024-05-11T01:10:00+00:00, run_start_date=2024-05-11 01:11:00.741628+00:00, run_end_date=2024-05-11 01:11:03.084346+00:00, run_duration=2.342718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:10:00+00:00, data_interval_end=2024-05-11 01:11:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:11:03.096047455Z [2024-05-11T01:11:03.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:11:00+00:00, run_after=2024-05-11T01:12:00+00:00 2024-05-11T01:11:03.150608724Z [2024-05-11T01:11:03.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:11:03.155256916Z [2024-05-11T01:11:03.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:11:01.728195+00:00, run_end_date=2024-05-11 01:11:02.203977+00:00, run_duration=0.475782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:11:00.804003+00:00, queued_by_job_id=2, pid=10538 2024-05-11T01:11:04.192221465Z [2024-05-11T01:11:04.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:11:04.192590259Z [2024-05-11T01:11:04.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:10:00+00:00, run_id=scheduled__2024-05-11T01:10:00+00:00, run_start_date=2024-05-11 01:11:00.742926+00:00, run_end_date=2024-05-11 01:11:04.192092+00:00, run_duration=3.449166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:10:00+00:00, data_interval_end=2024-05-11 01:11:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:11:04.200452852Z [2024-05-11T01:11:04.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:11:00+00:00, run_after=2024-05-11T01:12:00+00:00 2024-05-11T01:11:04.246521514Z [2024-05-11T01:11:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:11:04.255701325Z [2024-05-11T01:11:04.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:11:02.839300+00:00, run_end_date=2024-05-11 01:11:03.988949+00:00, run_duration=1.149649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:11:00.804003+00:00, queued_by_job_id=2, pid=10557 2024-05-11T01:11:05.326552151Z [2024-05-11T01:11:05.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:11:05.327340642Z [2024-05-11T01:11:05.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:10:00+00:00, run_id=scheduled__2024-05-11T01:10:00+00:00, run_start_date=2024-05-11 01:11:00.744024+00:00, run_end_date=2024-05-11 01:11:05.326818+00:00, run_duration=4.582794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:10:00+00:00, data_interval_end=2024-05-11 01:11:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:11:05.342939743Z [2024-05-11T01:11:05.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:11:00+00:00, run_after=2024-05-11T01:12:00+00:00 2024-05-11T01:11:05.395732049Z [2024-05-11T01:11:05.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:11:05.406474913Z [2024-05-11T01:11:05.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:11:02.753497+00:00, run_end_date=2024-05-11 01:11:04.230332+00:00, run_duration=1.476835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:11:00.804003+00:00, queued_by_job_id=2, pid=10556 2024-05-11T01:12:00.354644228Z [2024-05-11T01:12:00.351+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:12:00.365225779Z [2024-05-11T01:12:00.364+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:12:00+00:00, run_after=2024-05-11T01:13:00+00:00 2024-05-11T01:12:00.378296366Z [2024-05-11T01:12:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:12:00+00:00, run_after=2024-05-11T01:13:00+00:00 2024-05-11T01:12:00.385091640Z [2024-05-11T01:12:00.384+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:12:00.471736089Z [2024-05-11T01:12:00.471+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:12:00.471765659Z 2024-05-11T01:12:00.471771926Z 2024-05-11T01:12:00.471794491Z 2024-05-11T01:12:00.471799521Z 2024-05-11T01:12:00.471814216Z [2024-05-11T01:12:00.471+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:12:00.471977414Z [2024-05-11T01:12:00.471+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:12:00.472113458Z [2024-05-11T01:12:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:12:00.472253000Z [2024-05-11T01:12:00.472+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:12:00.473295637Z [2024-05-11T01:12:00.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:12:00.473306555Z 2024-05-11T01:12:00.473311866Z 2024-05-11T01:12:00.473316522Z 2024-05-11T01:12:00.473321170Z 2024-05-11T01:12:00.479866033Z [2024-05-11T01:12:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:12:00.479955204Z [2024-05-11T01:12:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:12:00.480286908Z [2024-05-11T01:12:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:12:00.480440105Z [2024-05-11T01:12:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:12:00.480785601Z [2024-05-11T01:12:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:12:00.480961460Z [2024-05-11T01:12:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:12:00.481227832Z [2024-05-11T01:12:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:12:00.481320352Z [2024-05-11T01:12:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:12:01.010573596Z [2024-05-11T01:12:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:12:01.010612515Z [2024-05-11T01:12:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:11:00+00:00 exited with status queued for try_number 1 2024-05-11T01:12:01.010616512Z [2024-05-11T01:12:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:11:00+00:00 exited with status queued for try_number 1 2024-05-11T01:12:01.010620162Z [2024-05-11T01:12:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:11:00+00:00 exited with status queued for try_number 1 2024-05-11T01:12:01.038023533Z [2024-05-11T01:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcd542e1-01d4-4e7a-b98c-c94e632bc6fb 2024-05-11T01:12:01.038059292Z [2024-05-11T01:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 884d279f-2b7d-477b-b9f4-38add936595a 2024-05-11T01:12:01.061584588Z [2024-05-11T01:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20d74937-ba4e-4c0d-b6be-06cb343ab952 2024-05-11T01:12:01.061614156Z [2024-05-11T01:12:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29026fb3-ac9a-4538-8097-a378fe376d14 2024-05-11T01:12:02.289998128Z [2024-05-11T01:12:02.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:12:02.290983929Z [2024-05-11T01:12:02.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:10:00+00:00, run_id=scheduled__2024-05-11T01:10:00+00:00, run_start_date=2024-05-11 01:12:00.394567+00:00, run_end_date=2024-05-11 01:12:02.289962+00:00, run_duration=1.895395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:10:00+00:00, data_interval_end=2024-05-11 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:12:02.301771957Z [2024-05-11T01:12:02.301+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:12:00+00:00, run_after=2024-05-11T01:14:00+00:00 2024-05-11T01:12:02.309448488Z [2024-05-11T01:12:02.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:12:02.309739039Z [2024-05-11T01:12:02.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:11:00+00:00, run_id=scheduled__2024-05-11T01:11:00+00:00, run_start_date=2024-05-11 01:12:00.395633+00:00, run_end_date=2024-05-11 01:12:02.309331+00:00, run_duration=1.913698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:11:00+00:00, data_interval_end=2024-05-11 01:12:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:12:02.322425468Z [2024-05-11T01:12:02.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:12:00+00:00, run_after=2024-05-11T01:13:00+00:00 2024-05-11T01:12:02.407089166Z [2024-05-11T01:12:02.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:12:02.410503868Z [2024-05-11T01:12:02.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:11:00+00:00 exited with status success for try_number 1 2024-05-11T01:12:02.421839170Z [2024-05-11T01:12:02.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:11:00+00:00, map_index=-1, run_start_date=2024-05-11 01:12:01.415835+00:00, run_end_date=2024-05-11 01:12:01.800551+00:00, run_duration=0.384716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:12:00.474941+00:00, queued_by_job_id=2, pid=10591 2024-05-11T01:12:02.422097987Z [2024-05-11T01:12:02.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:12:01.305824+00:00, run_end_date=2024-05-11 01:12:01.629963+00:00, run_duration=0.324139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:12:00.474941+00:00, queued_by_job_id=2, pid=10590 2024-05-11T01:12:05.721513862Z [2024-05-11T01:12:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:12:05.721692956Z [2024-05-11T01:12:05.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:11:00+00:00, run_id=scheduled__2024-05-11T01:11:00+00:00, run_start_date=2024-05-11 01:12:00.396569+00:00, run_end_date=2024-05-11 01:12:05.721394+00:00, run_duration=5.324825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:11:00+00:00, data_interval_end=2024-05-11 01:12:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:12:05.730206342Z [2024-05-11T01:12:05.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:12:00+00:00, run_after=2024-05-11T01:13:00+00:00 2024-05-11T01:12:05.738119377Z [2024-05-11T01:12:05.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:12:05.738396990Z [2024-05-11T01:12:05.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:11:00+00:00, run_id=scheduled__2024-05-11T01:11:00+00:00, run_start_date=2024-05-11 01:12:00.397544+00:00, run_end_date=2024-05-11 01:12:05.738021+00:00, run_duration=5.340477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:11:00+00:00, data_interval_end=2024-05-11 01:12:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:12:05.754417867Z [2024-05-11T01:12:05.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:12:00+00:00, run_after=2024-05-11T01:13:00+00:00 2024-05-11T01:12:05.795115032Z [2024-05-11T01:12:05.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:11:00+00:00 exited with status success for try_number 1 2024-05-11T01:12:05.795600786Z [2024-05-11T01:12:05.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:11:00+00:00 exited with status success for try_number 1 2024-05-11T01:12:05.803539109Z [2024-05-11T01:12:05.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:11:00+00:00, map_index=-1, run_start_date=2024-05-11 01:12:02.474712+00:00, run_end_date=2024-05-11 01:12:04.940165+00:00, run_duration=2.465453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:12:00.474941+00:00, queued_by_job_id=2, pid=10615 2024-05-11T01:12:05.803860952Z [2024-05-11T01:12:05.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:11:00+00:00, map_index=-1, run_start_date=2024-05-11 01:12:02.404125+00:00, run_end_date=2024-05-11 01:12:05.481636+00:00, run_duration=3.077511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:12:00.474941+00:00, queued_by_job_id=2, pid=10614 2024-05-11T01:13:00.570395146Z [2024-05-11T01:13:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:13:00+00:00, run_after=2024-05-11T01:14:00+00:00 2024-05-11T01:13:00.579391243Z [2024-05-11T01:13:00.579+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:13:00.597931608Z [2024-05-11T01:13:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:13:00+00:00, run_after=2024-05-11T01:14:00+00:00 2024-05-11T01:13:00.685884359Z [2024-05-11T01:13:00.685+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:13:00.685916644Z 2024-05-11T01:13:00.685923746Z 2024-05-11T01:13:00.685929439Z 2024-05-11T01:13:00.685955935Z [2024-05-11T01:13:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:13:00.686304697Z [2024-05-11T01:13:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:13:00.686351844Z [2024-05-11T01:13:00.686+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:13:00.687242986Z [2024-05-11T01:13:00.686+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:13:00.687265789Z 2024-05-11T01:13:00.687274692Z 2024-05-11T01:13:00.687282928Z 2024-05-11T01:13:00.692951996Z [2024-05-11T01:13:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:13:00.693185725Z [2024-05-11T01:13:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:13:00.693614337Z [2024-05-11T01:13:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:13:00.693886060Z [2024-05-11T01:13:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:13:00.694312266Z [2024-05-11T01:13:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:13:00.694559300Z [2024-05-11T01:13:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:13:00.894175173Z [2024-05-11T01:13:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status queued for try_number 1 2024-05-11T01:13:00.895862956Z [2024-05-11T01:13:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status queued for try_number 1 2024-05-11T01:13:00.896018823Z [2024-05-11T01:13:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status queued for try_number 1 2024-05-11T01:13:00.902685400Z [2024-05-11T01:13:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95fcb288-27e0-4b8b-a7e2-b7f7e4b69043 2024-05-11T01:13:00.902828973Z [2024-05-11T01:13:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f391f1e-f1a0-4a4a-b38a-06c6cf36303e 2024-05-11T01:13:00.902983944Z [2024-05-11T01:13:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f2cfb4-b1b0-434f-9be0-8ad36eff5ed2 2024-05-11T01:13:02.057258369Z [2024-05-11T01:13:02.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:13:02.057695688Z [2024-05-11T01:13:02.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:12:00+00:00, run_id=scheduled__2024-05-11T01:12:00+00:00, run_start_date=2024-05-11 01:13:00.608819+00:00, run_end_date=2024-05-11 01:13:02.057336+00:00, run_duration=1.448517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:12:00+00:00, data_interval_end=2024-05-11 01:13:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:13:02.066260668Z [2024-05-11T01:13:02.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:13:00+00:00, run_after=2024-05-11T01:14:00+00:00 2024-05-11T01:13:02.139269857Z [2024-05-11T01:13:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status success for try_number 1 2024-05-11T01:13:02.151115157Z [2024-05-11T01:13:02.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:12:00+00:00, map_index=-1, run_start_date=2024-05-11 01:13:01.589722+00:00, run_end_date=2024-05-11 01:13:01.924527+00:00, run_duration=0.334805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:13:00.688249+00:00, queued_by_job_id=2, pid=10647 2024-05-11T01:13:04.613365458Z [2024-05-11T01:13:04.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:13:04.614159533Z [2024-05-11T01:13:04.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:12:00+00:00, run_id=scheduled__2024-05-11T01:12:00+00:00, run_start_date=2024-05-11 01:13:00.611158+00:00, run_end_date=2024-05-11 01:13:04.613144+00:00, run_duration=4.001986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:12:00+00:00, data_interval_end=2024-05-11 01:13:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:13:04.624096836Z [2024-05-11T01:13:04.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:13:00+00:00, run_after=2024-05-11T01:14:00+00:00 2024-05-11T01:13:04.634343832Z [2024-05-11T01:13:04.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:13:04.634371215Z [2024-05-11T01:13:04.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:12:00+00:00, run_id=scheduled__2024-05-11T01:12:00+00:00, run_start_date=2024-05-11 01:13:00.613345+00:00, run_end_date=2024-05-11 01:13:04.631656+00:00, run_duration=4.018311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:12:00+00:00, data_interval_end=2024-05-11 01:13:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:13:04.648670434Z [2024-05-11T01:13:04.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:13:00+00:00, run_after=2024-05-11T01:14:00+00:00 2024-05-11T01:13:04.699952435Z [2024-05-11T01:13:04.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status success for try_number 1 2024-05-11T01:13:04.700979481Z [2024-05-11T01:13:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status success for try_number 1 2024-05-11T01:13:04.709570127Z [2024-05-11T01:13:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:12:00+00:00, map_index=-1, run_start_date=2024-05-11 01:13:02.420161+00:00, run_end_date=2024-05-11 01:13:03.652472+00:00, run_duration=1.232311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:13:00.688249+00:00, queued_by_job_id=2, pid=10665 2024-05-11T01:13:04.710152805Z [2024-05-11T01:13:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:12:00+00:00, map_index=-1, run_start_date=2024-05-11 01:13:02.504601+00:00, run_end_date=2024-05-11 01:13:04.005547+00:00, run_duration=1.500946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:13:00.688249+00:00, queued_by_job_id=2, pid=10666 2024-05-11T01:14:00.444728139Z [2024-05-11T01:14:00.444+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:14:00.456314293Z [2024-05-11T01:14:00.455+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:14:00.482236414Z [2024-05-11T01:14:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:14:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:14:00.496702691Z [2024-05-11T01:14:00.496+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:14:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:14:00.601695299Z [2024-05-11T01:14:00.601+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:14:00.601722952Z 2024-05-11T01:14:00.601728125Z 2024-05-11T01:14:00.601732392Z 2024-05-11T01:14:00.601736767Z 2024-05-11T01:14:00.602233301Z [2024-05-11T01:14:00.601+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:14:00.602557226Z [2024-05-11T01:14:00.602+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:14:00.602830467Z [2024-05-11T01:14:00.602+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:14:00.603168972Z [2024-05-11T01:14:00.602+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:14:00.604200873Z [2024-05-11T01:14:00.603+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:14:00.604215862Z 2024-05-11T01:14:00.604220890Z 2024-05-11T01:14:00.604225164Z 2024-05-11T01:14:00.604231058Z 2024-05-11T01:14:00.608919403Z [2024-05-11T01:14:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:14:00.609264742Z [2024-05-11T01:14:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:14:00.609662514Z [2024-05-11T01:14:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:14:00.610045244Z [2024-05-11T01:14:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:14:00.610436971Z [2024-05-11T01:14:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:14:00.610714986Z [2024-05-11T01:14:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:14:00.611079195Z [2024-05-11T01:14:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:14:00.611393560Z [2024-05-11T01:14:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:14:01.110033607Z [2024-05-11T01:14:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status queued for try_number 1 2024-05-11T01:14:01.110071296Z [2024-05-11T01:14:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:13:00+00:00 exited with status queued for try_number 1 2024-05-11T01:14:01.110075378Z [2024-05-11T01:14:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:13:00+00:00 exited with status queued for try_number 1 2024-05-11T01:14:01.110078682Z [2024-05-11T01:14:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:13:00+00:00 exited with status queued for try_number 1 2024-05-11T01:14:01.157792019Z [2024-05-11T01:14:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4060cc72-fa16-4242-b83b-44275d7645b1 2024-05-11T01:14:01.158683977Z [2024-05-11T01:14:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16b5274a-bff4-4f96-83e2-62397987cfbe 2024-05-11T01:14:01.158861233Z [2024-05-11T01:14:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5179f41b-0849-4b22-ab1f-b338774d9a12 2024-05-11T01:14:01.159244295Z [2024-05-11T01:14:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55aa4b04-5f64-4112-b602-fc420fd8fd78 2024-05-11T01:14:02.362211301Z [2024-05-11T01:14:02.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:14:02.362720905Z [2024-05-11T01:14:02.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:12:00+00:00, run_id=scheduled__2024-05-11T01:12:00+00:00, run_start_date=2024-05-11 01:14:00.510446+00:00, run_end_date=2024-05-11 01:14:02.362214+00:00, run_duration=1.851768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:12:00+00:00, data_interval_end=2024-05-11 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:14:02.372064888Z [2024-05-11T01:14:02.371+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:14:00+00:00, run_after=2024-05-11T01:16:00+00:00 2024-05-11T01:14:02.380921924Z [2024-05-11T01:14:02.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:14:02.381310276Z [2024-05-11T01:14:02.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:13:00+00:00, run_id=scheduled__2024-05-11T01:13:00+00:00, run_start_date=2024-05-11 01:14:00.511663+00:00, run_end_date=2024-05-11 01:14:02.380975+00:00, run_duration=1.869312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:13:00+00:00, data_interval_end=2024-05-11 01:14:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:14:02.393623372Z [2024-05-11T01:14:02.393+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:14:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:14:02.461017740Z [2024-05-11T01:14:02.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:12:00+00:00 exited with status success for try_number 1 2024-05-11T01:14:02.461161755Z [2024-05-11T01:14:02.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:13:00+00:00 exited with status success for try_number 1 2024-05-11T01:14:02.471295680Z [2024-05-11T01:14:02.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:12:00+00:00, map_index=-1, run_start_date=2024-05-11 01:14:01.555874+00:00, run_end_date=2024-05-11 01:14:02.058705+00:00, run_duration=0.502831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:14:00.605613+00:00, queued_by_job_id=2, pid=10699 2024-05-11T01:14:02.471575920Z [2024-05-11T01:14:02.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:13:00+00:00, map_index=-1, run_start_date=2024-05-11 01:14:01.706195+00:00, run_end_date=2024-05-11 01:14:02.131265+00:00, run_duration=0.42507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:14:00.605613+00:00, queued_by_job_id=2, pid=10700 2024-05-11T01:14:04.464293515Z [2024-05-11T01:14:04.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:14:04.464750223Z [2024-05-11T01:14:04.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:13:00+00:00, run_id=scheduled__2024-05-11T01:13:00+00:00, run_start_date=2024-05-11 01:14:00.512680+00:00, run_end_date=2024-05-11 01:14:04.464250+00:00, run_duration=3.95157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:13:00+00:00, data_interval_end=2024-05-11 01:14:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:14:04.477843142Z [2024-05-11T01:14:04.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:14:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:14:04.546114336Z [2024-05-11T01:14:04.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:13:00+00:00 exited with status success for try_number 1 2024-05-11T01:14:04.557563166Z [2024-05-11T01:14:04.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:13:00+00:00, map_index=-1, run_start_date=2024-05-11 01:14:02.668848+00:00, run_end_date=2024-05-11 01:14:04.139288+00:00, run_duration=1.47044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:14:00.605613+00:00, queued_by_job_id=2, pid=10723 2024-05-11T01:14:05.638015911Z [2024-05-11T01:14:05.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:14:05.638047827Z [2024-05-11T01:14:05.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:13:00+00:00, run_id=scheduled__2024-05-11T01:13:00+00:00, run_start_date=2024-05-11 01:14:00.513701+00:00, run_end_date=2024-05-11 01:14:05.632539+00:00, run_duration=5.118838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:13:00+00:00, data_interval_end=2024-05-11 01:14:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:14:05.648575009Z [2024-05-11T01:14:05.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:14:00+00:00, run_after=2024-05-11T01:15:00+00:00 2024-05-11T01:14:05.706084176Z [2024-05-11T01:14:05.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:13:00+00:00 exited with status success for try_number 1 2024-05-11T01:14:05.708968023Z [2024-05-11T01:14:05.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:13:00+00:00, map_index=-1, run_start_date=2024-05-11 01:14:02.808270+00:00, run_end_date=2024-05-11 01:14:04.642248+00:00, run_duration=1.833978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:14:00.605613+00:00, queued_by_job_id=2, pid=10724 2024-05-11T01:14:38.947596950Z [2024-05-11T01:14:38.947+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:14:38.947629227Z 2024-05-11T01:14:38.947917286Z [2024-05-11T01:14:38.947+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-11T01:14:38.948839021Z [2024-05-11T01:14:38.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:14:38.948852633Z 2024-05-11T01:14:38.952325590Z [2024-05-11T01:14:38.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240511011437_080449', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:14:38.952340965Z [2024-05-11T01:14:38.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240511011437_080449', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-11T01:14:39.016791760Z [2024-05-11T01:14:39.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240511011437_080449 exited with status queued for try_number 1 2024-05-11T01:14:39.022122913Z [2024-05-11T01:14:39.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b99525b-c272-4fcf-9b31-c8108c0227eb 2024-05-11T01:14:40.179078309Z [2024-05-11T01:14:40.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:14:40.179261829Z [2024-05-11T01:14:40.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-11 01:14:38.023466+00:00, run_id=vdu_down_20240511011437_080449, run_start_date=2024-05-11 01:14:38.907180+00:00, run_end_date=2024-05-11 01:14:40.178917+00:00, run_duration=1.271737, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 01:14:38.023466+00:00, data_interval_end=2024-05-11 01:14:38.023466+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-11T01:14:40.182416964Z [2024-05-11T01:14:40.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-11T01:14:40.222451636Z [2024-05-11T01:14:40.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240511011437_080449 exited with status success for try_number 1 2024-05-11T01:14:40.230074883Z [2024-05-11T01:14:40.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240511011437_080449, map_index=-1, run_start_date=2024-05-11 01:14:39.622686+00:00, run_end_date=2024-05-11 01:14:40.038732+00:00, run_duration=0.416046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:14:38.949241+00:00, queued_by_job_id=2, pid=10750 2024-05-11T01:15:00.569200192Z [2024-05-11T01:15:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:16:00+00:00 2024-05-11T01:15:00.587233996Z [2024-05-11T01:15:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:15:00.602500462Z [2024-05-11T01:15:00.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:16:00+00:00 2024-05-11T01:15:00.612576943Z [2024-05-11T01:15:00.612+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:15:00.722787489Z [2024-05-11T01:15:00.722+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:15:00.722825611Z 2024-05-11T01:15:00.722858831Z 2024-05-11T01:15:00.722865908Z 2024-05-11T01:15:00.722872213Z 2024-05-11T01:15:00.722904137Z [2024-05-11T01:15:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:15:00.722919325Z [2024-05-11T01:15:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:15:00.723082408Z [2024-05-11T01:15:00.722+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:15:00.723188284Z [2024-05-11T01:15:00.723+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:15:00.723852288Z [2024-05-11T01:15:00.723+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:15:00.723865940Z 2024-05-11T01:15:00.723872235Z 2024-05-11T01:15:00.723878043Z 2024-05-11T01:15:00.723883787Z 2024-05-11T01:15:00.728264287Z [2024-05-11T01:15:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:15:00.728878349Z [2024-05-11T01:15:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:15:00.729135845Z [2024-05-11T01:15:00.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:15:00.729229507Z [2024-05-11T01:15:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:15:00.729448892Z [2024-05-11T01:15:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:15:00.729536617Z [2024-05-11T01:15:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:15:00.729755962Z [2024-05-11T01:15:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:15:00.729843953Z [2024-05-11T01:15:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:15:01.153009810Z [2024-05-11T01:15:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:01.153224799Z [2024-05-11T01:15:01.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:01.153370807Z [2024-05-11T01:15:01.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:01.153515198Z [2024-05-11T01:15:01.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:01.164939650Z [2024-05-11T01:15:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46fa527a-fc43-4e0c-bd8d-4bae88a22a53 2024-05-11T01:15:01.165311351Z [2024-05-11T01:15:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66dd838c-3409-4e47-acde-23151e24023f 2024-05-11T01:15:01.165576799Z [2024-05-11T01:15:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf24e38c-dd03-478d-9d82-f328dc883304 2024-05-11T01:15:01.165846703Z [2024-05-11T01:15:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to def2b5dc-78c8-4d81-9ed7-9c19ca98a8f8 2024-05-11T01:15:02.361162429Z [2024-05-11T01:15:02.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:15:02.361368306Z [2024-05-11T01:15:02.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:14:00+00:00, run_id=scheduled__2024-05-11T01:14:00+00:00, run_start_date=2024-05-11 01:15:00.627363+00:00, run_end_date=2024-05-11 01:15:02.361050+00:00, run_duration=1.733687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:14:00+00:00, data_interval_end=2024-05-11 01:15:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:15:02.371738562Z [2024-05-11T01:15:02.371+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:16:00+00:00 2024-05-11T01:15:02.418238002Z [2024-05-11T01:15:02.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:02.425828181Z [2024-05-11T01:15:02.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:14:00+00:00, map_index=-1, run_start_date=2024-05-11 01:15:01.780083+00:00, run_end_date=2024-05-11 01:15:02.150189+00:00, run_duration=0.370106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:00.724839+00:00, queued_by_job_id=2, pid=10766 2024-05-11T01:15:03.518700561Z [2024-05-11T01:15:03.518+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:15:03.518746566Z 2024-05-11T01:15:03.518899601Z [2024-05-11T01:15:03.518+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:15:03.519516504Z [2024-05-11T01:15:03.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:15:03.519535369Z 2024-05-11T01:15:03.523204528Z [2024-05-11T01:15:03.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:15:03.523226978Z [2024-05-11T01:15:03.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:15:03.572449624Z [2024-05-11T01:15:03.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:03.572814037Z [2024-05-11T01:15:03.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:03.584036852Z [2024-05-11T01:15:03.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87bc128b-cfe0-42b4-ac47-bc8ca41077e5 2024-05-11T01:15:03.584263118Z [2024-05-11T01:15:03.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:15:02.924023+00:00, run_end_date=2024-05-11 01:15:03.263721+00:00, run_duration=0.339698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:00.724839+00:00, queued_by_job_id=2, pid=10792 2024-05-11T01:15:05.021517049Z [2024-05-11T01:15:05.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:15:05.021812377Z [2024-05-11T01:15:05.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:14:00+00:00, run_id=scheduled__2024-05-11T01:14:00+00:00, run_start_date=2024-05-11 01:15:00.628688+00:00, run_end_date=2024-05-11 01:15:05.021407+00:00, run_duration=4.392719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:14:00+00:00, data_interval_end=2024-05-11 01:15:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:15:05.034135372Z [2024-05-11T01:15:05.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:16:00+00:00 2024-05-11T01:15:05.041177454Z [2024-05-11T01:15:05.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:15:05.041386067Z [2024-05-11T01:15:05.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:14:00+00:00, run_id=scheduled__2024-05-11T01:14:00+00:00, run_start_date=2024-05-11 01:15:00.630161+00:00, run_end_date=2024-05-11 01:15:05.041062+00:00, run_duration=4.410901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:14:00+00:00, data_interval_end=2024-05-11 01:15:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:15:05.050280761Z [2024-05-11T01:15:05.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:16:00+00:00 2024-05-11T01:15:05.104478096Z [2024-05-11T01:15:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:05.104511047Z [2024-05-11T01:15:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:05.113179217Z [2024-05-11T01:15:05.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:14:00+00:00, map_index=-1, run_start_date=2024-05-11 01:15:02.734768+00:00, run_end_date=2024-05-11 01:15:03.943013+00:00, run_duration=1.208245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:00.724839+00:00, queued_by_job_id=2, pid=10791 2024-05-11T01:15:05.113325950Z [2024-05-11T01:15:05.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:14:00+00:00, map_index=-1, run_start_date=2024-05-11 01:15:02.671425+00:00, run_end_date=2024-05-11 01:15:04.411151+00:00, run_duration=1.739726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:00.724839+00:00, queued_by_job_id=2, pid=10789 2024-05-11T01:15:06.174773304Z [2024-05-11T01:15:06.174+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:15:06.174805912Z 2024-05-11T01:15:06.174880793Z [2024-05-11T01:15:06.174+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:15:06.175272856Z [2024-05-11T01:15:06.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:15:06.175283485Z 2024-05-11T01:15:06.177064348Z [2024-05-11T01:15:06.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:15:06.177138303Z [2024-05-11T01:15:06.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:15:06.239765726Z [2024-05-11T01:15:06.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:06.239895954Z [2024-05-11T01:15:06.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:06.247818889Z [2024-05-11T01:15:06.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a3e2607-6145-4af6-bf6d-199c2ed3b1c9 2024-05-11T01:15:06.248541031Z [2024-05-11T01:15:06.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:15:05.279633+00:00, run_end_date=2024-05-11 01:15:05.611569+00:00, run_duration=0.331936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:03.519951+00:00, queued_by_job_id=2, pid=10824 2024-05-11T01:15:09.164888613Z [2024-05-11T01:15:09.164+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:15:09.164921979Z 2024-05-11T01:15:09.165331914Z [2024-05-11T01:15:09.165+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:15:09.166434945Z [2024-05-11T01:15:09.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:15:09.166455109Z 2024-05-11T01:15:09.169731471Z [2024-05-11T01:15:09.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:15:09.170139089Z [2024-05-11T01:15:09.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:15:09.245188561Z [2024-05-11T01:15:09.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:15:09.245495799Z [2024-05-11T01:15:09.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:09.256524199Z [2024-05-11T01:15:09.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to 703a983b-9343-4222-b549-ce61d8b4e265 2024-05-11T01:15:09.257138842Z [2024-05-11T01:15:09.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=0, run_start_date=2024-05-11 01:15:07.922164+00:00, run_end_date=2024-05-11 01:15:08.220162+00:00, run_duration=0.297998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:06.175505+00:00, queued_by_job_id=2, pid=10835 2024-05-11T01:15:11.316284466Z [2024-05-11T01:15:11.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:15:11.316746247Z [2024-05-11T01:15:11.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:10:00+00:00, run_id=scheduled__2024-05-11T01:10:00+00:00, run_start_date=2024-05-11 01:15:00.626035+00:00, run_end_date=2024-05-11 01:15:11.316207+00:00, run_duration=10.690172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:10:00+00:00, data_interval_end=2024-05-11 01:15:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:15:11.323411503Z [2024-05-11T01:15:11.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:15:11.354649120Z [2024-05-11T01:15:11.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:15:11.360812517Z [2024-05-11T01:15:11.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:15:10.798714+00:00, run_end_date=2024-05-11 01:15:11.165016+00:00, run_duration=0.366302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:15:09.167246+00:00, queued_by_job_id=2, pid=10843 2024-05-11T01:15:35.434631729Z [2024-05-11T01:15:35.434+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:16:00.263333123Z [2024-05-11T01:16:00.262+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:16:00.280894714Z [2024-05-11T01:16:00.280+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:16:00.312583670Z [2024-05-11T01:16:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:00.337643532Z [2024-05-11T01:16:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:00.426705156Z [2024-05-11T01:16:00.426+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:16:00.426748881Z 2024-05-11T01:16:00.426767084Z 2024-05-11T01:16:00.426776193Z 2024-05-11T01:16:00.426785217Z 2024-05-11T01:16:00.426794412Z [2024-05-11T01:16:00.426+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:16:00.426817289Z [2024-05-11T01:16:00.426+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:16:00.426892543Z [2024-05-11T01:16:00.426+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:16:00.427014029Z [2024-05-11T01:16:00.426+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:16:00.427694433Z [2024-05-11T01:16:00.427+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:00.427727510Z 2024-05-11T01:16:00.427736797Z 2024-05-11T01:16:00.427745216Z 2024-05-11T01:16:00.427753507Z 2024-05-11T01:16:00.432017036Z [2024-05-11T01:16:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:00.432055202Z [2024-05-11T01:16:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:16:00.432108535Z [2024-05-11T01:16:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:00.432387573Z [2024-05-11T01:16:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:16:00.432595643Z [2024-05-11T01:16:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:00.432638345Z [2024-05-11T01:16:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:16:00.432911978Z [2024-05-11T01:16:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:00.432952403Z [2024-05-11T01:16:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:16:01.024236873Z [2024-05-11T01:16:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:01.024262277Z [2024-05-11T01:16:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:01.024266027Z [2024-05-11T01:16:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:01.024269412Z [2024-05-11T01:16:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:01.046549712Z [2024-05-11T01:16:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61f8c9b0-79f3-405b-b426-c64c468a604c 2024-05-11T01:16:01.046576553Z [2024-05-11T01:16:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dad7a61-037e-4c14-82fd-6b25dfbfba57 2024-05-11T01:16:01.046580425Z [2024-05-11T01:16:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to df3e130c-3eb5-4c4c-ab2c-d338494668f4 2024-05-11T01:16:01.046595702Z [2024-05-11T01:16:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to db5a265e-8cb4-4ef8-9bdf-415416db5b14 2024-05-11T01:16:02.153500328Z [2024-05-11T01:16:02.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:02.153846158Z [2024-05-11T01:16:02.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:14:00+00:00, run_id=scheduled__2024-05-11T01:14:00+00:00, run_start_date=2024-05-11 01:16:00.349008+00:00, run_end_date=2024-05-11 01:16:02.153355+00:00, run_duration=1.804347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:14:00+00:00, data_interval_end=2024-05-11 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:16:02.161768817Z [2024-05-11T01:16:02.161+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:16:02.169730781Z [2024-05-11T01:16:02.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:02.170091405Z [2024-05-11T01:16:02.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:15:00+00:00, run_id=scheduled__2024-05-11T01:15:00+00:00, run_start_date=2024-05-11 01:16:00.350667+00:00, run_end_date=2024-05-11 01:16:02.169645+00:00, run_duration=1.818978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:15:00+00:00, data_interval_end=2024-05-11 01:16:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:16:02.183149208Z [2024-05-11T01:16:02.182+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:02.243900538Z [2024-05-11T01:16:02.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:14:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:02.244092798Z [2024-05-11T01:16:02.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:02.252465101Z [2024-05-11T01:16:02.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:14:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:01.292414+00:00, run_end_date=2024-05-11 01:16:01.633634+00:00, run_duration=0.34122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:00.428627+00:00, queued_by_job_id=2, pid=10853 2024-05-11T01:16:02.253375169Z [2024-05-11T01:16:02.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:01.359887+00:00, run_end_date=2024-05-11 01:16:01.774093+00:00, run_duration=0.414206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:00.428627+00:00, queued_by_job_id=2, pid=10854 2024-05-11T01:16:04.327085141Z [2024-05-11T01:16:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:04.327769960Z [2024-05-11T01:16:04.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:15:00+00:00, run_id=scheduled__2024-05-11T01:15:00+00:00, run_start_date=2024-05-11 01:16:00.351979+00:00, run_end_date=2024-05-11 01:16:04.327195+00:00, run_duration=3.975216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:15:00+00:00, data_interval_end=2024-05-11 01:16:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:16:04.341158693Z [2024-05-11T01:16:04.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:04.350063719Z [2024-05-11T01:16:04.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:04.351127559Z [2024-05-11T01:16:04.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:15:00+00:00, run_id=scheduled__2024-05-11T01:15:00+00:00, run_start_date=2024-05-11 01:16:00.353242+00:00, run_end_date=2024-05-11 01:16:04.350293+00:00, run_duration=3.997051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:15:00+00:00, data_interval_end=2024-05-11 01:16:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:16:04.364615634Z [2024-05-11T01:16:04.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:04.400453257Z [2024-05-11T01:16:04.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:04.400767785Z [2024-05-11T01:16:04.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:04.407200696Z [2024-05-11T01:16:04.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:02.427219+00:00, run_end_date=2024-05-11 01:16:03.849734+00:00, run_duration=1.422515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:00.428627+00:00, queued_by_job_id=2, pid=10878 2024-05-11T01:16:04.407463205Z [2024-05-11T01:16:04.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:02.364806+00:00, run_end_date=2024-05-11 01:16:04.061728+00:00, run_duration=1.696922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:00.428627+00:00, queued_by_job_id=2, pid=10877 2024-05-11T01:16:19.618722569Z [2024-05-11T01:16:19.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:19.663457119Z [2024-05-11T01:16:19.662+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:16:19.663494900Z 2024-05-11T01:16:19.663501744Z [2024-05-11T01:16:19.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:16:19.663922996Z [2024-05-11T01:16:19.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:19.663939293Z 2024-05-11T01:16:19.666282325Z [2024-05-11T01:16:19.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:19.666298022Z [2024-05-11T01:16:19.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:16:19.726509083Z [2024-05-11T01:16:19.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:19.738385712Z [2024-05-11T01:16:19.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3e40fcf-5b7b-4b2b-8230-3db20a80b3e7 2024-05-11T01:16:23.620024399Z [2024-05-11T01:16:23.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:23.621000004Z [2024-05-11T01:16:23.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:15:00+00:00, run_id=scheduled__2024-05-11T01:15:00+00:00, run_start_date=2024-05-11 01:16:19.630518+00:00, run_end_date=2024-05-11 01:16:23.619919+00:00, run_duration=3.989401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:15:00+00:00, data_interval_end=2024-05-11 01:16:00+00:00, dag_hash=cfb4254e5b59f5284ec982da6faf73be 2024-05-11T01:16:23.629842563Z [2024-05-11T01:16:23.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:23.657170108Z [2024-05-11T01:16:23.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:23.663124069Z [2024-05-11T01:16:23.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:21.235963+00:00, run_end_date=2024-05-11 01:16:22.488515+00:00, run_duration=1.252552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:19.664124+00:00, queued_by_job_id=2, pid=10909 2024-05-11T01:16:24.514949171Z [2024-05-11T01:16:24.514+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:16:24.557632377Z [2024-05-11T01:16:24.557+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:16:24.557656997Z 2024-05-11T01:16:24.557666626Z [2024-05-11T01:16:24.557+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:16:24.558420763Z [2024-05-11T01:16:24.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:24.558431863Z 2024-05-11T01:16:24.560854874Z [2024-05-11T01:16:24.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:24.560868533Z [2024-05-11T01:16:24.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:16:24.631408469Z [2024-05-11T01:16:24.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:24.641047183Z [2024-05-11T01:16:24.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 647eb952-62a7-43a5-a179-84be14808242 2024-05-11T01:16:25.769839108Z [2024-05-11T01:16:25.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:16:25.814913361Z [2024-05-11T01:16:25.814+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:16:25.815144396Z 2024-05-11T01:16:25.815169090Z [2024-05-11T01:16:25.814+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:16:25.815475975Z [2024-05-11T01:16:25.815+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:25.815503990Z 2024-05-11T01:16:25.818510423Z [2024-05-11T01:16:25.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:16:25.818623726Z [2024-05-11T01:16:25.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:16:25.864834056Z [2024-05-11T01:16:25.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:25.871208040Z [2024-05-11T01:16:25.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0837d06-9f03-4300-94b5-43964b3ef5df 2024-05-11T01:16:28.757151138Z [2024-05-11T01:16:28.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:28.757464012Z [2024-05-11T01:16:28.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:15:00+00:00, run_id=scheduled__2024-05-11T01:15:00+00:00, run_start_date=2024-05-11 01:16:24.524887+00:00, run_end_date=2024-05-11 01:16:28.756987+00:00, run_duration=4.2321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:15:00+00:00, data_interval_end=2024-05-11 01:16:00+00:00, dag_hash=422e20a2a7e25bd0ee32c5ddb57d6235 2024-05-11T01:16:28.769634100Z [2024-05-11T01:16:28.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:16:00+00:00, run_after=2024-05-11T01:17:00+00:00 2024-05-11T01:16:28.796852993Z [2024-05-11T01:16:28.796+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:16:28.796880817Z 2024-05-11T01:16:28.796888670Z [2024-05-11T01:16:28.796+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:16:28.797764353Z [2024-05-11T01:16:28.797+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:28.797783658Z 2024-05-11T01:16:28.800699767Z [2024-05-11T01:16:28.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='split_metrics', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:16:28.800731094Z [2024-05-11T01:16:28.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'split_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:16:28.852431831Z [2024-05-11T01:16:28.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.split_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:28.852998736Z [2024-05-11T01:16:28.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:28.853351236Z [2024-05-11T01:16:28.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:28.870987352Z [2024-05-11T01:16:28.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:27.421749+00:00, run_end_date=2024-05-11 01:16:27.763388+00:00, run_duration=0.341639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:25.816004+00:00, queued_by_job_id=2, pid=10935 2024-05-11T01:16:28.871481713Z [2024-05-11T01:16:28.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a0eecbc-525c-4f9d-92b8-cdffc2087407 2024-05-11T01:16:28.871845973Z [2024-05-11T01:16:28.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:26.156208+00:00, run_end_date=2024-05-11 01:16:27.673505+00:00, run_duration=1.517297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:24.558743+00:00, queued_by_job_id=2, pid=10923 2024-05-11T01:16:31.123012829Z [2024-05-11T01:16:31.122+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:16:31.123051031Z 2024-05-11T01:16:31.123288046Z [2024-05-11T01:16:31.122+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:16:31.123994418Z [2024-05-11T01:16:31.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:31.124008148Z 2024-05-11T01:16:31.127004376Z [2024-05-11T01:16:31.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:16:31.127363472Z [2024-05-11T01:16:31.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'collect_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:16:31.201176845Z [2024-05-11T01:16:31.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.collect_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:31.201321270Z [2024-05-11T01:16:31.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.split_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:31.209268112Z [2024-05-11T01:16:31.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92e2821e-2a9d-4b80-98a4-317092d9b6e6 2024-05-11T01:16:31.209492835Z [2024-05-11T01:16:31.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=split_metrics, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:30.366537+00:00, run_end_date=2024-05-11 01:16:30.703211+00:00, run_duration=0.336674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:28.798260+00:00, queued_by_job_id=2, pid=10948 2024-05-11T01:16:33.869007382Z [2024-05-11T01:16:33.868+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:16:33.869036892Z 2024-05-11T01:16:33.869304085Z [2024-05-11T01:16:33.869+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:16:33.869991524Z [2024-05-11T01:16:33.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:16:33.870005545Z 2024-05-11T01:16:33.872191830Z [2024-05-11T01:16:33.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:16:33.872518830Z [2024-05-11T01:16:33.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'send_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:16:33.926635099Z [2024-05-11T01:16:33.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.send_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status queued for try_number 1 2024-05-11T01:16:33.926801472Z [2024-05-11T01:16:33.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.collect_metrics run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:33.931708506Z [2024-05-11T01:16:33.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cc0ad81-2f47-4295-be33-359c3d2a4b51 2024-05-11T01:16:33.931975729Z [2024-05-11T01:16:33.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=0, run_start_date=2024-05-11 01:16:32.708936+00:00, run_end_date=2024-05-11 01:16:33.041111+00:00, run_duration=0.332175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:31.124569+00:00, queued_by_job_id=2, pid=10956 2024-05-11T01:16:36.852857902Z [2024-05-11T01:16:36.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:16:36.853184974Z [2024-05-11T01:16:36.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:10:00+00:00, run_id=scheduled__2024-05-11T01:10:00+00:00, run_start_date=2024-05-11 01:16:25.778547+00:00, run_end_date=2024-05-11 01:16:36.852860+00:00, run_duration=11.074313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:10:00+00:00, data_interval_end=2024-05-11 01:15:00+00:00, dag_hash=a6d12d083055e35fb16d50424f1e7403 2024-05-11T01:16:36.859525025Z [2024-05-11T01:16:36.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:15:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:16:36.903734097Z [2024-05-11T01:16:36.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.send_prometheus run_id=scheduled__2024-05-11T01:10:00+00:00 exited with status success for try_number 1 2024-05-11T01:16:36.912650153Z [2024-05-11T01:16:36.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:10:00+00:00, map_index=-1, run_start_date=2024-05-11 01:16:35.390750+00:00, run_end_date=2024-05-11 01:16:35.773995+00:00, run_duration=0.383245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:16:33.870403+00:00, queued_by_job_id=2, pid=10964 2024-05-11T01:17:00.261328045Z [2024-05-11T01:17:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:00.272872304Z [2024-05-11T01:17:00.272+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:17:00.285775466Z [2024-05-11T01:17:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:17:00.308088538Z [2024-05-11T01:17:00.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:00.339614471Z [2024-05-11T01:17:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:00.471003307Z [2024-05-11T01:17:00.470+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:17:00.471047993Z 2024-05-11T01:17:00.471053467Z 2024-05-11T01:17:00.471065039Z 2024-05-11T01:17:00.471088940Z 2024-05-11T01:17:00.471093796Z 2024-05-11T01:17:00.471164469Z [2024-05-11T01:17:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:17:00.471442547Z [2024-05-11T01:17:00.471+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:17:00.471610260Z [2024-05-11T01:17:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:17:00.471799171Z [2024-05-11T01:17:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:17:00.471987873Z [2024-05-11T01:17:00.471+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:17:00.473122120Z [2024-05-11T01:17:00.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:17:00.473161256Z 2024-05-11T01:17:00.473171443Z 2024-05-11T01:17:00.473180036Z 2024-05-11T01:17:00.473188555Z 2024-05-11T01:17:00.473197162Z 2024-05-11T01:17:00.480973846Z [2024-05-11T01:17:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:00.481038396Z [2024-05-11T01:17:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:17:00.481620547Z [2024-05-11T01:17:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:00.481655458Z [2024-05-11T01:17:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:17:00.482188481Z [2024-05-11T01:17:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:00.482429589Z [2024-05-11T01:17:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:17:00.482754498Z [2024-05-11T01:17:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:00.482887021Z [2024-05-11T01:17:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:17:00.483194798Z [2024-05-11T01:17:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:00.483334744Z [2024-05-11T01:17:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:17:01.249767438Z [2024-05-11T01:17:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 1 2024-05-11T01:17:01.250108224Z [2024-05-11T01:17:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 1 2024-05-11T01:17:01.250281433Z [2024-05-11T01:17:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 1 2024-05-11T01:17:01.250433961Z [2024-05-11T01:17:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 1 2024-05-11T01:17:01.250581346Z [2024-05-11T01:17:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 1 2024-05-11T01:17:01.274350836Z [2024-05-11T01:17:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01cfa2ea-b7d5-4821-88cd-ea06f618dd90 2024-05-11T01:17:01.274626466Z [2024-05-11T01:17:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 815deb00-39b1-48d8-af20-e1d4ac8c670d 2024-05-11T01:17:01.275459602Z [2024-05-11T01:17:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to 775518a2-bae7-4c98-9540-46940cacaf79 2024-05-11T01:17:01.277839557Z [2024-05-11T01:17:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb7e95ad-dd40-4c0f-baa5-2fb9b8fdb78c 2024-05-11T01:17:01.278064277Z [2024-05-11T01:17:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f1c21b5-a138-4807-bf41-840da5bf088f 2024-05-11T01:17:02.639911572Z [2024-05-11T01:17:02.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:17:02.640492739Z [2024-05-11T01:17:02.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:16:00+00:00, run_id=scheduled__2024-05-11T01:16:00+00:00, run_start_date=2024-05-11 01:17:00.357286+00:00, run_end_date=2024-05-11 01:17:02.640013+00:00, run_duration=2.282727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:16:00+00:00, data_interval_end=2024-05-11 01:17:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:17:02.654039532Z [2024-05-11T01:17:02.653+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:02.732669322Z [2024-05-11T01:17:02.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status success for try_number 1 2024-05-11T01:17:02.755297933Z [2024-05-11T01:17:02.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=2024-05-11 01:17:01.734611+00:00, run_end_date=2024-05-11 01:17:02.312457+00:00, run_duration=0.577846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:00.475042+00:00, queued_by_job_id=2, pid=10975 2024-05-11T01:17:03.270796775Z [2024-05-11T01:17:03.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status failed for try_number 1 2024-05-11T01:17:03.270877186Z [2024-05-11T01:17:03.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status failed for try_number 1 2024-05-11T01:17:03.280991807Z [2024-05-11T01:17:03.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:00.475042+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:17:03.281546643Z [2024-05-11T01:17:03.281+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:03.284237195Z [2024-05-11T01:17:03.283+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:03.297069648Z [2024-05-11T01:17:03.296+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240511T011600, start_date=, end_date=20240511T011703 2024-05-11T01:17:03.305852505Z [2024-05-11T01:17:03.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:00.475042+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:17:03.306329088Z [2024-05-11T01:17:03.306+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:03.310214036Z [2024-05-11T01:17:03.308+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:03.327312734Z [2024-05-11T01:17:03.326+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240511T011600, start_date=, end_date=20240511T011703 2024-05-11T01:17:04.402286033Z [2024-05-11T01:17:04.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:17:04.402478356Z [2024-05-11T01:17:04.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:16:00+00:00, run_id=scheduled__2024-05-11T01:16:00+00:00, run_start_date=2024-05-11 01:17:00.360182+00:00, run_end_date=2024-05-11 01:17:04.402094+00:00, run_duration=4.041912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:16:00+00:00, data_interval_end=2024-05-11 01:17:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:17:04.412303033Z [2024-05-11T01:17:04.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:04.489237871Z [2024-05-11T01:17:04.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status success for try_number 1 2024-05-11T01:17:04.496603316Z [2024-05-11T01:17:04.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=2024-05-11 01:17:02.731160+00:00, run_end_date=2024-05-11 01:17:04.182114+00:00, run_duration=1.450954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:00.475042+00:00, queued_by_job_id=2, pid=10995 2024-05-11T01:17:06.046588695Z [2024-05-11T01:17:06.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:17:06.046940573Z [2024-05-11T01:17:06.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:16:00+00:00, run_id=scheduled__2024-05-11T01:16:00+00:00, run_start_date=2024-05-11 01:17:00.364534+00:00, run_end_date=2024-05-11 01:17:06.046482+00:00, run_duration=5.681948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:16:00+00:00, data_interval_end=2024-05-11 01:17:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:17:06.057190067Z [2024-05-11T01:17:06.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:06.124445922Z [2024-05-11T01:17:06.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status success for try_number 1 2024-05-11T01:17:06.128413710Z [2024-05-11T01:17:06.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=2024-05-11 01:17:02.874873+00:00, run_end_date=2024-05-11 01:17:05.236607+00:00, run_duration=2.361734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:00.475042+00:00, queued_by_job_id=2, pid=11006 2024-05-11T01:17:13.487054128Z [2024-05-11T01:17:13.486+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-11T01:17:13.487097852Z 2024-05-11T01:17:13.487101828Z 2024-05-11T01:17:13.487606038Z [2024-05-11T01:17:13.486+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:17:13.487864576Z [2024-05-11T01:17:13.487+0000] {scheduler_job.py:425} INFO - DAG vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:17:13.488415828Z [2024-05-11T01:17:13.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:17:13.488428758Z 2024-05-11T01:17:13.488450000Z 2024-05-11T01:17:13.491225948Z [2024-05-11T01:17:13.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:13.491402693Z [2024-05-11T01:17:13.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:17:13.491653415Z [2024-05-11T01:17:13.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:17:13.491861874Z [2024-05-11T01:17:13.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:17:13.639731631Z [2024-05-11T01:17:13.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 2 2024-05-11T01:17:13.639895147Z [2024-05-11T01:17:13.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 2 2024-05-11T01:17:13.646827168Z [2024-05-11T01:17:13.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2edc8639-8bff-4c1e-a242-f932c50022bc 2024-05-11T01:17:13.647170161Z [2024-05-11T01:17:13.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5004a94-418c-442b-9750-0e7e9d7fefcb 2024-05-11T01:17:15.083344597Z [2024-05-11T01:17:15.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status failed for try_number 2 2024-05-11T01:17:15.083540436Z [2024-05-11T01:17:15.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status failed for try_number 2 2024-05-11T01:17:15.088924135Z [2024-05-11T01:17:15.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-11 01:17:03.286951+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:13.488985+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:17:15.089377545Z [2024-05-11T01:17:15.089+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:15.091378924Z [2024-05-11T01:17:15.091+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:15.106713307Z [2024-05-11T01:17:15.106+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240511T011600, start_date=, end_date=20240511T011715 2024-05-11T01:17:15.113474232Z [2024-05-11T01:17:15.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-11 01:17:03.312441+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:17:13.488985+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:17:15.113970943Z [2024-05-11T01:17:15.113+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:15.115835938Z [2024-05-11T01:17:15.115+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:17:15.125852614Z [2024-05-11T01:17:15.125+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240511T011600, start_date=, end_date=20240511T011715 2024-05-11T01:17:16.188497888Z [2024-05-11T01:17:16.187+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-11T01:17:16.189089920Z [2024-05-11T01:17:16.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:16:00+00:00, run_id=scheduled__2024-05-11T01:16:00+00:00, run_start_date=2024-05-11 01:17:00.362146+00:00, run_end_date=2024-05-11 01:17:16.188624+00:00, run_duration=15.826478, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:16:00+00:00, data_interval_end=2024-05-11 01:17:00+00:00, dag_hash=cfb4254e5b59f5284ec982da6faf73be 2024-05-11T01:17:16.200125353Z [2024-05-11T01:17:16.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:17:16.209593042Z [2024-05-11T01:17:16.209+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-11T01:17:16.210060649Z [2024-05-11T01:17:16.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:16:00+00:00, run_id=scheduled__2024-05-11T01:16:00+00:00, run_start_date=2024-05-11 01:17:00.366169+00:00, run_end_date=2024-05-11 01:17:16.209712+00:00, run_duration=15.843543, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:16:00+00:00, data_interval_end=2024-05-11 01:17:00+00:00, dag_hash=422e20a2a7e25bd0ee32c5ddb57d6235 2024-05-11T01:17:16.219406703Z [2024-05-11T01:17:16.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:17:00+00:00, run_after=2024-05-11T01:18:00+00:00 2024-05-11T01:18:00.444131592Z [2024-05-11T01:18:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:00.478735331Z [2024-05-11T01:18:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:18:00.510027254Z [2024-05-11T01:18:00.509+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:00.533004270Z [2024-05-11T01:18:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:00.539666567Z [2024-05-11T01:18:00.539+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:18:00.545793282Z [2024-05-11T01:18:00.545+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:18:00.669291234Z [2024-05-11T01:18:00.668+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-11T01:18:00.669346949Z 2024-05-11T01:18:00.669367277Z 2024-05-11T01:18:00.669381131Z 2024-05-11T01:18:00.669393327Z 2024-05-11T01:18:00.669406079Z 2024-05-11T01:18:00.669415445Z 2024-05-11T01:18:00.669545488Z [2024-05-11T01:18:00.669+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:18:00.669558095Z [2024-05-11T01:18:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:18:00.669644280Z [2024-05-11T01:18:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:18:00.670566301Z [2024-05-11T01:18:00.669+0000] {scheduler_job.py:425} INFO - DAG vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:18:00.670633219Z [2024-05-11T01:18:00.669+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:18:00.670646305Z [2024-05-11T01:18:00.669+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:18:00.671009110Z [2024-05-11T01:18:00.670+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:18:00.671032863Z 2024-05-11T01:18:00.671042344Z 2024-05-11T01:18:00.671050520Z 2024-05-11T01:18:00.671058895Z 2024-05-11T01:18:00.671067393Z 2024-05-11T01:18:00.671075711Z 2024-05-11T01:18:00.678219417Z [2024-05-11T01:18:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:00.678332055Z [2024-05-11T01:18:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:18:00.678703824Z [2024-05-11T01:18:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:00.678796250Z [2024-05-11T01:18:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:18:00.679034613Z [2024-05-11T01:18:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:00.679126094Z [2024-05-11T01:18:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:18:00.679382064Z [2024-05-11T01:18:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:00.679482712Z [2024-05-11T01:18:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:18:00.679710543Z [2024-05-11T01:18:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:00.680179761Z [2024-05-11T01:18:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:18:00.680414711Z [2024-05-11T01:18:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:00.680513778Z [2024-05-11T01:18:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:18:01.531122853Z [2024-05-11T01:18:01.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status queued for try_number 1 2024-05-11T01:18:01.531156119Z [2024-05-11T01:18:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 1 2024-05-11T01:18:01.531203684Z [2024-05-11T01:18:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 1 2024-05-11T01:18:01.531295296Z [2024-05-11T01:18:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 1 2024-05-11T01:18:01.531336184Z [2024-05-11T01:18:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 1 2024-05-11T01:18:01.531408623Z [2024-05-11T01:18:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 1 2024-05-11T01:18:01.556915411Z [2024-05-11T01:18:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ae0f14c-b369-4188-b135-5ef72e12aa84 2024-05-11T01:18:01.556996328Z [2024-05-11T01:18:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f01ea25-7fbb-4759-92b6-5af7e864e9cf 2024-05-11T01:18:01.557112316Z [2024-05-11T01:18:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbdc6a4e-b795-4fb5-a045-1861f315b90a 2024-05-11T01:18:01.557406559Z [2024-05-11T01:18:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b0722e1-389e-4b70-8fa2-7ea1df226711 2024-05-11T01:18:01.557513335Z [2024-05-11T01:18:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 400c9a0b-fc65-4900-9f29-aa09effbdbbe 2024-05-11T01:18:01.557596486Z [2024-05-11T01:18:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9425c843-c5fd-4db6-a631-7dd206998dee 2024-05-11T01:18:02.875328607Z [2024-05-11T01:18:02.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:18:02.875524485Z [2024-05-11T01:18:02.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:16:00+00:00, run_id=scheduled__2024-05-11T01:16:00+00:00, run_start_date=2024-05-11 01:18:00.563933+00:00, run_end_date=2024-05-11 01:18:02.875235+00:00, run_duration=2.311302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:16:00+00:00, data_interval_end=2024-05-11 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:18:02.886510211Z [2024-05-11T01:18:02.886+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:18:02.903298430Z [2024-05-11T01:18:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:18:02.903440733Z [2024-05-11T01:18:02.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:17:00+00:00, run_id=scheduled__2024-05-11T01:17:00+00:00, run_start_date=2024-05-11 01:18:00.568680+00:00, run_end_date=2024-05-11 01:18:02.903215+00:00, run_duration=2.334535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:17:00+00:00, data_interval_end=2024-05-11 01:18:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:18:02.917172435Z [2024-05-11T01:18:02.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:03.062257159Z [2024-05-11T01:18:03.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:16:00+00:00 exited with status success for try_number 1 2024-05-11T01:18:03.064865675Z [2024-05-11T01:18:03.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status success for try_number 1 2024-05-11T01:18:03.073388347Z [2024-05-11T01:18:03.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=2024-05-11 01:18:01.864636+00:00, run_end_date=2024-05-11 01:18:02.338120+00:00, run_duration=0.473484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:00.673134+00:00, queued_by_job_id=2, pid=11076 2024-05-11T01:18:03.073568306Z [2024-05-11T01:18:03.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:16:00+00:00, map_index=-1, run_start_date=2024-05-11 01:18:01.738341+00:00, run_end_date=2024-05-11 01:18:02.295325+00:00, run_duration=0.556984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:00.673134+00:00, queued_by_job_id=2, pid=11075 2024-05-11T01:18:04.199061419Z [2024-05-11T01:18:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status failed for try_number 1 2024-05-11T01:18:04.199189198Z [2024-05-11T01:18:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status failed for try_number 1 2024-05-11T01:18:04.208323596Z [2024-05-11T01:18:04.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:00.673134+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:18:04.208904161Z [2024-05-11T01:18:04.208+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:04.211290970Z [2024-05-11T01:18:04.210+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:04.223723143Z [2024-05-11T01:18:04.223+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240511T011700, start_date=, end_date=20240511T011804 2024-05-11T01:18:04.231837495Z [2024-05-11T01:18:04.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:00.673134+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:18:04.232106576Z [2024-05-11T01:18:04.231+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:04.234293692Z [2024-05-11T01:18:04.233+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:04.246881381Z [2024-05-11T01:18:04.246+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240511T011700, start_date=, end_date=20240511T011804 2024-05-11T01:18:05.441500147Z [2024-05-11T01:18:05.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:18:05.441782751Z [2024-05-11T01:18:05.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:17:00+00:00, run_id=scheduled__2024-05-11T01:17:00+00:00, run_start_date=2024-05-11 01:18:00.573463+00:00, run_end_date=2024-05-11 01:18:05.441348+00:00, run_duration=4.867885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:17:00+00:00, data_interval_end=2024-05-11 01:18:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:18:05.450478006Z [2024-05-11T01:18:05.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:05.503209663Z [2024-05-11T01:18:05.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status success for try_number 1 2024-05-11T01:18:05.508939813Z [2024-05-11T01:18:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=2024-05-11 01:18:03.186125+00:00, run_end_date=2024-05-11 01:18:05.151175+00:00, run_duration=1.96505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:00.673134+00:00, queued_by_job_id=2, pid=11112 2024-05-11T01:18:06.576364342Z [2024-05-11T01:18:06.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:18:06.577115698Z [2024-05-11T01:18:06.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:17:00+00:00, run_id=scheduled__2024-05-11T01:17:00+00:00, run_start_date=2024-05-11 01:18:00.575901+00:00, run_end_date=2024-05-11 01:18:06.576628+00:00, run_duration=6.000727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:17:00+00:00, data_interval_end=2024-05-11 01:18:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:18:06.590501601Z [2024-05-11T01:18:06.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:06.652790004Z [2024-05-11T01:18:06.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status success for try_number 1 2024-05-11T01:18:06.660309850Z [2024-05-11T01:18:06.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=2024-05-11 01:18:03.148316+00:00, run_end_date=2024-05-11 01:18:05.912345+00:00, run_duration=2.764029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:00.673134+00:00, queued_by_job_id=2, pid=11111 2024-05-11T01:18:14.663053573Z [2024-05-11T01:18:14.662+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-11T01:18:14.663079642Z 2024-05-11T01:18:14.663083137Z 2024-05-11T01:18:14.663368488Z [2024-05-11T01:18:14.663+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:18:14.663393807Z [2024-05-11T01:18:14.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 has 0/16 running and queued tasks 2024-05-11T01:18:14.663919575Z [2024-05-11T01:18:14.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:18:14.663974842Z 2024-05-11T01:18:14.663985266Z 2024-05-11T01:18:14.667708349Z [2024-05-11T01:18:14.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:14.667913835Z [2024-05-11T01:18:14.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:18:14.668208869Z [2024-05-11T01:18:14.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:17:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:14.668368624Z [2024-05-11T01:18:14.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:18:14.836755362Z [2024-05-11T01:18:14.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 2 2024-05-11T01:18:14.837229940Z [2024-05-11T01:18:14.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status queued for try_number 2 2024-05-11T01:18:14.846395044Z [2024-05-11T01:18:14.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 500bbe38-a84d-4eeb-a10d-241e3fd60aed 2024-05-11T01:18:14.846680906Z [2024-05-11T01:18:14.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 929845b1-34e1-4324-abac-f76e1b8a3974 2024-05-11T01:18:16.779464300Z [2024-05-11T01:18:16.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status failed for try_number 2 2024-05-11T01:18:16.779495664Z [2024-05-11T01:18:16.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:17:00+00:00 exited with status failed for try_number 2 2024-05-11T01:18:16.793241458Z [2024-05-11T01:18:16.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-11 01:18:04.213435+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:14.664532+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:18:16.793707707Z [2024-05-11T01:18:16.793+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:16.812060438Z [2024-05-11T01:18:16.797+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:16.828015645Z [2024-05-11T01:18:16.826+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240511T011700, start_date=, end_date=20240511T011816 2024-05-11T01:18:16.840147571Z [2024-05-11T01:18:16.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-11 01:18:04.236301+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:14.664532+00:00, queued_by_job_id=2, pid=None 2024-05-11T01:18:16.840469901Z [2024-05-11T01:18:16.840+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:16.842670521Z [2024-05-11T01:18:16.842+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-11T01:18:16.858687720Z [2024-05-11T01:18:16.858+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240511T011700, start_date=, end_date=20240511T011816 2024-05-11T01:18:17.921227162Z [2024-05-11T01:18:17.920+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-11T01:18:17.921470890Z [2024-05-11T01:18:17.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:17:00+00:00, run_id=scheduled__2024-05-11T01:17:00+00:00, run_start_date=2024-05-11 01:18:00.574843+00:00, run_end_date=2024-05-11 01:18:17.921049+00:00, run_duration=17.346206, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:17:00+00:00, data_interval_end=2024-05-11 01:18:00+00:00, dag_hash=cfb4254e5b59f5284ec982da6faf73be 2024-05-11T01:18:17.933336537Z [2024-05-11T01:18:17.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:17.941517137Z [2024-05-11T01:18:17.941+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-11T01:18:17.941660317Z [2024-05-11T01:18:17.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246, execution_date=2024-05-11 01:17:00+00:00, run_id=scheduled__2024-05-11T01:17:00+00:00, run_start_date=2024-05-11 01:18:00.576854+00:00, run_end_date=2024-05-11 01:18:17.941382+00:00, run_duration=17.364528, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:17:00+00:00, data_interval_end=2024-05-11 01:18:00+00:00, dag_hash=422e20a2a7e25bd0ee32c5ddb57d6235 2024-05-11T01:18:17.950387627Z [2024-05-11T01:18:17.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 to 2024-05-11T01:18:00+00:00, run_after=2024-05-11T01:19:00+00:00 2024-05-11T01:18:39.077457053Z [2024-05-11T01:18:39.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:18:39.077532524Z 2024-05-11T01:18:39.077771326Z [2024-05-11T01:18:39.077+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-11T01:18:39.079489611Z [2024-05-11T01:18:39.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:18:39.079518520Z 2024-05-11T01:18:39.083986069Z [2024-05-11T01:18:39.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240511011837_438975', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:18:39.084607781Z [2024-05-11T01:18:39.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240511011837_438975', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-11T01:18:39.158847756Z [2024-05-11T01:18:39.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240511011837_438975 exited with status queued for try_number 1 2024-05-11T01:18:39.171623078Z [2024-05-11T01:18:39.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9e27990-3fda-4b35-935d-f33443a2137f 2024-05-11T01:18:41.265081540Z [2024-05-11T01:18:41.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:18:41.265680231Z [2024-05-11T01:18:41.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-11 01:18:37.971876+00:00, run_id=vdu_down_20240511011837_438975, run_start_date=2024-05-11 01:18:39.035335+00:00, run_end_date=2024-05-11 01:18:41.264922+00:00, run_duration=2.229587, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 01:18:37.971876+00:00, data_interval_end=2024-05-11 01:18:37.971876+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-11T01:18:41.269264588Z [2024-05-11T01:18:41.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-11T01:18:41.311719063Z [2024-05-11T01:18:41.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240511011837_438975 exited with status success for try_number 1 2024-05-11T01:18:41.320494260Z [2024-05-11T01:18:41.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240511011837_438975, map_index=-1, run_start_date=2024-05-11 01:18:39.753026+00:00, run_end_date=2024-05-11 01:18:40.188795+00:00, run_duration=0.435769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:18:39.080186+00:00, queued_by_job_id=2, pid=11171 2024-05-11T01:19:00.205341071Z [2024-05-11T01:19:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:19:00.218617219Z [2024-05-11T01:19:00.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:19:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:19:00.242965184Z [2024-05-11T01:19:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:19:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:19:00.320863068Z [2024-05-11T01:19:00.319+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:19:00.320898598Z 2024-05-11T01:19:00.320907837Z 2024-05-11T01:19:00.320916342Z 2024-05-11T01:19:00.320924870Z [2024-05-11T01:19:00.320+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:19:00.320933302Z [2024-05-11T01:19:00.320+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:19:00.320962217Z [2024-05-11T01:19:00.320+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:19:00.320980626Z [2024-05-11T01:19:00.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:19:00.320986929Z 2024-05-11T01:19:00.320992707Z 2024-05-11T01:19:00.320998395Z 2024-05-11T01:19:00.331262536Z [2024-05-11T01:19:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:19:00.331363944Z [2024-05-11T01:19:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:19:00.331614568Z [2024-05-11T01:19:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:19:00.331625665Z [2024-05-11T01:19:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:19:00.331776002Z [2024-05-11T01:19:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:19:00.331847844Z [2024-05-11T01:19:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:19:00.754905071Z [2024-05-11T01:19:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status queued for try_number 1 2024-05-11T01:19:00.755060645Z [2024-05-11T01:19:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status queued for try_number 1 2024-05-11T01:19:00.755200975Z [2024-05-11T01:19:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status queued for try_number 1 2024-05-11T01:19:00.763876921Z [2024-05-11T01:19:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 192415e5-c1df-4e7d-9b64-19a59135c726 2024-05-11T01:19:00.764092708Z [2024-05-11T01:19:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36900695-4f07-4ef0-8fac-79891495a441 2024-05-11T01:19:00.764299579Z [2024-05-11T01:19:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 163d90ea-235c-4ce2-92b3-85e49edc811e 2024-05-11T01:19:01.939191982Z [2024-05-11T01:19:01.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:19:01.939697374Z [2024-05-11T01:19:01.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:18:00+00:00, run_id=scheduled__2024-05-11T01:18:00+00:00, run_start_date=2024-05-11 01:19:00.254436+00:00, run_end_date=2024-05-11 01:19:01.939336+00:00, run_duration=1.6849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:18:00+00:00, data_interval_end=2024-05-11 01:19:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:19:01.949674470Z [2024-05-11T01:19:01.949+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:19:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:19:01.993304969Z [2024-05-11T01:19:01.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status success for try_number 1 2024-05-11T01:19:01.998580877Z [2024-05-11T01:19:01.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:18:00+00:00, map_index=-1, run_start_date=2024-05-11 01:19:01.367535+00:00, run_end_date=2024-05-11 01:19:01.754367+00:00, run_duration=0.386832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:19:00.328161+00:00, queued_by_job_id=2, pid=11185 2024-05-11T01:19:04.145480169Z [2024-05-11T01:19:04.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:19:04.148592988Z [2024-05-11T01:19:04.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:18:00+00:00, run_id=scheduled__2024-05-11T01:18:00+00:00, run_start_date=2024-05-11 01:19:00.256639+00:00, run_end_date=2024-05-11 01:19:04.145658+00:00, run_duration=3.889019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:18:00+00:00, data_interval_end=2024-05-11 01:19:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:19:04.171888658Z [2024-05-11T01:19:04.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:19:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:19:04.263796811Z [2024-05-11T01:19:04.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status success for try_number 1 2024-05-11T01:19:04.269451371Z [2024-05-11T01:19:04.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:18:00+00:00, map_index=-1, run_start_date=2024-05-11 01:19:02.351624+00:00, run_end_date=2024-05-11 01:19:03.828994+00:00, run_duration=1.47737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:19:00.328161+00:00, queued_by_job_id=2, pid=11204 2024-05-11T01:19:05.308487031Z [2024-05-11T01:19:05.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:19:05.308902371Z [2024-05-11T01:19:05.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:18:00+00:00, run_id=scheduled__2024-05-11T01:18:00+00:00, run_start_date=2024-05-11 01:19:00.257682+00:00, run_end_date=2024-05-11 01:19:05.308349+00:00, run_duration=5.050667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:18:00+00:00, data_interval_end=2024-05-11 01:19:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:19:05.320363537Z [2024-05-11T01:19:05.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:19:00+00:00, run_after=2024-05-11T01:20:00+00:00 2024-05-11T01:19:05.364498159Z [2024-05-11T01:19:05.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status success for try_number 1 2024-05-11T01:19:05.371538304Z [2024-05-11T01:19:05.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:18:00+00:00, map_index=-1, run_start_date=2024-05-11 01:19:02.341746+00:00, run_end_date=2024-05-11 01:19:04.207078+00:00, run_duration=1.865332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:19:00.328161+00:00, queued_by_job_id=2, pid=11203 2024-05-11T01:20:00.621321054Z [2024-05-11T01:20:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:21:00+00:00 2024-05-11T01:20:00.634965529Z [2024-05-11T01:20:00.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:21:00+00:00 2024-05-11T01:20:00.642230798Z [2024-05-11T01:20:00.641+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:20:00.649466001Z [2024-05-11T01:20:00.649+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:20:00.662951340Z [2024-05-11T01:20:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:20:00.827746110Z [2024-05-11T01:20:00.827+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:20:00.827773342Z 2024-05-11T01:20:00.827777037Z 2024-05-11T01:20:00.827780821Z 2024-05-11T01:20:00.827783945Z 2024-05-11T01:20:00.827787206Z 2024-05-11T01:20:00.828036935Z [2024-05-11T01:20:00.827+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:20:00.828304116Z [2024-05-11T01:20:00.828+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:20:00.828601845Z [2024-05-11T01:20:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:20:00.828816055Z [2024-05-11T01:20:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:20:00.829067713Z [2024-05-11T01:20:00.828+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:20:00.830240966Z [2024-05-11T01:20:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:20:00.830257960Z 2024-05-11T01:20:00.830264028Z 2024-05-11T01:20:00.830268680Z 2024-05-11T01:20:00.830274843Z 2024-05-11T01:20:00.830280251Z 2024-05-11T01:20:00.837422060Z [2024-05-11T01:20:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:20:00.837644395Z [2024-05-11T01:20:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:20:00.838061600Z [2024-05-11T01:20:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:20:00.838439197Z [2024-05-11T01:20:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:20:00.839091424Z [2024-05-11T01:20:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:20:00.839325830Z [2024-05-11T01:20:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:20:00.839746178Z [2024-05-11T01:20:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:20:00.839998191Z [2024-05-11T01:20:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:20:00.840375761Z [2024-05-11T01:20:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:20:00.840616125Z [2024-05-11T01:20:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:20:01.407537012Z [2024-05-11T01:20:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:01.407870421Z [2024-05-11T01:20:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:01.408060347Z [2024-05-11T01:20:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:19:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:01.408245027Z [2024-05-11T01:20:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:19:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:01.408776367Z [2024-05-11T01:20:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:19:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:01.429701910Z [2024-05-11T01:20:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddcd7745-2f4f-4486-8990-b576ba8bc3bb 2024-05-11T01:20:01.442760755Z [2024-05-11T01:20:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 573dbd8c-0e18-451a-9d86-264e80950eec 2024-05-11T01:20:01.445249046Z [2024-05-11T01:20:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89809213-76f2-4ea4-a476-9bb22e74721f 2024-05-11T01:20:01.446548124Z [2024-05-11T01:20:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f6f337e-a9e4-442d-8eba-18fbedf9afaa 2024-05-11T01:20:01.446562555Z [2024-05-11T01:20:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dec0f5b-1534-4f8f-834c-6150988b5ba3 2024-05-11T01:20:02.877366980Z [2024-05-11T01:20:02.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:20:02.877767695Z [2024-05-11T01:20:02.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:18:00+00:00, run_id=scheduled__2024-05-11T01:18:00+00:00, run_start_date=2024-05-11 01:20:00.676415+00:00, run_end_date=2024-05-11 01:20:02.877289+00:00, run_duration=2.200874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:18:00+00:00, data_interval_end=2024-05-11 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:20:02.885568424Z [2024-05-11T01:20:02.885+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:22:00+00:00 2024-05-11T01:20:02.974244886Z [2024-05-11T01:20:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:18:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:02.979725204Z [2024-05-11T01:20:02.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:18:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:02.065201+00:00, run_end_date=2024-05-11 01:20:02.613582+00:00, run_duration=0.548381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:00.832639+00:00, queued_by_job_id=2, pid=11238 2024-05-11T01:20:04.098573838Z [2024-05-11T01:20:04.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:20:04.098606172Z [2024-05-11T01:20:04.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:19:00+00:00, run_id=scheduled__2024-05-11T01:19:00+00:00, run_start_date=2024-05-11 01:20:00.677614+00:00, run_end_date=2024-05-11 01:20:04.091692+00:00, run_duration=3.414078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:19:00+00:00, data_interval_end=2024-05-11 01:20:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:20:04.102146646Z [2024-05-11T01:20:04.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:21:00+00:00 2024-05-11T01:20:04.132808643Z [2024-05-11T01:20:04.132+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:20:04.132833375Z 2024-05-11T01:20:04.133605989Z [2024-05-11T01:20:04.133+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:20:04.138933334Z [2024-05-11T01:20:04.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:20:04.138974219Z 2024-05-11T01:20:04.145031167Z [2024-05-11T01:20:04.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:20:04.145361917Z [2024-05-11T01:20:04.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:20:04.203587391Z [2024-05-11T01:20:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:04.203631673Z [2024-05-11T01:20:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:04.203824574Z [2024-05-11T01:20:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:19:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:04.214594269Z [2024-05-11T01:20:04.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36fd3052-7e0e-40db-9516-b025419066a4 2024-05-11T01:20:04.214861765Z [2024-05-11T01:20:04.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:19:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:02.436670+00:00, run_end_date=2024-05-11 01:20:02.915156+00:00, run_duration=0.478486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:00.832639+00:00, queued_by_job_id=2, pid=11239 2024-05-11T01:20:04.214896324Z [2024-05-11T01:20:04.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:03.593243+00:00, run_end_date=2024-05-11 01:20:03.943156+00:00, run_duration=0.349913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:00.832639+00:00, queued_by_job_id=2, pid=11269 2024-05-11T01:20:05.416948749Z [2024-05-11T01:20:05.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:20:05.417298253Z [2024-05-11T01:20:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:19:00+00:00, run_id=scheduled__2024-05-11T01:19:00+00:00, run_start_date=2024-05-11 01:20:00.678891+00:00, run_end_date=2024-05-11 01:20:05.416933+00:00, run_duration=4.738042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:19:00+00:00, data_interval_end=2024-05-11 01:20:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:20:05.429308399Z [2024-05-11T01:20:05.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:21:00+00:00 2024-05-11T01:20:05.488353381Z [2024-05-11T01:20:05.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:19:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:05.498014103Z [2024-05-11T01:20:05.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:19:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:03.746868+00:00, run_end_date=2024-05-11 01:20:04.956759+00:00, run_duration=1.209891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:00.832639+00:00, queued_by_job_id=2, pid=11270 2024-05-11T01:20:06.433129798Z [2024-05-11T01:20:06.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:20:06.433420392Z [2024-05-11T01:20:06.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:19:00+00:00, run_id=scheduled__2024-05-11T01:19:00+00:00, run_start_date=2024-05-11 01:20:00.680891+00:00, run_end_date=2024-05-11 01:20:06.433036+00:00, run_duration=5.752145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:19:00+00:00, data_interval_end=2024-05-11 01:20:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:20:06.441090700Z [2024-05-11T01:20:06.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:21:00+00:00 2024-05-11T01:20:06.475588985Z [2024-05-11T01:20:06.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:19:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:06.481026951Z [2024-05-11T01:20:06.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:19:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:03.487866+00:00, run_end_date=2024-05-11 01:20:05.301848+00:00, run_duration=1.813982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:00.832639+00:00, queued_by_job_id=2, pid=11263 2024-05-11T01:20:07.556106157Z [2024-05-11T01:20:07.555+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:20:07.556140631Z 2024-05-11T01:20:07.556501042Z [2024-05-11T01:20:07.556+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:20:07.558038105Z [2024-05-11T01:20:07.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:20:07.558052404Z 2024-05-11T01:20:07.560379469Z [2024-05-11T01:20:07.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:20:07.560608096Z [2024-05-11T01:20:07.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:20:07.631482865Z [2024-05-11T01:20:07.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:07.631523553Z [2024-05-11T01:20:07.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:07.637397290Z [2024-05-11T01:20:07.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8c3aab2-ad92-44bc-8300-dec35dbd11cf 2024-05-11T01:20:07.637783822Z [2024-05-11T01:20:07.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:05.874813+00:00, run_end_date=2024-05-11 01:20:06.305457+00:00, run_duration=0.430644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:04.139765+00:00, queued_by_job_id=2, pid=11303 2024-05-11T01:20:09.520342963Z [2024-05-11T01:20:09.519+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:20:09.520369960Z 2024-05-11T01:20:09.520420899Z [2024-05-11T01:20:09.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:20:09.521022180Z [2024-05-11T01:20:09.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:20:09.521031409Z 2024-05-11T01:20:09.525020537Z [2024-05-11T01:20:09.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:20:09.525136720Z [2024-05-11T01:20:09.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:20:09.592441912Z [2024-05-11T01:20:09.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status queued for try_number 1 2024-05-11T01:20:09.602850710Z [2024-05-11T01:20:09.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 758397ef-226d-4285-8374-1b897f89e073 2024-05-11T01:20:09.748195764Z [2024-05-11T01:20:09.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:09.755225295Z [2024-05-11T01:20:09.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=0, run_start_date=2024-05-11 01:20:09.127069+00:00, run_end_date=2024-05-11 01:20:09.469932+00:00, run_duration=0.342863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:07.558592+00:00, queued_by_job_id=2, pid=11314 2024-05-11T01:20:12.652850836Z [2024-05-11T01:20:12.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:20:12.652984674Z [2024-05-11T01:20:12.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:15:00+00:00, run_id=scheduled__2024-05-11T01:15:00+00:00, run_start_date=2024-05-11 01:20:00.674734+00:00, run_end_date=2024-05-11 01:20:12.652674+00:00, run_duration=11.97794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:15:00+00:00, data_interval_end=2024-05-11 01:20:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:20:12.659163781Z [2024-05-11T01:20:12.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:20:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:20:12.690046277Z [2024-05-11T01:20:12.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:15:00+00:00 exited with status success for try_number 1 2024-05-11T01:20:12.694539739Z [2024-05-11T01:20:12.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:15:00+00:00, map_index=-1, run_start_date=2024-05-11 01:20:11.255247+00:00, run_end_date=2024-05-11 01:20:11.588684+00:00, run_duration=0.333437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:20:09.521369+00:00, queued_by_job_id=2, pid=11322 2024-05-11T01:20:35.511384939Z [2024-05-11T01:20:35.510+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:21:00.346409882Z [2024-05-11T01:21:00.345+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:21:00.361886700Z [2024-05-11T01:21:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:21:00+00:00, run_after=2024-05-11T01:22:00+00:00 2024-05-11T01:21:00.376514212Z [2024-05-11T01:21:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:21:00+00:00, run_after=2024-05-11T01:22:00+00:00 2024-05-11T01:21:00.474653476Z [2024-05-11T01:21:00.474+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:21:00.474682629Z 2024-05-11T01:21:00.474687762Z 2024-05-11T01:21:00.474692722Z 2024-05-11T01:21:00.475062816Z [2024-05-11T01:21:00.474+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:21:00.475442872Z [2024-05-11T01:21:00.475+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:21:00.475781251Z [2024-05-11T01:21:00.475+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:21:00.476644905Z [2024-05-11T01:21:00.476+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:21:00.476658443Z 2024-05-11T01:21:00.476663469Z 2024-05-11T01:21:00.476683381Z 2024-05-11T01:21:00.481340551Z [2024-05-11T01:21:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:21:00.481747714Z [2024-05-11T01:21:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:21:00.482214686Z [2024-05-11T01:21:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:21:00.482594120Z [2024-05-11T01:21:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:21:00.482952293Z [2024-05-11T01:21:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:21:00.483207956Z [2024-05-11T01:21:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:21:00.700604651Z [2024-05-11T01:21:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:21:00.702120610Z [2024-05-11T01:21:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:21:00.702726976Z [2024-05-11T01:21:00.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:21:00.712891050Z [2024-05-11T01:21:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43b03ce9-3add-4010-a0c2-4cfe6f1037cc 2024-05-11T01:21:00.713065912Z [2024-05-11T01:21:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39d61917-9754-4ddb-99e1-af888f051cd2 2024-05-11T01:21:00.713240987Z [2024-05-11T01:21:00.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3375184a-77fc-4841-b72b-0db8ea6466d1 2024-05-11T01:21:01.849829407Z [2024-05-11T01:21:01.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:21:01.850481902Z [2024-05-11T01:21:01.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:20:00+00:00, run_id=scheduled__2024-05-11T01:20:00+00:00, run_start_date=2024-05-11 01:21:00.390035+00:00, run_end_date=2024-05-11 01:21:01.850110+00:00, run_duration=1.460075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:20:00+00:00, data_interval_end=2024-05-11 01:21:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:21:01.861063734Z [2024-05-11T01:21:01.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:21:00+00:00, run_after=2024-05-11T01:22:00+00:00 2024-05-11T01:21:01.912344885Z [2024-05-11T01:21:01.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:21:01.921363458Z [2024-05-11T01:21:01.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:21:01.347883+00:00, run_end_date=2024-05-11 01:21:01.731501+00:00, run_duration=0.383618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:21:00.477729+00:00, queued_by_job_id=2, pid=11331 2024-05-11T01:21:04.520630989Z [2024-05-11T01:21:04.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:21:04.520760678Z [2024-05-11T01:21:04.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:20:00+00:00, run_id=scheduled__2024-05-11T01:20:00+00:00, run_start_date=2024-05-11 01:21:00.391637+00:00, run_end_date=2024-05-11 01:21:04.520475+00:00, run_duration=4.128838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:20:00+00:00, data_interval_end=2024-05-11 01:21:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:21:04.528679769Z [2024-05-11T01:21:04.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:21:00+00:00, run_after=2024-05-11T01:22:00+00:00 2024-05-11T01:21:04.534355391Z [2024-05-11T01:21:04.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:21:04.534473818Z [2024-05-11T01:21:04.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:20:00+00:00, run_id=scheduled__2024-05-11T01:20:00+00:00, run_start_date=2024-05-11 01:21:00.393407+00:00, run_end_date=2024-05-11 01:21:04.534259+00:00, run_duration=4.140852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:20:00+00:00, data_interval_end=2024-05-11 01:21:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:21:04.543112824Z [2024-05-11T01:21:04.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:21:00+00:00, run_after=2024-05-11T01:22:00+00:00 2024-05-11T01:21:04.584291720Z [2024-05-11T01:21:04.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:21:04.584369394Z [2024-05-11T01:21:04.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:21:04.591366754Z [2024-05-11T01:21:04.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:21:02.300852+00:00, run_end_date=2024-05-11 01:21:03.875127+00:00, run_duration=1.574275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:21:00.477729+00:00, queued_by_job_id=2, pid=11350 2024-05-11T01:21:04.591527065Z [2024-05-11T01:21:04.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:21:02.284635+00:00, run_end_date=2024-05-11 01:21:03.602306+00:00, run_duration=1.317671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:21:00.477729+00:00, queued_by_job_id=2, pid=11349 2024-05-11T01:22:00.310116904Z [2024-05-11T01:22:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:22:00+00:00, run_after=2024-05-11T01:23:00+00:00 2024-05-11T01:22:00.321141363Z [2024-05-11T01:22:00.320+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:22:00.335261625Z [2024-05-11T01:22:00.333+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:22:00.348782326Z [2024-05-11T01:22:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:22:00+00:00, run_after=2024-05-11T01:23:00+00:00 2024-05-11T01:22:00.439228949Z [2024-05-11T01:22:00.438+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:22:00.439287684Z 2024-05-11T01:22:00.439299719Z 2024-05-11T01:22:00.439309668Z 2024-05-11T01:22:00.439319271Z 2024-05-11T01:22:00.439331270Z [2024-05-11T01:22:00.438+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:22:00.439486511Z [2024-05-11T01:22:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:22:00.439512859Z [2024-05-11T01:22:00.439+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:22:00.439572595Z [2024-05-11T01:22:00.439+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:22:00.440450645Z [2024-05-11T01:22:00.440+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:22:00.440457066Z 2024-05-11T01:22:00.440461142Z 2024-05-11T01:22:00.440464444Z 2024-05-11T01:22:00.440468021Z 2024-05-11T01:22:00.445331428Z [2024-05-11T01:22:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:22:00.446499294Z [2024-05-11T01:22:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:22:00.447041304Z [2024-05-11T01:22:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:22:00.447421779Z [2024-05-11T01:22:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:22:00.448369037Z [2024-05-11T01:22:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:22:00.448808632Z [2024-05-11T01:22:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:22:00.449265740Z [2024-05-11T01:22:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:22:00.449546440Z [2024-05-11T01:22:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:22:01.077930736Z [2024-05-11T01:22:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:22:01.080332917Z [2024-05-11T01:22:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:21:00+00:00 exited with status queued for try_number 1 2024-05-11T01:22:01.080351924Z [2024-05-11T01:22:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:21:00+00:00 exited with status queued for try_number 1 2024-05-11T01:22:01.080366153Z [2024-05-11T01:22:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:21:00+00:00 exited with status queued for try_number 1 2024-05-11T01:22:01.118127568Z [2024-05-11T01:22:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 522aeedb-07dc-4e99-8b73-d6c4452dee30 2024-05-11T01:22:01.118195303Z [2024-05-11T01:22:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ca0f3b6-1cc1-49e5-8f17-a118805b2cc9 2024-05-11T01:22:01.118404247Z [2024-05-11T01:22:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9b795af-4ebc-4e48-a0f9-d9282fa04b10 2024-05-11T01:22:01.118408820Z [2024-05-11T01:22:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e61e7dc-118f-45d0-965d-13fe593aaa80 2024-05-11T01:22:02.334024702Z [2024-05-11T01:22:02.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:22:02.334737058Z [2024-05-11T01:22:02.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:20:00+00:00, run_id=scheduled__2024-05-11T01:20:00+00:00, run_start_date=2024-05-11 01:22:00.365421+00:00, run_end_date=2024-05-11 01:22:02.333948+00:00, run_duration=1.968527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:20:00+00:00, data_interval_end=2024-05-11 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:22:02.348349408Z [2024-05-11T01:22:02.348+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:22:00+00:00, run_after=2024-05-11T01:24:00+00:00 2024-05-11T01:22:02.357754727Z [2024-05-11T01:22:02.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:22:02.358139498Z [2024-05-11T01:22:02.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:21:00+00:00, run_id=scheduled__2024-05-11T01:21:00+00:00, run_start_date=2024-05-11 01:22:00.366942+00:00, run_end_date=2024-05-11 01:22:02.357640+00:00, run_duration=1.990698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:21:00+00:00, data_interval_end=2024-05-11 01:22:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:22:02.367958444Z [2024-05-11T01:22:02.367+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:22:00+00:00, run_after=2024-05-11T01:23:00+00:00 2024-05-11T01:22:02.411472971Z [2024-05-11T01:22:02.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:22:02.413714087Z [2024-05-11T01:22:02.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:21:00+00:00 exited with status success for try_number 1 2024-05-11T01:22:02.419707033Z [2024-05-11T01:22:02.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:21:00+00:00, map_index=-1, run_start_date=2024-05-11 01:22:01.402004+00:00, run_end_date=2024-05-11 01:22:01.808390+00:00, run_duration=0.406386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:22:00.441412+00:00, queued_by_job_id=2, pid=11383 2024-05-11T01:22:02.419815722Z [2024-05-11T01:22:02.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:22:01.423631+00:00, run_end_date=2024-05-11 01:22:01.819228+00:00, run_duration=0.395597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:22:00.441412+00:00, queued_by_job_id=2, pid=11384 2024-05-11T01:22:04.390021598Z [2024-05-11T01:22:04.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:22:04.390320965Z [2024-05-11T01:22:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:21:00+00:00, run_id=scheduled__2024-05-11T01:21:00+00:00, run_start_date=2024-05-11 01:22:00.369777+00:00, run_end_date=2024-05-11 01:22:04.389829+00:00, run_duration=4.020052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:21:00+00:00, data_interval_end=2024-05-11 01:22:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:22:04.399017806Z [2024-05-11T01:22:04.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:22:00+00:00, run_after=2024-05-11T01:23:00+00:00 2024-05-11T01:22:04.450996240Z [2024-05-11T01:22:04.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:21:00+00:00 exited with status success for try_number 1 2024-05-11T01:22:04.462873946Z [2024-05-11T01:22:04.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:21:00+00:00, map_index=-1, run_start_date=2024-05-11 01:22:02.449665+00:00, run_end_date=2024-05-11 01:22:03.858248+00:00, run_duration=1.408583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:22:00.441412+00:00, queued_by_job_id=2, pid=11407 2024-05-11T01:22:05.524567663Z [2024-05-11T01:22:05.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:22:05.524784492Z [2024-05-11T01:22:05.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:21:00+00:00, run_id=scheduled__2024-05-11T01:21:00+00:00, run_start_date=2024-05-11 01:22:00.371566+00:00, run_end_date=2024-05-11 01:22:05.524426+00:00, run_duration=5.15286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:21:00+00:00, data_interval_end=2024-05-11 01:22:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:22:05.532844286Z [2024-05-11T01:22:05.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:22:00+00:00, run_after=2024-05-11T01:23:00+00:00 2024-05-11T01:22:05.561391094Z [2024-05-11T01:22:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:21:00+00:00 exited with status success for try_number 1 2024-05-11T01:22:05.566393736Z [2024-05-11T01:22:05.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:21:00+00:00, map_index=-1, run_start_date=2024-05-11 01:22:02.510039+00:00, run_end_date=2024-05-11 01:22:04.384033+00:00, run_duration=1.873994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:22:00.441412+00:00, queued_by_job_id=2, pid=11408 2024-05-11T01:23:00.193847748Z [2024-05-11T01:23:00.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:23:00+00:00, run_after=2024-05-11T01:24:00+00:00 2024-05-11T01:23:00.200130222Z [2024-05-11T01:23:00.199+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:23:00.213716730Z [2024-05-11T01:23:00.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:23:00+00:00, run_after=2024-05-11T01:24:00+00:00 2024-05-11T01:23:00.286743772Z [2024-05-11T01:23:00.286+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:23:00.286776008Z 2024-05-11T01:23:00.286781030Z 2024-05-11T01:23:00.286785581Z 2024-05-11T01:23:00.286912624Z [2024-05-11T01:23:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:23:00.287126784Z [2024-05-11T01:23:00.286+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:23:00.287202964Z [2024-05-11T01:23:00.287+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:23:00.287801729Z [2024-05-11T01:23:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:23:00.287807660Z 2024-05-11T01:23:00.287812033Z 2024-05-11T01:23:00.287816309Z 2024-05-11T01:23:00.291027159Z [2024-05-11T01:23:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:23:00.291183647Z [2024-05-11T01:23:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:23:00.291489269Z [2024-05-11T01:23:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:23:00.291744254Z [2024-05-11T01:23:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:23:00.291951427Z [2024-05-11T01:23:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:23:00.292084248Z [2024-05-11T01:23:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:23:00.707597573Z [2024-05-11T01:23:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status queued for try_number 1 2024-05-11T01:23:00.707698574Z [2024-05-11T01:23:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status queued for try_number 1 2024-05-11T01:23:00.707811791Z [2024-05-11T01:23:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status queued for try_number 1 2024-05-11T01:23:00.715193048Z [2024-05-11T01:23:00.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81c2597f-daa1-4c4f-8c06-1f3452b84c5d 2024-05-11T01:23:00.715362001Z [2024-05-11T01:23:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a8554a3-90a6-4c77-9322-eb1a10c7c8c1 2024-05-11T01:23:00.715528688Z [2024-05-11T01:23:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c2e857f-eeaa-4a8d-a121-10e0bea1e870 2024-05-11T01:23:01.847160794Z [2024-05-11T01:23:01.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:23:01.847428829Z [2024-05-11T01:23:01.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:22:00+00:00, run_id=scheduled__2024-05-11T01:22:00+00:00, run_start_date=2024-05-11 01:23:00.234155+00:00, run_end_date=2024-05-11 01:23:01.847049+00:00, run_duration=1.612894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:22:00+00:00, data_interval_end=2024-05-11 01:23:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:23:01.859215256Z [2024-05-11T01:23:01.858+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:23:00+00:00, run_after=2024-05-11T01:24:00+00:00 2024-05-11T01:23:01.922231344Z [2024-05-11T01:23:01.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status success for try_number 1 2024-05-11T01:23:01.927507456Z [2024-05-11T01:23:01.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:22:00+00:00, map_index=-1, run_start_date=2024-05-11 01:23:01.100291+00:00, run_end_date=2024-05-11 01:23:01.496268+00:00, run_duration=0.395977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:23:00.288549+00:00, queued_by_job_id=2, pid=11440 2024-05-11T01:23:05.336184783Z [2024-05-11T01:23:05.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:23:05.336547845Z [2024-05-11T01:23:05.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:22:00+00:00, run_id=scheduled__2024-05-11T01:22:00+00:00, run_start_date=2024-05-11 01:23:00.235384+00:00, run_end_date=2024-05-11 01:23:05.336044+00:00, run_duration=5.10066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:22:00+00:00, data_interval_end=2024-05-11 01:23:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:23:05.344248871Z [2024-05-11T01:23:05.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:23:00+00:00, run_after=2024-05-11T01:24:00+00:00 2024-05-11T01:23:05.394628772Z [2024-05-11T01:23:05.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status success for try_number 1 2024-05-11T01:23:05.414949022Z [2024-05-11T01:23:05.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:22:00+00:00, map_index=-1, run_start_date=2024-05-11 01:23:02.214751+00:00, run_end_date=2024-05-11 01:23:04.228949+00:00, run_duration=2.014198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:23:00.288549+00:00, queued_by_job_id=2, pid=11458 2024-05-11T01:23:06.448996500Z [2024-05-11T01:23:06.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:23:06.449317652Z [2024-05-11T01:23:06.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:22:00+00:00, run_id=scheduled__2024-05-11T01:22:00+00:00, run_start_date=2024-05-11 01:23:00.236382+00:00, run_end_date=2024-05-11 01:23:06.448797+00:00, run_duration=6.212415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:22:00+00:00, data_interval_end=2024-05-11 01:23:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:23:06.459870691Z [2024-05-11T01:23:06.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:23:00+00:00, run_after=2024-05-11T01:24:00+00:00 2024-05-11T01:23:06.503043330Z [2024-05-11T01:23:06.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status success for try_number 1 2024-05-11T01:23:06.509329664Z [2024-05-11T01:23:06.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:22:00+00:00, map_index=-1, run_start_date=2024-05-11 01:23:02.218015+00:00, run_end_date=2024-05-11 01:23:05.327826+00:00, run_duration=3.109811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:23:00.288549+00:00, queued_by_job_id=2, pid=11459 2024-05-11T01:24:00.210050843Z [2024-05-11T01:24:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:24:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:24:00.276574383Z [2024-05-11T01:24:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:24:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:24:00.319640859Z [2024-05-11T01:24:00.319+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:24:00.352676343Z [2024-05-11T01:24:00.345+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:24:00.442607988Z [2024-05-11T01:24:00.442+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:24:00.442639701Z 2024-05-11T01:24:00.442644257Z 2024-05-11T01:24:00.442647630Z 2024-05-11T01:24:00.442651014Z 2024-05-11T01:24:00.442907732Z [2024-05-11T01:24:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:24:00.443243593Z [2024-05-11T01:24:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:24:00.443466793Z [2024-05-11T01:24:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:24:00.443730676Z [2024-05-11T01:24:00.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:24:00.444787803Z [2024-05-11T01:24:00.444+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:24:00.444800492Z 2024-05-11T01:24:00.444804912Z 2024-05-11T01:24:00.444820135Z 2024-05-11T01:24:00.444823341Z 2024-05-11T01:24:00.448671433Z [2024-05-11T01:24:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:24:00.448981461Z [2024-05-11T01:24:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:24:00.449329625Z [2024-05-11T01:24:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:24:00.449606437Z [2024-05-11T01:24:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:24:00.449906842Z [2024-05-11T01:24:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:24:00.450118971Z [2024-05-11T01:24:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:24:00.450403744Z [2024-05-11T01:24:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:24:00.450617819Z [2024-05-11T01:24:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:24:00.821609457Z [2024-05-11T01:24:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status queued for try_number 1 2024-05-11T01:24:00.821673558Z [2024-05-11T01:24:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:23:00+00:00 exited with status queued for try_number 1 2024-05-11T01:24:00.821808090Z [2024-05-11T01:24:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:23:00+00:00 exited with status queued for try_number 1 2024-05-11T01:24:00.821936925Z [2024-05-11T01:24:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:23:00+00:00 exited with status queued for try_number 1 2024-05-11T01:24:00.834138837Z [2024-05-11T01:24:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80dab729-b82f-4a9f-988a-e16f95715786 2024-05-11T01:24:00.838367101Z [2024-05-11T01:24:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to be24165d-5665-40f6-b69a-4bdf27071c9b 2024-05-11T01:24:00.838527357Z [2024-05-11T01:24:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 097e0e23-c69a-41f5-ade3-58947aef7e81 2024-05-11T01:24:00.838677360Z [2024-05-11T01:24:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc53c40a-e566-4ef8-9a7b-198cb71a3a72 2024-05-11T01:24:02.063266850Z [2024-05-11T01:24:02.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:24:02.064985281Z [2024-05-11T01:24:02.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:22:00+00:00, run_id=scheduled__2024-05-11T01:22:00+00:00, run_start_date=2024-05-11 01:24:00.376960+00:00, run_end_date=2024-05-11 01:24:02.064408+00:00, run_duration=1.687448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:22:00+00:00, data_interval_end=2024-05-11 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:24:02.077226011Z [2024-05-11T01:24:02.076+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:24:00+00:00, run_after=2024-05-11T01:26:00+00:00 2024-05-11T01:24:03.200263686Z [2024-05-11T01:24:03.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:24:03.200535451Z [2024-05-11T01:24:03.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:23:00+00:00, run_id=scheduled__2024-05-11T01:23:00+00:00, run_start_date=2024-05-11 01:24:00.379410+00:00, run_end_date=2024-05-11 01:24:03.200204+00:00, run_duration=2.820794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:23:00+00:00, data_interval_end=2024-05-11 01:24:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:24:03.211566433Z [2024-05-11T01:24:03.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:24:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:24:03.272354992Z [2024-05-11T01:24:03.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:22:00+00:00 exited with status success for try_number 1 2024-05-11T01:24:03.272658648Z [2024-05-11T01:24:03.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:23:00+00:00 exited with status success for try_number 1 2024-05-11T01:24:03.286769069Z [2024-05-11T01:24:03.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:22:00+00:00, map_index=-1, run_start_date=2024-05-11 01:24:01.557496+00:00, run_end_date=2024-05-11 01:24:01.980808+00:00, run_duration=0.423312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:24:00.445790+00:00, queued_by_job_id=2, pid=11493 2024-05-11T01:24:03.287241364Z [2024-05-11T01:24:03.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:23:00+00:00, map_index=-1, run_start_date=2024-05-11 01:24:01.755239+00:00, run_end_date=2024-05-11 01:24:02.270408+00:00, run_duration=0.515169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:24:00.445790+00:00, queued_by_job_id=2, pid=11494 2024-05-11T01:24:05.455313481Z [2024-05-11T01:24:05.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:24:05.455538914Z [2024-05-11T01:24:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:23:00+00:00, run_id=scheduled__2024-05-11T01:23:00+00:00, run_start_date=2024-05-11 01:24:00.380980+00:00, run_end_date=2024-05-11 01:24:05.455205+00:00, run_duration=5.074225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:23:00+00:00, data_interval_end=2024-05-11 01:24:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:24:05.463948132Z [2024-05-11T01:24:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:24:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:24:05.469945845Z [2024-05-11T01:24:05.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:24:05.470138963Z [2024-05-11T01:24:05.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:23:00+00:00, run_id=scheduled__2024-05-11T01:23:00+00:00, run_start_date=2024-05-11 01:24:00.383202+00:00, run_end_date=2024-05-11 01:24:05.469844+00:00, run_duration=5.086642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:23:00+00:00, data_interval_end=2024-05-11 01:24:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:24:05.478517416Z [2024-05-11T01:24:05.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:24:00+00:00, run_after=2024-05-11T01:25:00+00:00 2024-05-11T01:24:05.526503144Z [2024-05-11T01:24:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:23:00+00:00 exited with status success for try_number 1 2024-05-11T01:24:05.533380864Z [2024-05-11T01:24:05.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:23:00+00:00, map_index=-1, run_start_date=2024-05-11 01:24:02.985756+00:00, run_end_date=2024-05-11 01:24:04.820738+00:00, run_duration=1.834982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:24:00.445790+00:00, queued_by_job_id=2, pid=11518 2024-05-11T01:24:05.972773533Z [2024-05-11T01:24:05.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:23:00+00:00 exited with status success for try_number 1 2024-05-11T01:24:05.980293648Z [2024-05-11T01:24:05.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:23:00+00:00, map_index=-1, run_start_date=2024-05-11 01:24:02.950703+00:00, run_end_date=2024-05-11 01:24:05.401186+00:00, run_duration=2.450483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:24:00.445790+00:00, queued_by_job_id=2, pid=11517 2024-05-11T01:25:00.429155837Z [2024-05-11T01:25:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:26:00+00:00 2024-05-11T01:25:00.443941127Z [2024-05-11T01:25:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:25:00.452718984Z [2024-05-11T01:25:00.452+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:25:00.467374971Z [2024-05-11T01:25:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:26:00+00:00 2024-05-11T01:25:00.578696557Z [2024-05-11T01:25:00.578+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:25:00.578732321Z 2024-05-11T01:25:00.578740383Z 2024-05-11T01:25:00.578746108Z 2024-05-11T01:25:00.578752239Z 2024-05-11T01:25:00.579122837Z [2024-05-11T01:25:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:25:00.579824904Z [2024-05-11T01:25:00.579+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:25:00.580216586Z [2024-05-11T01:25:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:25:00.580688223Z [2024-05-11T01:25:00.580+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:25:00.582102510Z [2024-05-11T01:25:00.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:25:00.582122094Z 2024-05-11T01:25:00.582169582Z 2024-05-11T01:25:00.582174718Z 2024-05-11T01:25:00.582179580Z 2024-05-11T01:25:00.588266860Z [2024-05-11T01:25:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:25:00.588545108Z [2024-05-11T01:25:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:25:00.588960676Z [2024-05-11T01:25:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:25:00.589196566Z [2024-05-11T01:25:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:25:00.589547272Z [2024-05-11T01:25:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:25:00.589796276Z [2024-05-11T01:25:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:25:00.590246184Z [2024-05-11T01:25:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:25:00.590390910Z [2024-05-11T01:25:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:25:00.955056444Z [2024-05-11T01:25:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:00.955336206Z [2024-05-11T01:25:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:00.955396660Z [2024-05-11T01:25:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:00.955533104Z [2024-05-11T01:25:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:00.981016184Z [2024-05-11T01:25:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58e31518-96fc-49d9-a212-a98a581308c1 2024-05-11T01:25:00.981148654Z [2024-05-11T01:25:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bb14636-c961-4acd-9072-9618469e79a9 2024-05-11T01:25:00.981797041Z [2024-05-11T01:25:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34bccea2-114a-433c-b850-c70c15703610 2024-05-11T01:25:00.982014356Z [2024-05-11T01:25:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81110e8c-3bfa-47e7-8e89-98f0754f216d 2024-05-11T01:25:03.075952758Z [2024-05-11T01:25:03.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:25:03.076295451Z [2024-05-11T01:25:03.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:24:00+00:00, run_id=scheduled__2024-05-11T01:24:00+00:00, run_start_date=2024-05-11 01:25:00.484137+00:00, run_end_date=2024-05-11 01:25:03.075838+00:00, run_duration=2.591701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:24:00+00:00, data_interval_end=2024-05-11 01:25:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:25:03.085592293Z [2024-05-11T01:25:03.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:26:00+00:00 2024-05-11T01:25:03.207370286Z [2024-05-11T01:25:03.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:03.220786392Z [2024-05-11T01:25:03.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:24:00+00:00, map_index=-1, run_start_date=2024-05-11 01:25:01.853291+00:00, run_end_date=2024-05-11 01:25:02.365674+00:00, run_duration=0.512383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:00.584148+00:00, queued_by_job_id=2, pid=11551 2024-05-11T01:25:04.314101572Z [2024-05-11T01:25:04.313+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:25:04.314154198Z 2024-05-11T01:25:04.314362536Z [2024-05-11T01:25:04.313+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:25:04.315086737Z [2024-05-11T01:25:04.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:25:04.315097942Z 2024-05-11T01:25:04.318724269Z [2024-05-11T01:25:04.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:25:04.319034566Z [2024-05-11T01:25:04.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:25:04.377991452Z [2024-05-11T01:25:04.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:04.378131440Z [2024-05-11T01:25:04.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:04.383501951Z [2024-05-11T01:25:04.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to b377368c-4b11-447c-87ca-0b1bb76586db 2024-05-11T01:25:04.383789730Z [2024-05-11T01:25:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:25:03.306033+00:00, run_end_date=2024-05-11 01:25:03.744540+00:00, run_duration=0.438507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:00.584148+00:00, queued_by_job_id=2, pid=11581 2024-05-11T01:25:05.555638574Z [2024-05-11T01:25:05.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:25:05.556278682Z [2024-05-11T01:25:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:24:00+00:00, run_id=scheduled__2024-05-11T01:24:00+00:00, run_start_date=2024-05-11 01:25:00.488391+00:00, run_end_date=2024-05-11 01:25:05.555800+00:00, run_duration=5.067409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:24:00+00:00, data_interval_end=2024-05-11 01:25:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:25:05.571849366Z [2024-05-11T01:25:05.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:26:00+00:00 2024-05-11T01:25:05.582589471Z [2024-05-11T01:25:05.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:25:05.583182624Z [2024-05-11T01:25:05.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:24:00+00:00, run_id=scheduled__2024-05-11T01:24:00+00:00, run_start_date=2024-05-11 01:25:00.486129+00:00, run_end_date=2024-05-11 01:25:05.582729+00:00, run_duration=5.0966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:24:00+00:00, data_interval_end=2024-05-11 01:25:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:25:05.601327771Z [2024-05-11T01:25:05.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:26:00+00:00 2024-05-11T01:25:05.659781068Z [2024-05-11T01:25:05.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:05.660066664Z [2024-05-11T01:25:05.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:05.669137203Z [2024-05-11T01:25:05.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:24:00+00:00, map_index=-1, run_start_date=2024-05-11 01:25:03.095411+00:00, run_end_date=2024-05-11 01:25:04.495034+00:00, run_duration=1.399623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:00.584148+00:00, queued_by_job_id=2, pid=11576 2024-05-11T01:25:05.669551257Z [2024-05-11T01:25:05.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:24:00+00:00, map_index=-1, run_start_date=2024-05-11 01:25:02.911515+00:00, run_end_date=2024-05-11 01:25:04.585606+00:00, run_duration=1.674091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:00.584148+00:00, queued_by_job_id=2, pid=11570 2024-05-11T01:25:06.734206140Z [2024-05-11T01:25:06.733+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:25:06.734232816Z 2024-05-11T01:25:06.734280670Z [2024-05-11T01:25:06.734+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:25:06.735116083Z [2024-05-11T01:25:06.734+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:25:06.735123381Z 2024-05-11T01:25:06.738266816Z [2024-05-11T01:25:06.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:25:06.738466127Z [2024-05-11T01:25:06.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:25:06.826664984Z [2024-05-11T01:25:06.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:06.828814822Z [2024-05-11T01:25:06.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:06.834011362Z [2024-05-11T01:25:06.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to f16e00a5-e5c5-45c8-88ae-96398b6ba21e 2024-05-11T01:25:06.834349333Z [2024-05-11T01:25:06.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:25:06.017488+00:00, run_end_date=2024-05-11 01:25:06.365463+00:00, run_duration=0.347975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:04.315505+00:00, queued_by_job_id=2, pid=11610 2024-05-11T01:25:09.499550447Z [2024-05-11T01:25:09.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:25:09.499584783Z 2024-05-11T01:25:09.499642539Z [2024-05-11T01:25:09.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:25:09.500326858Z [2024-05-11T01:25:09.500+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:25:09.500337869Z 2024-05-11T01:25:09.502696662Z [2024-05-11T01:25:09.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:25:09.502926007Z [2024-05-11T01:25:09.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:25:09.551514537Z [2024-05-11T01:25:09.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status queued for try_number 1 2024-05-11T01:25:09.551728732Z [2024-05-11T01:25:09.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:09.558839785Z [2024-05-11T01:25:09.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28950ab8-c4de-451a-a031-deaee5cfc00a 2024-05-11T01:25:09.559060903Z [2024-05-11T01:25:09.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=0, run_start_date=2024-05-11 01:25:08.503808+00:00, run_end_date=2024-05-11 01:25:08.779952+00:00, run_duration=0.276144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:06.735512+00:00, queued_by_job_id=2, pid=11621 2024-05-11T01:25:11.807674518Z [2024-05-11T01:25:11.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:25:11.807921291Z [2024-05-11T01:25:11.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:20:00+00:00, run_id=scheduled__2024-05-11T01:20:00+00:00, run_start_date=2024-05-11 01:25:00.482449+00:00, run_end_date=2024-05-11 01:25:11.807388+00:00, run_duration=11.324939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:20:00+00:00, data_interval_end=2024-05-11 01:25:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:25:11.817344351Z [2024-05-11T01:25:11.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:25:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:25:11.861102111Z [2024-05-11T01:25:11.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:20:00+00:00 exited with status success for try_number 1 2024-05-11T01:25:11.868488269Z [2024-05-11T01:25:11.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:20:00+00:00, map_index=-1, run_start_date=2024-05-11 01:25:11.129521+00:00, run_end_date=2024-05-11 01:25:11.504630+00:00, run_duration=0.375109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:25:09.500721+00:00, queued_by_job_id=2, pid=11629 2024-05-11T01:25:35.579592126Z [2024-05-11T01:25:35.578+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:26:00.800749698Z [2024-05-11T01:26:00.800+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:26:00.807778746Z [2024-05-11T01:26:00.807+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:26:00.819926892Z [2024-05-11T01:26:00.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:26:00+00:00, run_after=2024-05-11T01:27:00+00:00 2024-05-11T01:26:00.833900679Z [2024-05-11T01:26:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:26:00+00:00, run_after=2024-05-11T01:27:00+00:00 2024-05-11T01:26:00.905994236Z [2024-05-11T01:26:00.905+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:26:00.906024809Z 2024-05-11T01:26:00.906029678Z 2024-05-11T01:26:00.906053379Z 2024-05-11T01:26:00.906059258Z 2024-05-11T01:26:00.906352754Z [2024-05-11T01:26:00.906+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:26:00.906661315Z [2024-05-11T01:26:00.906+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:26:00.906927856Z [2024-05-11T01:26:00.906+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:26:00.907247252Z [2024-05-11T01:26:00.907+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:26:00.908306627Z [2024-05-11T01:26:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:26:00.908321492Z 2024-05-11T01:26:00.908327603Z 2024-05-11T01:26:00.908352268Z 2024-05-11T01:26:00.908358518Z 2024-05-11T01:26:00.911817457Z [2024-05-11T01:26:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:26:00.912071380Z [2024-05-11T01:26:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:26:00.912492091Z [2024-05-11T01:26:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:26:00.912818028Z [2024-05-11T01:26:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:26:00.913165792Z [2024-05-11T01:26:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:26:00.913372168Z [2024-05-11T01:26:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:26:00.913766589Z [2024-05-11T01:26:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:26:00.914038933Z [2024-05-11T01:26:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:26:01.495107840Z [2024-05-11T01:26:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status queued for try_number 1 2024-05-11T01:26:01.497467071Z [2024-05-11T01:26:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:26:01.497708251Z [2024-05-11T01:26:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:26:01.497853273Z [2024-05-11T01:26:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:26:01.519437538Z [2024-05-11T01:26:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to afd94bcd-fa58-4958-b3d1-728c113a5c81 2024-05-11T01:26:01.519563910Z [2024-05-11T01:26:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb954b38-0412-466e-8cf4-9e163cef677c 2024-05-11T01:26:01.519718560Z [2024-05-11T01:26:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to e438c3fd-7fac-4b2e-bba1-536b8c6bf8a5 2024-05-11T01:26:01.519875590Z [2024-05-11T01:26:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89b81d57-f869-4c22-8452-14ee0aac183d 2024-05-11T01:26:02.787890765Z [2024-05-11T01:26:02.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:26:02.788178322Z [2024-05-11T01:26:02.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:24:00+00:00, run_id=scheduled__2024-05-11T01:24:00+00:00, run_start_date=2024-05-11 01:26:00.844347+00:00, run_end_date=2024-05-11 01:26:02.787846+00:00, run_duration=1.943499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:24:00+00:00, data_interval_end=2024-05-11 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:26:02.795354038Z [2024-05-11T01:26:02.795+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:26:00+00:00, run_after=2024-05-11T01:28:00+00:00 2024-05-11T01:26:02.801567777Z [2024-05-11T01:26:02.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:26:02.801732184Z [2024-05-11T01:26:02.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:25:00+00:00, run_id=scheduled__2024-05-11T01:25:00+00:00, run_start_date=2024-05-11 01:26:00.846034+00:00, run_end_date=2024-05-11 01:26:02.801484+00:00, run_duration=1.95545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:25:00+00:00, data_interval_end=2024-05-11 01:26:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:26:02.810923492Z [2024-05-11T01:26:02.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:26:00+00:00, run_after=2024-05-11T01:27:00+00:00 2024-05-11T01:26:02.859370276Z [2024-05-11T01:26:02.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:24:00+00:00 exited with status success for try_number 1 2024-05-11T01:26:02.859665790Z [2024-05-11T01:26:02.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:26:02.870989653Z [2024-05-11T01:26:02.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:24:00+00:00, map_index=-1, run_start_date=2024-05-11 01:26:01.786008+00:00, run_end_date=2024-05-11 01:26:02.189361+00:00, run_duration=0.403353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:26:00.909367+00:00, queued_by_job_id=2, pid=11639 2024-05-11T01:26:02.871547128Z [2024-05-11T01:26:02.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=-1, run_start_date=2024-05-11 01:26:01.854148+00:00, run_end_date=2024-05-11 01:26:02.222401+00:00, run_duration=0.368253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:26:00.909367+00:00, queued_by_job_id=2, pid=11640 2024-05-11T01:26:05.209696701Z [2024-05-11T01:26:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:26:05.210646153Z [2024-05-11T01:26:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:25:00+00:00, run_id=scheduled__2024-05-11T01:25:00+00:00, run_start_date=2024-05-11 01:26:00.847132+00:00, run_end_date=2024-05-11 01:26:05.209612+00:00, run_duration=4.36248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:25:00+00:00, data_interval_end=2024-05-11 01:26:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:26:05.219363162Z [2024-05-11T01:26:05.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:26:00+00:00, run_after=2024-05-11T01:27:00+00:00 2024-05-11T01:26:05.227335979Z [2024-05-11T01:26:05.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:26:05.227503335Z [2024-05-11T01:26:05.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:25:00+00:00, run_id=scheduled__2024-05-11T01:25:00+00:00, run_start_date=2024-05-11 01:26:00.848136+00:00, run_end_date=2024-05-11 01:26:05.227245+00:00, run_duration=4.379109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:25:00+00:00, data_interval_end=2024-05-11 01:26:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:26:05.236385099Z [2024-05-11T01:26:05.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:26:00+00:00, run_after=2024-05-11T01:27:00+00:00 2024-05-11T01:26:05.274332854Z [2024-05-11T01:26:05.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:26:05.274355974Z [2024-05-11T01:26:05.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:26:05.280678262Z [2024-05-11T01:26:05.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=-1, run_start_date=2024-05-11 01:26:02.932968+00:00, run_end_date=2024-05-11 01:26:04.626396+00:00, run_duration=1.693428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:26:00.909367+00:00, queued_by_job_id=2, pid=11663 2024-05-11T01:26:05.280813865Z [2024-05-11T01:26:05.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=-1, run_start_date=2024-05-11 01:26:02.948261+00:00, run_end_date=2024-05-11 01:26:04.914094+00:00, run_duration=1.965833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:26:00.909367+00:00, queued_by_job_id=2, pid=11664 2024-05-11T01:27:00.152006044Z [2024-05-11T01:27:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:27:00+00:00, run_after=2024-05-11T01:28:00+00:00 2024-05-11T01:27:00.158396821Z [2024-05-11T01:27:00.158+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:27:00.168846017Z [2024-05-11T01:27:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:27:00+00:00, run_after=2024-05-11T01:28:00+00:00 2024-05-11T01:27:00.243917841Z [2024-05-11T01:27:00.243+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:27:00.243940965Z 2024-05-11T01:27:00.243945233Z 2024-05-11T01:27:00.243961718Z 2024-05-11T01:27:00.244043915Z [2024-05-11T01:27:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:27:00.244048620Z [2024-05-11T01:27:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:27:00.244084214Z [2024-05-11T01:27:00.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:27:00.244601146Z [2024-05-11T01:27:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:27:00.244610223Z 2024-05-11T01:27:00.244613398Z 2024-05-11T01:27:00.244616444Z 2024-05-11T01:27:00.247434776Z [2024-05-11T01:27:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:27:00.247511850Z [2024-05-11T01:27:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:27:00.247711749Z [2024-05-11T01:27:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:27:00.247812089Z [2024-05-11T01:27:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:27:00.247968271Z [2024-05-11T01:27:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:27:00.248040046Z [2024-05-11T01:27:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:27:00.832184489Z [2024-05-11T01:27:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status queued for try_number 1 2024-05-11T01:27:00.832209107Z [2024-05-11T01:27:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status queued for try_number 1 2024-05-11T01:27:00.832323262Z [2024-05-11T01:27:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status queued for try_number 1 2024-05-11T01:27:00.851110367Z [2024-05-11T01:27:00.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 952ca6c5-9c80-4efb-8054-6fe92ab32847 2024-05-11T01:27:00.851239273Z [2024-05-11T01:27:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2adf912d-62a5-453b-9d08-844a600ebb5f 2024-05-11T01:27:00.851406238Z [2024-05-11T01:27:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5298cba3-f849-44f1-a8de-e80b1898975e 2024-05-11T01:27:02.041471503Z [2024-05-11T01:27:02.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:27:02.041698224Z [2024-05-11T01:27:02.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:26:00+00:00, run_id=scheduled__2024-05-11T01:26:00+00:00, run_start_date=2024-05-11 01:27:00.177970+00:00, run_end_date=2024-05-11 01:27:02.041398+00:00, run_duration=1.863428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:26:00+00:00, data_interval_end=2024-05-11 01:27:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:27:02.057657723Z [2024-05-11T01:27:02.057+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:27:00+00:00, run_after=2024-05-11T01:28:00+00:00 2024-05-11T01:27:02.108662853Z [2024-05-11T01:27:02.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status success for try_number 1 2024-05-11T01:27:02.115579135Z [2024-05-11T01:27:02.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:26:00+00:00, map_index=-1, run_start_date=2024-05-11 01:27:01.329105+00:00, run_end_date=2024-05-11 01:27:01.738618+00:00, run_duration=0.409513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:27:00.245186+00:00, queued_by_job_id=2, pid=11698 2024-05-11T01:27:03.915047516Z [2024-05-11T01:27:03.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:27:03.915468874Z [2024-05-11T01:27:03.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:26:00+00:00, run_id=scheduled__2024-05-11T01:26:00+00:00, run_start_date=2024-05-11 01:27:00.180453+00:00, run_end_date=2024-05-11 01:27:03.915190+00:00, run_duration=3.734737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:26:00+00:00, data_interval_end=2024-05-11 01:27:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:27:03.923964678Z [2024-05-11T01:27:03.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:27:00+00:00, run_after=2024-05-11T01:28:00+00:00 2024-05-11T01:27:03.929476179Z [2024-05-11T01:27:03.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:27:03.929798221Z [2024-05-11T01:27:03.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:26:00+00:00, run_id=scheduled__2024-05-11T01:26:00+00:00, run_start_date=2024-05-11 01:27:00.179456+00:00, run_end_date=2024-05-11 01:27:03.929537+00:00, run_duration=3.750081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:26:00+00:00, data_interval_end=2024-05-11 01:27:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:27:03.938415370Z [2024-05-11T01:27:03.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:27:00+00:00, run_after=2024-05-11T01:28:00+00:00 2024-05-11T01:27:03.969417130Z [2024-05-11T01:27:03.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status success for try_number 1 2024-05-11T01:27:03.973654676Z [2024-05-11T01:27:03.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:26:00+00:00, map_index=-1, run_start_date=2024-05-11 01:27:02.052317+00:00, run_end_date=2024-05-11 01:27:03.280955+00:00, run_duration=1.228638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:27:00.245186+00:00, queued_by_job_id=2, pid=11715 2024-05-11T01:27:05.076377989Z [2024-05-11T01:27:05.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status success for try_number 1 2024-05-11T01:27:05.083442968Z [2024-05-11T01:27:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:26:00+00:00, map_index=-1, run_start_date=2024-05-11 01:27:02.209067+00:00, run_end_date=2024-05-11 01:27:03.868189+00:00, run_duration=1.659122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:27:00.245186+00:00, queued_by_job_id=2, pid=11716 2024-05-11T01:28:00.657519815Z [2024-05-11T01:28:00.657+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:28:00.665674863Z [2024-05-11T01:28:00.665+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:28:00.678429238Z [2024-05-11T01:28:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:28:00+00:00, run_after=2024-05-11T01:29:00+00:00 2024-05-11T01:28:00.704751450Z [2024-05-11T01:28:00.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:28:00+00:00, run_after=2024-05-11T01:29:00+00:00 2024-05-11T01:28:00.788189791Z [2024-05-11T01:28:00.787+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:28:00.788224272Z 2024-05-11T01:28:00.788239851Z 2024-05-11T01:28:00.788246955Z 2024-05-11T01:28:00.788253759Z 2024-05-11T01:28:00.788261045Z [2024-05-11T01:28:00.788+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:28:00.788445445Z [2024-05-11T01:28:00.788+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:28:00.788605795Z [2024-05-11T01:28:00.788+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:28:00.788838883Z [2024-05-11T01:28:00.788+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:28:00.789581203Z [2024-05-11T01:28:00.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:28:00.789614276Z 2024-05-11T01:28:00.789624939Z 2024-05-11T01:28:00.789633454Z 2024-05-11T01:28:00.789641883Z 2024-05-11T01:28:00.793598597Z [2024-05-11T01:28:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:28:00.793617378Z [2024-05-11T01:28:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:28:00.794011714Z [2024-05-11T01:28:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:28:00.794026633Z [2024-05-11T01:28:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:28:00.794305137Z [2024-05-11T01:28:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:28:00.794369284Z [2024-05-11T01:28:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:28:00.794632190Z [2024-05-11T01:28:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:28:00.794713751Z [2024-05-11T01:28:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:28:01.371225247Z [2024-05-11T01:28:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status queued for try_number 1 2024-05-11T01:28:01.371270748Z [2024-05-11T01:28:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:27:00+00:00 exited with status queued for try_number 1 2024-05-11T01:28:01.371400498Z [2024-05-11T01:28:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:27:00+00:00 exited with status queued for try_number 1 2024-05-11T01:28:01.371564245Z [2024-05-11T01:28:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:27:00+00:00 exited with status queued for try_number 1 2024-05-11T01:28:01.381050863Z [2024-05-11T01:28:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fe63fb4-f5f1-4b00-a286-de14f1a8e26b 2024-05-11T01:28:01.381189151Z [2024-05-11T01:28:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d358310-1fef-41f1-b088-9f2eba8257d8 2024-05-11T01:28:01.381372660Z [2024-05-11T01:28:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b44cc6d-b55b-49dd-b936-8b012ec37f8b 2024-05-11T01:28:01.381505975Z [2024-05-11T01:28:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca5fa002-7942-491c-b779-c225a7c7e876 2024-05-11T01:28:02.556067116Z [2024-05-11T01:28:02.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:28:02.556729422Z [2024-05-11T01:28:02.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:26:00+00:00, run_id=scheduled__2024-05-11T01:26:00+00:00, run_start_date=2024-05-11 01:28:00.717602+00:00, run_end_date=2024-05-11 01:28:02.555995+00:00, run_duration=1.838393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:26:00+00:00, data_interval_end=2024-05-11 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:28:02.565078830Z [2024-05-11T01:28:02.564+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:28:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:28:02.572402953Z [2024-05-11T01:28:02.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:28:02.572707268Z [2024-05-11T01:28:02.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:27:00+00:00, run_id=scheduled__2024-05-11T01:27:00+00:00, run_start_date=2024-05-11 01:28:00.719093+00:00, run_end_date=2024-05-11 01:28:02.572300+00:00, run_duration=1.853207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:27:00+00:00, data_interval_end=2024-05-11 01:28:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:28:02.582663898Z [2024-05-11T01:28:02.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:28:00+00:00, run_after=2024-05-11T01:29:00+00:00 2024-05-11T01:28:02.630179841Z [2024-05-11T01:28:02.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:26:00+00:00 exited with status success for try_number 1 2024-05-11T01:28:02.630335222Z [2024-05-11T01:28:02.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:27:00+00:00 exited with status success for try_number 1 2024-05-11T01:28:02.636847973Z [2024-05-11T01:28:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:26:00+00:00, map_index=-1, run_start_date=2024-05-11 01:28:01.664733+00:00, run_end_date=2024-05-11 01:28:02.002628+00:00, run_duration=0.337895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:28:00.790570+00:00, queued_by_job_id=2, pid=11749 2024-05-11T01:28:02.637080293Z [2024-05-11T01:28:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:27:00+00:00, map_index=-1, run_start_date=2024-05-11 01:28:01.772718+00:00, run_end_date=2024-05-11 01:28:02.186668+00:00, run_duration=0.41395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:28:00.790570+00:00, queued_by_job_id=2, pid=11750 2024-05-11T01:28:04.668518342Z [2024-05-11T01:28:04.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:28:04.668676505Z [2024-05-11T01:28:04.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:27:00+00:00, run_id=scheduled__2024-05-11T01:27:00+00:00, run_start_date=2024-05-11 01:28:00.720439+00:00, run_end_date=2024-05-11 01:28:04.668424+00:00, run_duration=3.947985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:27:00+00:00, data_interval_end=2024-05-11 01:28:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:28:04.677047631Z [2024-05-11T01:28:04.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:28:00+00:00, run_after=2024-05-11T01:29:00+00:00 2024-05-11T01:28:04.724265140Z [2024-05-11T01:28:04.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:27:00+00:00 exited with status success for try_number 1 2024-05-11T01:28:04.733338977Z [2024-05-11T01:28:04.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:27:00+00:00, map_index=-1, run_start_date=2024-05-11 01:28:02.687997+00:00, run_end_date=2024-05-11 01:28:04.117056+00:00, run_duration=1.429059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:28:00.790570+00:00, queued_by_job_id=2, pid=11768 2024-05-11T01:28:05.781197003Z [2024-05-11T01:28:05.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:28:05.781258955Z [2024-05-11T01:28:05.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:27:00+00:00, run_id=scheduled__2024-05-11T01:27:00+00:00, run_start_date=2024-05-11 01:28:00.721651+00:00, run_end_date=2024-05-11 01:28:05.780997+00:00, run_duration=5.059346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:27:00+00:00, data_interval_end=2024-05-11 01:28:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:28:05.790079505Z [2024-05-11T01:28:05.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:28:00+00:00, run_after=2024-05-11T01:29:00+00:00 2024-05-11T01:28:05.826391935Z [2024-05-11T01:28:05.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:27:00+00:00 exited with status success for try_number 1 2024-05-11T01:28:05.831596207Z [2024-05-11T01:28:05.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:27:00+00:00, map_index=-1, run_start_date=2024-05-11 01:28:02.923794+00:00, run_end_date=2024-05-11 01:28:04.776782+00:00, run_duration=1.852988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:28:00.790570+00:00, queued_by_job_id=2, pid=11774 2024-05-11T01:29:00.437064943Z [2024-05-11T01:29:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:29:00.457448467Z [2024-05-11T01:29:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:29:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:29:00.469999175Z [2024-05-11T01:29:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:29:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:29:00.540046909Z [2024-05-11T01:29:00.538+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:29:00.540075033Z 2024-05-11T01:29:00.540078706Z 2024-05-11T01:29:00.540081740Z 2024-05-11T01:29:00.540084951Z [2024-05-11T01:29:00.538+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:29:00.540087914Z [2024-05-11T01:29:00.539+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:29:00.540090934Z [2024-05-11T01:29:00.539+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:29:00.540094859Z [2024-05-11T01:29:00.539+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:29:00.540097719Z 2024-05-11T01:29:00.540100693Z 2024-05-11T01:29:00.540103549Z 2024-05-11T01:29:00.543571325Z [2024-05-11T01:29:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:29:00.543599916Z [2024-05-11T01:29:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:29:00.543823130Z [2024-05-11T01:29:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:29:00.543904283Z [2024-05-11T01:29:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:29:00.544078625Z [2024-05-11T01:29:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:29:00.544281286Z [2024-05-11T01:29:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:29:00.822485316Z [2024-05-11T01:29:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status queued for try_number 1 2024-05-11T01:29:00.822517541Z [2024-05-11T01:29:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status queued for try_number 1 2024-05-11T01:29:00.822584768Z [2024-05-11T01:29:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status queued for try_number 1 2024-05-11T01:29:00.843988567Z [2024-05-11T01:29:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to c05a467b-a553-42c7-a9e2-ea398949ca8a 2024-05-11T01:29:00.844024112Z [2024-05-11T01:29:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b7e0872-43e7-4c67-bd8c-ae00195a8c93 2024-05-11T01:29:00.844162128Z [2024-05-11T01:29:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to aee52e56-2f32-4c49-8359-d1217275a4a7 2024-05-11T01:29:02.128905411Z [2024-05-11T01:29:02.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:29:02.129061105Z [2024-05-11T01:29:02.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:28:00+00:00, run_id=scheduled__2024-05-11T01:28:00+00:00, run_start_date=2024-05-11 01:29:00.479614+00:00, run_end_date=2024-05-11 01:29:02.128758+00:00, run_duration=1.649144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:28:00+00:00, data_interval_end=2024-05-11 01:29:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:29:02.138287367Z [2024-05-11T01:29:02.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:29:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:29:02.186992392Z [2024-05-11T01:29:02.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status success for try_number 1 2024-05-11T01:29:02.193209551Z [2024-05-11T01:29:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:28:00+00:00, map_index=-1, run_start_date=2024-05-11 01:29:01.575927+00:00, run_end_date=2024-05-11 01:29:02.014041+00:00, run_duration=0.438114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:29:00.540824+00:00, queued_by_job_id=2, pid=11806 2024-05-11T01:29:05.423048615Z [2024-05-11T01:29:05.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:29:05.423179556Z [2024-05-11T01:29:05.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:28:00+00:00, run_id=scheduled__2024-05-11T01:28:00+00:00, run_start_date=2024-05-11 01:29:00.480794+00:00, run_end_date=2024-05-11 01:29:05.422946+00:00, run_duration=4.942152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:28:00+00:00, data_interval_end=2024-05-11 01:29:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:29:05.431342591Z [2024-05-11T01:29:05.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:29:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:29:05.437448953Z [2024-05-11T01:29:05.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:29:05.437595838Z [2024-05-11T01:29:05.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:28:00+00:00, run_id=scheduled__2024-05-11T01:28:00+00:00, run_start_date=2024-05-11 01:29:00.481796+00:00, run_end_date=2024-05-11 01:29:05.437352+00:00, run_duration=4.955556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:28:00+00:00, data_interval_end=2024-05-11 01:29:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:29:05.448200535Z [2024-05-11T01:29:05.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:29:00+00:00, run_after=2024-05-11T01:30:00+00:00 2024-05-11T01:29:05.475549470Z [2024-05-11T01:29:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status success for try_number 1 2024-05-11T01:29:05.475607719Z [2024-05-11T01:29:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status success for try_number 1 2024-05-11T01:29:05.481321693Z [2024-05-11T01:29:05.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:28:00+00:00, map_index=-1, run_start_date=2024-05-11 01:29:02.687779+00:00, run_end_date=2024-05-11 01:29:04.366975+00:00, run_duration=1.679196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:29:00.540824+00:00, queued_by_job_id=2, pid=11824 2024-05-11T01:29:05.481340097Z [2024-05-11T01:29:05.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:28:00+00:00, map_index=-1, run_start_date=2024-05-11 01:29:02.695467+00:00, run_end_date=2024-05-11 01:29:05.289889+00:00, run_duration=2.594422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:29:00.540824+00:00, queued_by_job_id=2, pid=11825 2024-05-11T01:30:00.329127545Z [2024-05-11T01:30:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:31:00+00:00 2024-05-11T01:30:00.351602832Z [2024-05-11T01:30:00.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:31:00+00:00 2024-05-11T01:30:00.362849679Z [2024-05-11T01:30:00.362+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:30:00.371992274Z [2024-05-11T01:30:00.371+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:30:00.395672271Z [2024-05-11T01:30:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:30:00.509146035Z [2024-05-11T01:30:00.508+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:30:00.509172815Z 2024-05-11T01:30:00.509176660Z 2024-05-11T01:30:00.509180813Z 2024-05-11T01:30:00.509184559Z 2024-05-11T01:30:00.509187752Z 2024-05-11T01:30:00.509395152Z [2024-05-11T01:30:00.509+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:30:00.509578641Z [2024-05-11T01:30:00.509+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:30:00.509777263Z [2024-05-11T01:30:00.509+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:30:00.510042847Z [2024-05-11T01:30:00.509+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:30:00.510231705Z [2024-05-11T01:30:00.510+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:30:00.510834990Z [2024-05-11T01:30:00.510+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:30:00.510839550Z 2024-05-11T01:30:00.510842927Z 2024-05-11T01:30:00.510846408Z 2024-05-11T01:30:00.510849541Z 2024-05-11T01:30:00.510852773Z 2024-05-11T01:30:00.514960947Z [2024-05-11T01:30:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:30:00.515219669Z [2024-05-11T01:30:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:30:00.515520601Z [2024-05-11T01:30:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:30:00.515708706Z [2024-05-11T01:30:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:30:00.515989119Z [2024-05-11T01:30:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:30:00.516158444Z [2024-05-11T01:30:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:30:00.516458933Z [2024-05-11T01:30:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:30:00.516636490Z [2024-05-11T01:30:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:30:00.516886157Z [2024-05-11T01:30:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:30:00.517076342Z [2024-05-11T01:30:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:30:01.095295325Z [2024-05-11T01:30:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:01.098091462Z [2024-05-11T01:30:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:01.098432530Z [2024-05-11T01:30:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:29:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:01.098618618Z [2024-05-11T01:30:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:29:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:01.099503175Z [2024-05-11T01:30:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:29:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:01.117069880Z [2024-05-11T01:30:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2206febc-e978-41fe-a2c4-9c4077767f24 2024-05-11T01:30:01.117529498Z [2024-05-11T01:30:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to d738b1ea-8fbd-461c-b65e-dfded7ca66a9 2024-05-11T01:30:01.117740217Z [2024-05-11T01:30:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8be4849-1a45-4600-86b7-64cceab78db3 2024-05-11T01:30:01.117954739Z [2024-05-11T01:30:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64675038-c4c1-4b80-a4f5-2580c919114a 2024-05-11T01:30:01.118107826Z [2024-05-11T01:30:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to b67ea7f8-9913-493f-a28f-0a2b7c24fe1a 2024-05-11T01:30:03.010851412Z [2024-05-11T01:30:03.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:30:03.013039410Z [2024-05-11T01:30:03.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:29:00+00:00, run_id=scheduled__2024-05-11T01:29:00+00:00, run_start_date=2024-05-11 01:30:00.417062+00:00, run_end_date=2024-05-11 01:30:03.010964+00:00, run_duration=2.593902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:29:00+00:00, data_interval_end=2024-05-11 01:30:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:30:03.027540438Z [2024-05-11T01:30:03.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:31:00+00:00 2024-05-11T01:30:03.047727267Z [2024-05-11T01:30:03.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:30:03.048132155Z [2024-05-11T01:30:03.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:28:00+00:00, run_id=scheduled__2024-05-11T01:28:00+00:00, run_start_date=2024-05-11 01:30:00.415059+00:00, run_end_date=2024-05-11 01:30:03.047640+00:00, run_duration=2.632581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:28:00+00:00, data_interval_end=2024-05-11 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:30:03.057070089Z [2024-05-11T01:30:03.056+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:32:00+00:00 2024-05-11T01:30:03.139236911Z [2024-05-11T01:30:03.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:28:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:03.139841919Z [2024-05-11T01:30:03.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:29:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:03.147262472Z [2024-05-11T01:30:03.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:29:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:01.699137+00:00, run_end_date=2024-05-11 01:30:02.303231+00:00, run_duration=0.604094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:00.511880+00:00, queued_by_job_id=2, pid=11859 2024-05-11T01:30:03.147669908Z [2024-05-11T01:30:03.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:28:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:01.737077+00:00, run_end_date=2024-05-11 01:30:02.353785+00:00, run_duration=0.616708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:00.511880+00:00, queued_by_job_id=2, pid=11860 2024-05-11T01:30:04.251742744Z [2024-05-11T01:30:04.251+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:30:04.251779917Z 2024-05-11T01:30:04.252314030Z [2024-05-11T01:30:04.251+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:30:04.253660745Z [2024-05-11T01:30:04.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:30:04.253681699Z 2024-05-11T01:30:04.258410845Z [2024-05-11T01:30:04.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:30:04.258819893Z [2024-05-11T01:30:04.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:30:04.320891001Z [2024-05-11T01:30:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:04.321144320Z [2024-05-11T01:30:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:04.329632746Z [2024-05-11T01:30:04.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80e24d19-954d-4d2d-9267-abd2838ece15 2024-05-11T01:30:04.330168236Z [2024-05-11T01:30:04.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:03.101218+00:00, run_end_date=2024-05-11 01:30:03.554305+00:00, run_duration=0.453087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:00.511880+00:00, queued_by_job_id=2, pid=11890 2024-05-11T01:30:05.488336532Z [2024-05-11T01:30:05.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:30:05.488646154Z [2024-05-11T01:30:05.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:29:00+00:00, run_id=scheduled__2024-05-11T01:29:00+00:00, run_start_date=2024-05-11 01:30:00.418596+00:00, run_end_date=2024-05-11 01:30:05.488229+00:00, run_duration=5.069633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:29:00+00:00, data_interval_end=2024-05-11 01:30:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:30:05.498157505Z [2024-05-11T01:30:05.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:31:00+00:00 2024-05-11T01:30:05.517625847Z [2024-05-11T01:30:05.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:30:05.518132629Z [2024-05-11T01:30:05.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:29:00+00:00, run_id=scheduled__2024-05-11T01:29:00+00:00, run_start_date=2024-05-11 01:30:00.419581+00:00, run_end_date=2024-05-11 01:30:05.517522+00:00, run_duration=5.097941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:29:00+00:00, data_interval_end=2024-05-11 01:30:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:30:05.530424679Z [2024-05-11T01:30:05.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:31:00+00:00 2024-05-11T01:30:05.585363199Z [2024-05-11T01:30:05.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:29:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:05.585730186Z [2024-05-11T01:30:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:29:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:05.594240158Z [2024-05-11T01:30:05.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:29:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:03.156613+00:00, run_end_date=2024-05-11 01:30:04.709260+00:00, run_duration=1.552647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:00.511880+00:00, queued_by_job_id=2, pid=11891 2024-05-11T01:30:05.594981092Z [2024-05-11T01:30:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:29:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:03.028786+00:00, run_end_date=2024-05-11 01:30:04.915756+00:00, run_duration=1.88697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:00.511880+00:00, queued_by_job_id=2, pid=11889 2024-05-11T01:30:06.683086039Z [2024-05-11T01:30:06.682+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:30:06.683113194Z 2024-05-11T01:30:06.683421168Z [2024-05-11T01:30:06.683+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:30:06.684617606Z [2024-05-11T01:30:06.684+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:30:06.684624939Z 2024-05-11T01:30:06.687997948Z [2024-05-11T01:30:06.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:30:06.688283865Z [2024-05-11T01:30:06.688+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:30:06.771917849Z [2024-05-11T01:30:06.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:06.771938005Z [2024-05-11T01:30:06.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:06.775622320Z [2024-05-11T01:30:06.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81d6d3f0-6eae-4cdd-93d7-bc78f18afc01 2024-05-11T01:30:06.775999498Z [2024-05-11T01:30:06.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:05.973227+00:00, run_end_date=2024-05-11 01:30:06.313796+00:00, run_duration=0.340569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:04.254775+00:00, queued_by_job_id=2, pid=11924 2024-05-11T01:30:09.200732334Z [2024-05-11T01:30:09.200+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:30:09.200764049Z 2024-05-11T01:30:09.200780803Z [2024-05-11T01:30:09.200+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:30:09.201906070Z [2024-05-11T01:30:09.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:30:09.201918402Z 2024-05-11T01:30:09.204377270Z [2024-05-11T01:30:09.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:30:09.204496471Z [2024-05-11T01:30:09.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:30:09.262232769Z [2024-05-11T01:30:09.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status queued for try_number 1 2024-05-11T01:30:09.262365328Z [2024-05-11T01:30:09.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:09.269014183Z [2024-05-11T01:30:09.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 697aa064-2f6e-485b-9397-ddc56d5fb631 2024-05-11T01:30:09.269238920Z [2024-05-11T01:30:09.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=0, run_start_date=2024-05-11 01:30:08.403410+00:00, run_end_date=2024-05-11 01:30:08.731635+00:00, run_duration=0.328225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:06.685389+00:00, queued_by_job_id=2, pid=11935 2024-05-11T01:30:12.079221612Z [2024-05-11T01:30:12.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:30:12.079624741Z [2024-05-11T01:30:12.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:25:00+00:00, run_id=scheduled__2024-05-11T01:25:00+00:00, run_start_date=2024-05-11 01:30:00.412043+00:00, run_end_date=2024-05-11 01:30:12.079108+00:00, run_duration=11.667065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:25:00+00:00, data_interval_end=2024-05-11 01:30:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:30:12.085422137Z [2024-05-11T01:30:12.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:30:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:30:12.115604578Z [2024-05-11T01:30:12.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:25:00+00:00 exited with status success for try_number 1 2024-05-11T01:30:12.118436573Z [2024-05-11T01:30:12.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:25:00+00:00, map_index=-1, run_start_date=2024-05-11 01:30:10.769249+00:00, run_end_date=2024-05-11 01:30:11.217128+00:00, run_duration=0.447879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:30:09.202211+00:00, queued_by_job_id=2, pid=11943 2024-05-11T01:30:35.639375552Z [2024-05-11T01:30:35.638+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:31:00.833106101Z [2024-05-11T01:31:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:31:00.854317470Z [2024-05-11T01:31:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:31:00+00:00, run_after=2024-05-11T01:32:00+00:00 2024-05-11T01:31:00.868475262Z [2024-05-11T01:31:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:31:00+00:00, run_after=2024-05-11T01:32:00+00:00 2024-05-11T01:31:00.951852199Z [2024-05-11T01:31:00.951+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:31:00.951892844Z 2024-05-11T01:31:00.951899578Z 2024-05-11T01:31:00.951906031Z 2024-05-11T01:31:00.951991525Z [2024-05-11T01:31:00.951+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:31:00.952194526Z [2024-05-11T01:31:00.952+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:31:00.952477708Z [2024-05-11T01:31:00.952+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:31:00.953137128Z [2024-05-11T01:31:00.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:31:00.953146552Z 2024-05-11T01:31:00.953152416Z 2024-05-11T01:31:00.953158300Z 2024-05-11T01:31:00.957037349Z [2024-05-11T01:31:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:31:00.957273609Z [2024-05-11T01:31:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:31:00.957580263Z [2024-05-11T01:31:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:31:00.957797938Z [2024-05-11T01:31:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:31:00.958108381Z [2024-05-11T01:31:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:31:00.958256382Z [2024-05-11T01:31:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:31:01.270978067Z [2024-05-11T01:31:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:31:01.271010197Z [2024-05-11T01:31:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:31:01.271060572Z [2024-05-11T01:31:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:31:01.291279831Z [2024-05-11T01:31:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ab3b24f-24d8-4958-b74c-c0acb65a8d39 2024-05-11T01:31:01.291313668Z [2024-05-11T01:31:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72a1dc0e-7dfa-433a-badc-d36635e71822 2024-05-11T01:31:01.291435705Z [2024-05-11T01:31:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5553e8a5-77fc-4b86-b95d-39706251565f 2024-05-11T01:31:02.704384551Z [2024-05-11T01:31:02.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:31:02.705685404Z [2024-05-11T01:31:02.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:30:00+00:00, run_id=scheduled__2024-05-11T01:30:00+00:00, run_start_date=2024-05-11 01:31:00.883774+00:00, run_end_date=2024-05-11 01:31:02.704168+00:00, run_duration=1.820394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:30:00+00:00, data_interval_end=2024-05-11 01:31:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:31:02.715030369Z [2024-05-11T01:31:02.714+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:31:00+00:00, run_after=2024-05-11T01:32:00+00:00 2024-05-11T01:31:02.773725359Z [2024-05-11T01:31:02.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:31:02.780944687Z [2024-05-11T01:31:02.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:31:01.799480+00:00, run_end_date=2024-05-11 01:31:02.243178+00:00, run_duration=0.443698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:31:00.954002+00:00, queued_by_job_id=2, pid=11952 2024-05-11T01:31:04.967927384Z [2024-05-11T01:31:04.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:31:04.968529354Z [2024-05-11T01:31:04.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:30:00+00:00, run_id=scheduled__2024-05-11T01:30:00+00:00, run_start_date=2024-05-11 01:31:00.885316+00:00, run_end_date=2024-05-11 01:31:04.967608+00:00, run_duration=4.082292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:30:00+00:00, data_interval_end=2024-05-11 01:31:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:31:04.981516045Z [2024-05-11T01:31:04.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:31:00+00:00, run_after=2024-05-11T01:32:00+00:00 2024-05-11T01:31:05.035136090Z [2024-05-11T01:31:05.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:31:05.041739134Z [2024-05-11T01:31:05.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:31:02.770670+00:00, run_end_date=2024-05-11 01:31:04.160461+00:00, run_duration=1.389791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:31:00.954002+00:00, queued_by_job_id=2, pid=11970 2024-05-11T01:31:06.095247518Z [2024-05-11T01:31:06.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:31:06.095818813Z [2024-05-11T01:31:06.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:30:00+00:00, run_id=scheduled__2024-05-11T01:30:00+00:00, run_start_date=2024-05-11 01:31:00.886747+00:00, run_end_date=2024-05-11 01:31:06.095383+00:00, run_duration=5.208636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:30:00+00:00, data_interval_end=2024-05-11 01:31:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:31:06.104269946Z [2024-05-11T01:31:06.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:31:00+00:00, run_after=2024-05-11T01:32:00+00:00 2024-05-11T01:31:06.135521245Z [2024-05-11T01:31:06.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:31:06.141110451Z [2024-05-11T01:31:06.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:31:02.793374+00:00, run_end_date=2024-05-11 01:31:05.053114+00:00, run_duration=2.25974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:31:00.954002+00:00, queued_by_job_id=2, pid=11971 2024-05-11T01:32:00.668335876Z [2024-05-11T01:32:00.667+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:32:00.680918243Z [2024-05-11T01:32:00.680+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:32:00.695256098Z [2024-05-11T01:32:00.694+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:32:00+00:00, run_after=2024-05-11T01:33:00+00:00 2024-05-11T01:32:00.710741771Z [2024-05-11T01:32:00.710+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:32:00+00:00, run_after=2024-05-11T01:33:00+00:00 2024-05-11T01:32:00.838489400Z [2024-05-11T01:32:00.837+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:32:00.838517442Z 2024-05-11T01:32:00.838524229Z 2024-05-11T01:32:00.838529351Z 2024-05-11T01:32:00.838534572Z 2024-05-11T01:32:00.838914701Z [2024-05-11T01:32:00.838+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:32:00.839281251Z [2024-05-11T01:32:00.839+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:32:00.839492889Z [2024-05-11T01:32:00.839+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:32:00.839766623Z [2024-05-11T01:32:00.839+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:32:00.841007185Z [2024-05-11T01:32:00.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:32:00.841031032Z 2024-05-11T01:32:00.841038996Z 2024-05-11T01:32:00.841056752Z 2024-05-11T01:32:00.841066078Z 2024-05-11T01:32:00.847502903Z [2024-05-11T01:32:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:32:00.847958333Z [2024-05-11T01:32:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:32:00.848388555Z [2024-05-11T01:32:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:32:00.848628546Z [2024-05-11T01:32:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:32:00.849173934Z [2024-05-11T01:32:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:32:00.849469179Z [2024-05-11T01:32:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:32:00.850024970Z [2024-05-11T01:32:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:32:00.850209875Z [2024-05-11T01:32:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:32:01.209370003Z [2024-05-11T01:32:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:32:01.209502155Z [2024-05-11T01:32:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:31:00+00:00 exited with status queued for try_number 1 2024-05-11T01:32:01.209635268Z [2024-05-11T01:32:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:31:00+00:00 exited with status queued for try_number 1 2024-05-11T01:32:01.209748759Z [2024-05-11T01:32:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:31:00+00:00 exited with status queued for try_number 1 2024-05-11T01:32:01.219146571Z [2024-05-11T01:32:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3de35689-cae3-450b-b599-eb1830d09a48 2024-05-11T01:32:01.219291984Z [2024-05-11T01:32:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8a8a5e6-1c0a-414a-872f-788e437be86b 2024-05-11T01:32:01.219457132Z [2024-05-11T01:32:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2c82821-02a7-4711-b85a-897b1389a335 2024-05-11T01:32:01.219597374Z [2024-05-11T01:32:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07750a5-c84c-415e-8023-caafa057fde2 2024-05-11T01:32:03.140978233Z [2024-05-11T01:32:03.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:32:03.141300306Z [2024-05-11T01:32:03.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:30:00+00:00, run_id=scheduled__2024-05-11T01:30:00+00:00, run_start_date=2024-05-11 01:32:00.729165+00:00, run_end_date=2024-05-11 01:32:03.140931+00:00, run_duration=2.411766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:30:00+00:00, data_interval_end=2024-05-11 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:32:03.148890411Z [2024-05-11T01:32:03.148+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:32:00+00:00, run_after=2024-05-11T01:34:00+00:00 2024-05-11T01:32:03.157192857Z [2024-05-11T01:32:03.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:32:03.157769824Z [2024-05-11T01:32:03.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:31:00+00:00, run_id=scheduled__2024-05-11T01:31:00+00:00, run_start_date=2024-05-11 01:32:00.730747+00:00, run_end_date=2024-05-11 01:32:03.157407+00:00, run_duration=2.42666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:31:00+00:00, data_interval_end=2024-05-11 01:32:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:32:03.167892727Z [2024-05-11T01:32:03.167+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:32:00+00:00, run_after=2024-05-11T01:33:00+00:00 2024-05-11T01:32:03.210335230Z [2024-05-11T01:32:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:32:03.212353480Z [2024-05-11T01:32:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:31:00+00:00 exited with status success for try_number 1 2024-05-11T01:32:03.218836823Z [2024-05-11T01:32:03.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:32:01.867643+00:00, run_end_date=2024-05-11 01:32:02.267071+00:00, run_duration=0.399428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:32:00.842399+00:00, queued_by_job_id=2, pid=12005 2024-05-11T01:32:03.219044329Z [2024-05-11T01:32:03.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:31:00+00:00, map_index=-1, run_start_date=2024-05-11 01:32:01.841794+00:00, run_end_date=2024-05-11 01:32:02.300609+00:00, run_duration=0.458815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:32:00.842399+00:00, queued_by_job_id=2, pid=12004 2024-05-11T01:32:05.855968153Z [2024-05-11T01:32:05.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:32:05.856467123Z [2024-05-11T01:32:05.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:31:00+00:00, run_id=scheduled__2024-05-11T01:31:00+00:00, run_start_date=2024-05-11 01:32:00.732173+00:00, run_end_date=2024-05-11 01:32:05.855870+00:00, run_duration=5.123697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:31:00+00:00, data_interval_end=2024-05-11 01:32:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:32:05.868081849Z [2024-05-11T01:32:05.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:32:00+00:00, run_after=2024-05-11T01:33:00+00:00 2024-05-11T01:32:05.920555828Z [2024-05-11T01:32:05.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:31:00+00:00 exited with status success for try_number 1 2024-05-11T01:32:05.926436759Z [2024-05-11T01:32:05.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:31:00+00:00, map_index=-1, run_start_date=2024-05-11 01:32:02.838252+00:00, run_end_date=2024-05-11 01:32:04.816568+00:00, run_duration=1.978316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:32:00.842399+00:00, queued_by_job_id=2, pid=12028 2024-05-11T01:32:06.969810417Z [2024-05-11T01:32:06.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:32:06.969931713Z [2024-05-11T01:32:06.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:31:00+00:00, run_id=scheduled__2024-05-11T01:31:00+00:00, run_start_date=2024-05-11 01:32:00.733850+00:00, run_end_date=2024-05-11 01:32:06.969510+00:00, run_duration=6.23566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:31:00+00:00, data_interval_end=2024-05-11 01:32:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:32:06.978909050Z [2024-05-11T01:32:06.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:32:00+00:00, run_after=2024-05-11T01:33:00+00:00 2024-05-11T01:32:07.026892543Z [2024-05-11T01:32:07.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:31:00+00:00 exited with status success for try_number 1 2024-05-11T01:32:07.045286901Z [2024-05-11T01:32:07.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:31:00+00:00, map_index=-1, run_start_date=2024-05-11 01:32:03.032859+00:00, run_end_date=2024-05-11 01:32:06.809501+00:00, run_duration=3.776642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:32:00.842399+00:00, queued_by_job_id=2, pid=12029 2024-05-11T01:33:00.490856024Z [2024-05-11T01:33:00.490+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:33:00.510980188Z [2024-05-11T01:33:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:33:00+00:00, run_after=2024-05-11T01:34:00+00:00 2024-05-11T01:33:00.525714748Z [2024-05-11T01:33:00.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:33:00+00:00, run_after=2024-05-11T01:34:00+00:00 2024-05-11T01:33:00.618531814Z [2024-05-11T01:33:00.617+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:33:00.618611030Z 2024-05-11T01:33:00.618641518Z 2024-05-11T01:33:00.618648278Z 2024-05-11T01:33:00.619125786Z [2024-05-11T01:33:00.618+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:33:00.619277005Z [2024-05-11T01:33:00.619+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:33:00.619474261Z [2024-05-11T01:33:00.619+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:33:00.620516154Z [2024-05-11T01:33:00.620+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:33:00.620526200Z 2024-05-11T01:33:00.620546422Z 2024-05-11T01:33:00.620549755Z 2024-05-11T01:33:00.625948320Z [2024-05-11T01:33:00.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:33:00.626345537Z [2024-05-11T01:33:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:33:00.626865785Z [2024-05-11T01:33:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:33:00.627250328Z [2024-05-11T01:33:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:33:00.627617218Z [2024-05-11T01:33:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:33:00.627754782Z [2024-05-11T01:33:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:33:00.832119803Z [2024-05-11T01:33:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status queued for try_number 1 2024-05-11T01:33:00.832269799Z [2024-05-11T01:33:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status queued for try_number 1 2024-05-11T01:33:00.832462143Z [2024-05-11T01:33:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status queued for try_number 1 2024-05-11T01:33:00.845074451Z [2024-05-11T01:33:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4f8da22-48d0-4fd0-b7ab-968692b5a7b4 2024-05-11T01:33:00.845498407Z [2024-05-11T01:33:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 367e0b4e-ccde-4261-98a7-d134b60ee5cd 2024-05-11T01:33:00.845832230Z [2024-05-11T01:33:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3ca245a-cdc4-4c8f-b6e5-8b3de70ec2b5 2024-05-11T01:33:02.042353342Z [2024-05-11T01:33:02.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:33:02.042606552Z [2024-05-11T01:33:02.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:32:00+00:00, run_id=scheduled__2024-05-11T01:32:00+00:00, run_start_date=2024-05-11 01:33:00.541488+00:00, run_end_date=2024-05-11 01:33:02.042256+00:00, run_duration=1.500768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:32:00+00:00, data_interval_end=2024-05-11 01:33:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:33:02.055942841Z [2024-05-11T01:33:02.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:33:00+00:00, run_after=2024-05-11T01:34:00+00:00 2024-05-11T01:33:02.134026739Z [2024-05-11T01:33:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status success for try_number 1 2024-05-11T01:33:02.147873299Z [2024-05-11T01:33:02.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:32:00+00:00, map_index=-1, run_start_date=2024-05-11 01:33:01.507682+00:00, run_end_date=2024-05-11 01:33:01.846071+00:00, run_duration=0.338389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:33:00.622031+00:00, queued_by_job_id=2, pid=12061 2024-05-11T01:33:04.494574842Z [2024-05-11T01:33:04.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:33:04.494724040Z [2024-05-11T01:33:04.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:32:00+00:00, run_id=scheduled__2024-05-11T01:32:00+00:00, run_start_date=2024-05-11 01:33:00.544816+00:00, run_end_date=2024-05-11 01:33:04.494260+00:00, run_duration=3.949444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:32:00+00:00, data_interval_end=2024-05-11 01:33:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:33:04.505601737Z [2024-05-11T01:33:04.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:33:00+00:00, run_after=2024-05-11T01:34:00+00:00 2024-05-11T01:33:04.516687326Z [2024-05-11T01:33:04.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:33:04.516713577Z [2024-05-11T01:33:04.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:32:00+00:00, run_id=scheduled__2024-05-11T01:32:00+00:00, run_start_date=2024-05-11 01:33:00.542965+00:00, run_end_date=2024-05-11 01:33:04.514180+00:00, run_duration=3.971215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:32:00+00:00, data_interval_end=2024-05-11 01:33:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:33:04.529482646Z [2024-05-11T01:33:04.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:33:00+00:00, run_after=2024-05-11T01:34:00+00:00 2024-05-11T01:33:04.589102262Z [2024-05-11T01:33:04.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status success for try_number 1 2024-05-11T01:33:04.589128968Z [2024-05-11T01:33:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status success for try_number 1 2024-05-11T01:33:04.593971547Z [2024-05-11T01:33:04.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:32:00+00:00, map_index=-1, run_start_date=2024-05-11 01:33:02.416823+00:00, run_end_date=2024-05-11 01:33:03.795711+00:00, run_duration=1.378888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:33:00.622031+00:00, queued_by_job_id=2, pid=12079 2024-05-11T01:33:04.594094605Z [2024-05-11T01:33:04.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:32:00+00:00, map_index=-1, run_start_date=2024-05-11 01:33:02.523121+00:00, run_end_date=2024-05-11 01:33:04.210560+00:00, run_duration=1.687439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:33:00.622031+00:00, queued_by_job_id=2, pid=12080 2024-05-11T01:34:00.364936189Z [2024-05-11T01:34:00.364+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:34:00.371940824Z [2024-05-11T01:34:00.371+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:34:00.385574233Z [2024-05-11T01:34:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:34:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:34:00.398507674Z [2024-05-11T01:34:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:34:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:34:00.488965355Z [2024-05-11T01:34:00.488+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:34:00.488992712Z 2024-05-11T01:34:00.488998193Z 2024-05-11T01:34:00.489002392Z 2024-05-11T01:34:00.489006321Z 2024-05-11T01:34:00.489027997Z [2024-05-11T01:34:00.488+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:34:00.489083948Z [2024-05-11T01:34:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:34:00.489174856Z [2024-05-11T01:34:00.489+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:34:00.489248352Z [2024-05-11T01:34:00.489+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:34:00.489926793Z [2024-05-11T01:34:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:34:00.489954520Z 2024-05-11T01:34:00.489961391Z 2024-05-11T01:34:00.489967427Z 2024-05-11T01:34:00.489972982Z 2024-05-11T01:34:00.493586533Z [2024-05-11T01:34:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:34:00.493672426Z [2024-05-11T01:34:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:34:00.493820999Z [2024-05-11T01:34:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:34:00.493939977Z [2024-05-11T01:34:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:34:00.494110729Z [2024-05-11T01:34:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:34:00.494178772Z [2024-05-11T01:34:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:34:00.494329932Z [2024-05-11T01:34:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:34:00.494391342Z [2024-05-11T01:34:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:34:00.737486399Z [2024-05-11T01:34:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status queued for try_number 1 2024-05-11T01:34:00.737560486Z [2024-05-11T01:34:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:33:00+00:00 exited with status queued for try_number 1 2024-05-11T01:34:00.737696138Z [2024-05-11T01:34:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:33:00+00:00 exited with status queued for try_number 1 2024-05-11T01:34:00.737839570Z [2024-05-11T01:34:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:33:00+00:00 exited with status queued for try_number 1 2024-05-11T01:34:00.755359683Z [2024-05-11T01:34:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to d67e3202-dbb4-431a-a791-8089b586959b 2024-05-11T01:34:00.755410864Z [2024-05-11T01:34:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb16bc66-64dd-49c4-ac98-4bf82f53dd24 2024-05-11T01:34:00.755516424Z [2024-05-11T01:34:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03164278-903c-4c11-a52c-52c33be3cf0c 2024-05-11T01:34:00.755615939Z [2024-05-11T01:34:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to f827d439-4898-4b5b-9dab-05b6bdb73d2d 2024-05-11T01:34:01.928731954Z [2024-05-11T01:34:01.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:34:01.928926777Z [2024-05-11T01:34:01.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:32:00+00:00, run_id=scheduled__2024-05-11T01:32:00+00:00, run_start_date=2024-05-11 01:34:00.410596+00:00, run_end_date=2024-05-11 01:34:01.928623+00:00, run_duration=1.518027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:32:00+00:00, data_interval_end=2024-05-11 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:34:01.937686409Z [2024-05-11T01:34:01.937+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:34:00+00:00, run_after=2024-05-11T01:36:00+00:00 2024-05-11T01:34:01.991763023Z [2024-05-11T01:34:01.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:32:00+00:00 exited with status success for try_number 1 2024-05-11T01:34:01.997591998Z [2024-05-11T01:34:01.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:32:00+00:00, map_index=-1, run_start_date=2024-05-11 01:34:01.277788+00:00, run_end_date=2024-05-11 01:34:01.706757+00:00, run_duration=0.428969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:34:00.490723+00:00, queued_by_job_id=2, pid=12107 2024-05-11T01:34:02.889160832Z [2024-05-11T01:34:02.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:34:02.889584600Z [2024-05-11T01:34:02.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:33:00+00:00, run_id=scheduled__2024-05-11T01:33:00+00:00, run_start_date=2024-05-11 01:34:00.412068+00:00, run_end_date=2024-05-11 01:34:02.889073+00:00, run_duration=2.477005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:33:00+00:00, data_interval_end=2024-05-11 01:34:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:34:02.901854654Z [2024-05-11T01:34:02.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:34:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:34:02.948749852Z [2024-05-11T01:34:02.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:33:00+00:00 exited with status success for try_number 1 2024-05-11T01:34:02.955722065Z [2024-05-11T01:34:02.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:33:00+00:00, map_index=-1, run_start_date=2024-05-11 01:34:01.629202+00:00, run_end_date=2024-05-11 01:34:02.005577+00:00, run_duration=0.376375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:34:00.490723+00:00, queued_by_job_id=2, pid=12118 2024-05-11T01:34:05.105372989Z [2024-05-11T01:34:05.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:34:05.106493451Z [2024-05-11T01:34:05.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:33:00+00:00, run_id=scheduled__2024-05-11T01:33:00+00:00, run_start_date=2024-05-11 01:34:00.414302+00:00, run_end_date=2024-05-11 01:34:05.105253+00:00, run_duration=4.690951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:33:00+00:00, data_interval_end=2024-05-11 01:34:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:34:05.126232385Z [2024-05-11T01:34:05.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:34:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:34:05.818107895Z [2024-05-11T01:34:05.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:34:05.818141385Z [2024-05-11T01:34:05.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:33:00+00:00, run_id=scheduled__2024-05-11T01:33:00+00:00, run_start_date=2024-05-11 01:34:00.415387+00:00, run_end_date=2024-05-11 01:34:05.815126+00:00, run_duration=5.399739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:33:00+00:00, data_interval_end=2024-05-11 01:34:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:34:05.831872497Z [2024-05-11T01:34:05.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:34:00+00:00, run_after=2024-05-11T01:35:00+00:00 2024-05-11T01:34:05.872998642Z [2024-05-11T01:34:05.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:33:00+00:00 exited with status success for try_number 1 2024-05-11T01:34:05.873135871Z [2024-05-11T01:34:05.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:33:00+00:00 exited with status success for try_number 1 2024-05-11T01:34:05.879296995Z [2024-05-11T01:34:05.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:33:00+00:00, map_index=-1, run_start_date=2024-05-11 01:34:02.702341+00:00, run_end_date=2024-05-11 01:34:05.065720+00:00, run_duration=2.363379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:34:00.490723+00:00, queued_by_job_id=2, pid=12137 2024-05-11T01:34:05.879318415Z [2024-05-11T01:34:05.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:33:00+00:00, map_index=-1, run_start_date=2024-05-11 01:34:02.557464+00:00, run_end_date=2024-05-11 01:34:05.501679+00:00, run_duration=2.944215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:34:00.490723+00:00, queued_by_job_id=2, pid=12136 2024-05-11T01:35:00.272413257Z [2024-05-11T01:35:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:36:00+00:00 2024-05-11T01:35:00.296793572Z [2024-05-11T01:35:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:35:00.322041644Z [2024-05-11T01:35:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:36:00+00:00 2024-05-11T01:35:00.329965636Z [2024-05-11T01:35:00.325+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:35:00.439884450Z [2024-05-11T01:35:00.439+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:35:00.439920890Z 2024-05-11T01:35:00.439928565Z 2024-05-11T01:35:00.439934443Z 2024-05-11T01:35:00.439962225Z 2024-05-11T01:35:00.440264495Z [2024-05-11T01:35:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:35:00.440608983Z [2024-05-11T01:35:00.440+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:35:00.440936106Z [2024-05-11T01:35:00.440+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:35:00.441187473Z [2024-05-11T01:35:00.440+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:35:00.442530772Z [2024-05-11T01:35:00.442+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:35:00.442547953Z 2024-05-11T01:35:00.442556484Z 2024-05-11T01:35:00.442564297Z 2024-05-11T01:35:00.442572067Z 2024-05-11T01:35:00.447875246Z [2024-05-11T01:35:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:35:00.447912170Z [2024-05-11T01:35:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:35:00.448559471Z [2024-05-11T01:35:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:35:00.449074849Z [2024-05-11T01:35:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:35:00.449728269Z [2024-05-11T01:35:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:35:00.450206406Z [2024-05-11T01:35:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:35:00.450815572Z [2024-05-11T01:35:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:35:00.451249171Z [2024-05-11T01:35:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:35:00.707250222Z [2024-05-11T01:35:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:00.707394855Z [2024-05-11T01:35:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:00.707577702Z [2024-05-11T01:35:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:00.707688772Z [2024-05-11T01:35:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:00.716299792Z [2024-05-11T01:35:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb4033a6-9db0-400b-81a4-3302e2d15eef 2024-05-11T01:35:00.716566599Z [2024-05-11T01:35:00.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to 461836cf-b7ea-481d-8470-f5600e44fc08 2024-05-11T01:35:00.716768846Z [2024-05-11T01:35:00.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57d9abaf-d768-4bce-bf87-4ab03b5efb3f 2024-05-11T01:35:00.716959409Z [2024-05-11T01:35:00.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f6b643f-4f3d-4f5a-8d0d-872239d0decf 2024-05-11T01:35:02.780558098Z [2024-05-11T01:35:02.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:35:02.781423294Z [2024-05-11T01:35:02.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:34:00+00:00, run_id=scheduled__2024-05-11T01:34:00+00:00, run_start_date=2024-05-11 01:35:00.336070+00:00, run_end_date=2024-05-11 01:35:02.780489+00:00, run_duration=2.444419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:34:00+00:00, data_interval_end=2024-05-11 01:35:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:35:02.793599769Z [2024-05-11T01:35:02.793+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:36:00+00:00 2024-05-11T01:35:02.876223187Z [2024-05-11T01:35:02.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:02.883626396Z [2024-05-11T01:35:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:34:00+00:00, map_index=-1, run_start_date=2024-05-11 01:35:01.398754+00:00, run_end_date=2024-05-11 01:35:01.797817+00:00, run_duration=0.399063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:00.443981+00:00, queued_by_job_id=2, pid=12170 2024-05-11T01:35:03.353477604Z [2024-05-11T01:35:03.352+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:35:03.353509145Z 2024-05-11T01:35:03.354720393Z [2024-05-11T01:35:03.353+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:35:03.355452178Z [2024-05-11T01:35:03.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:35:03.355466022Z 2024-05-11T01:35:03.361934584Z [2024-05-11T01:35:03.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:35:03.362189765Z [2024-05-11T01:35:03.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:35:03.432785181Z [2024-05-11T01:35:03.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:03.433189314Z [2024-05-11T01:35:03.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:03.443553818Z [2024-05-11T01:35:03.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77ac1bc1-fee5-48bb-ae5b-6820005ed131 2024-05-11T01:35:03.443913434Z [2024-05-11T01:35:03.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:35:02.729984+00:00, run_end_date=2024-05-11 01:35:03.111156+00:00, run_duration=0.381172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:00.443981+00:00, queued_by_job_id=2, pid=12196 2024-05-11T01:35:05.717017942Z [2024-05-11T01:35:05.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:35:05.717550249Z [2024-05-11T01:35:05.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:34:00+00:00, run_id=scheduled__2024-05-11T01:34:00+00:00, run_start_date=2024-05-11 01:35:00.337052+00:00, run_end_date=2024-05-11 01:35:05.716894+00:00, run_duration=5.379842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:34:00+00:00, data_interval_end=2024-05-11 01:35:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:35:05.728997412Z [2024-05-11T01:35:05.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:36:00+00:00 2024-05-11T01:35:05.794013106Z [2024-05-11T01:35:05.793+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:35:05.794047869Z 2024-05-11T01:35:05.794456937Z [2024-05-11T01:35:05.794+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:35:05.795930888Z [2024-05-11T01:35:05.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:35:05.795948194Z 2024-05-11T01:35:05.799406265Z [2024-05-11T01:35:05.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:35:05.799556596Z [2024-05-11T01:35:05.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:35:05.856622729Z [2024-05-11T01:35:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:05.856700724Z [2024-05-11T01:35:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:05.856778366Z [2024-05-11T01:35:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:05.871762451Z [2024-05-11T01:35:05.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e3679a0-4d79-4fe4-846b-d46ec886f0c5 2024-05-11T01:35:05.872271386Z [2024-05-11T01:35:05.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:34:00+00:00, map_index=-1, run_start_date=2024-05-11 01:35:02.582470+00:00, run_end_date=2024-05-11 01:35:04.921323+00:00, run_duration=2.338853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:00.443981+00:00, queued_by_job_id=2, pid=12195 2024-05-11T01:35:05.872712165Z [2024-05-11T01:35:05.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:35:05.006537+00:00, run_end_date=2024-05-11 01:35:05.350672+00:00, run_duration=0.344135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:03.358005+00:00, queued_by_job_id=2, pid=12219 2024-05-11T01:35:06.772622117Z [2024-05-11T01:35:06.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:35:06.773587686Z [2024-05-11T01:35:06.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:34:00+00:00, run_id=scheduled__2024-05-11T01:34:00+00:00, run_start_date=2024-05-11 01:35:00.338379+00:00, run_end_date=2024-05-11 01:35:06.772607+00:00, run_duration=6.434228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:34:00+00:00, data_interval_end=2024-05-11 01:35:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:35:06.786920312Z [2024-05-11T01:35:06.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:36:00+00:00 2024-05-11T01:35:06.843757997Z [2024-05-11T01:35:06.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:06.855441725Z [2024-05-11T01:35:06.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:34:00+00:00, map_index=-1, run_start_date=2024-05-11 01:35:02.589437+00:00, run_end_date=2024-05-11 01:35:06.198296+00:00, run_duration=3.608859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:00.443981+00:00, queued_by_job_id=2, pid=12194 2024-05-11T01:35:07.955818954Z [2024-05-11T01:35:07.955+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:35:07.955838538Z 2024-05-11T01:35:07.956176723Z [2024-05-11T01:35:07.955+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:35:07.957223100Z [2024-05-11T01:35:07.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:35:07.957234675Z 2024-05-11T01:35:07.960581765Z [2024-05-11T01:35:07.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:35:07.961188410Z [2024-05-11T01:35:07.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:35:08.030098586Z [2024-05-11T01:35:08.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status queued for try_number 1 2024-05-11T01:35:08.037924487Z [2024-05-11T01:35:08.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7e66de0-9411-40b2-a8ce-1883043f6794 2024-05-11T01:35:08.144076102Z [2024-05-11T01:35:08.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:08.152530990Z [2024-05-11T01:35:08.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=0, run_start_date=2024-05-11 01:35:07.503822+00:00, run_end_date=2024-05-11 01:35:07.887080+00:00, run_duration=0.383258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:05.796655+00:00, queued_by_job_id=2, pid=12240 2024-05-11T01:35:10.332920946Z [2024-05-11T01:35:10.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:35:10.335195845Z [2024-05-11T01:35:10.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:30:00+00:00, run_id=scheduled__2024-05-11T01:30:00+00:00, run_start_date=2024-05-11 01:35:00.334907+00:00, run_end_date=2024-05-11 01:35:10.333107+00:00, run_duration=9.9982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:30:00+00:00, data_interval_end=2024-05-11 01:35:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:35:10.342955771Z [2024-05-11T01:35:10.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:35:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:35:10.386712439Z [2024-05-11T01:35:10.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:30:00+00:00 exited with status success for try_number 1 2024-05-11T01:35:10.392197401Z [2024-05-11T01:35:10.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:30:00+00:00, map_index=-1, run_start_date=2024-05-11 01:35:09.638257+00:00, run_end_date=2024-05-11 01:35:10.104140+00:00, run_duration=0.465883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:35:07.957967+00:00, queued_by_job_id=2, pid=12248 2024-05-11T01:35:35.702176424Z [2024-05-11T01:35:35.701+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:36:00.789159290Z [2024-05-11T01:36:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:36:00+00:00, run_after=2024-05-11T01:37:00+00:00 2024-05-11T01:36:00.800946095Z [2024-05-11T01:36:00.800+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:36:00.809891889Z [2024-05-11T01:36:00.809+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:36:00.828834620Z [2024-05-11T01:36:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:36:00+00:00, run_after=2024-05-11T01:37:00+00:00 2024-05-11T01:36:00.945730255Z [2024-05-11T01:36:00.945+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:36:00.945764072Z 2024-05-11T01:36:00.945769836Z 2024-05-11T01:36:00.945774590Z 2024-05-11T01:36:00.945779579Z 2024-05-11T01:36:00.945987222Z [2024-05-11T01:36:00.945+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:36:00.946198416Z [2024-05-11T01:36:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:36:00.946444139Z [2024-05-11T01:36:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:36:00.946687074Z [2024-05-11T01:36:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:36:00.947729651Z [2024-05-11T01:36:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:36:00.947740192Z 2024-05-11T01:36:00.947744170Z 2024-05-11T01:36:00.947747980Z 2024-05-11T01:36:00.947751116Z 2024-05-11T01:36:00.954715661Z [2024-05-11T01:36:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:36:00.955019767Z [2024-05-11T01:36:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:36:00.955429359Z [2024-05-11T01:36:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:36:00.955669484Z [2024-05-11T01:36:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:36:00.956060431Z [2024-05-11T01:36:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:36:00.956343234Z [2024-05-11T01:36:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:36:00.956822311Z [2024-05-11T01:36:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:36:00.957056150Z [2024-05-11T01:36:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:36:01.568954389Z [2024-05-11T01:36:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status queued for try_number 1 2024-05-11T01:36:01.569066848Z [2024-05-11T01:36:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:36:01.569237481Z [2024-05-11T01:36:01.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:36:01.569408826Z [2024-05-11T01:36:01.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:36:01.591338820Z [2024-05-11T01:36:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 399e6d50-cfd8-4dce-ae8f-5a6189d1f209 2024-05-11T01:36:01.592908488Z [2024-05-11T01:36:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa222b34-3a69-412c-91fa-2aa460b16c19 2024-05-11T01:36:01.593398744Z [2024-05-11T01:36:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15a566e1-bed9-46f2-bd02-83c0c9015afd 2024-05-11T01:36:01.593625618Z [2024-05-11T01:36:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9101584-eb97-4cf4-a799-bf98a5d8bbc1 2024-05-11T01:36:02.673979206Z [2024-05-11T01:36:02.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:36:02.674513247Z [2024-05-11T01:36:02.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:35:00+00:00, run_id=scheduled__2024-05-11T01:35:00+00:00, run_start_date=2024-05-11 01:36:00.856271+00:00, run_end_date=2024-05-11 01:36:02.673850+00:00, run_duration=1.817579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:35:00+00:00, data_interval_end=2024-05-11 01:36:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:36:02.685510517Z [2024-05-11T01:36:02.685+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:36:00+00:00, run_after=2024-05-11T01:37:00+00:00 2024-05-11T01:36:02.692902088Z [2024-05-11T01:36:02.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:36:02.693146967Z [2024-05-11T01:36:02.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:34:00+00:00, run_id=scheduled__2024-05-11T01:34:00+00:00, run_start_date=2024-05-11 01:36:00.854686+00:00, run_end_date=2024-05-11 01:36:02.692770+00:00, run_duration=1.838084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:34:00+00:00, data_interval_end=2024-05-11 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:36:02.701555945Z [2024-05-11T01:36:02.701+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:36:00+00:00, run_after=2024-05-11T01:38:00+00:00 2024-05-11T01:36:02.785167057Z [2024-05-11T01:36:02.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:34:00+00:00 exited with status success for try_number 1 2024-05-11T01:36:02.785358739Z [2024-05-11T01:36:02.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:36:02.796935401Z [2024-05-11T01:36:02.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=-1, run_start_date=2024-05-11 01:36:01.803091+00:00, run_end_date=2024-05-11 01:36:02.227337+00:00, run_duration=0.424246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:36:00.949348+00:00, queued_by_job_id=2, pid=12258 2024-05-11T01:36:02.797246188Z [2024-05-11T01:36:02.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:34:00+00:00, map_index=-1, run_start_date=2024-05-11 01:36:02.100662+00:00, run_end_date=2024-05-11 01:36:02.492179+00:00, run_duration=0.391517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:36:00.949348+00:00, queued_by_job_id=2, pid=12261 2024-05-11T01:36:04.973160224Z [2024-05-11T01:36:04.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:36:04.973433563Z [2024-05-11T01:36:04.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:35:00+00:00, run_id=scheduled__2024-05-11T01:35:00+00:00, run_start_date=2024-05-11 01:36:00.863862+00:00, run_end_date=2024-05-11 01:36:04.972992+00:00, run_duration=4.10913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:35:00+00:00, data_interval_end=2024-05-11 01:36:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:36:04.984275334Z [2024-05-11T01:36:04.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:36:00+00:00, run_after=2024-05-11T01:37:00+00:00 2024-05-11T01:36:05.028337382Z [2024-05-11T01:36:05.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:36:05.038355912Z [2024-05-11T01:36:05.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=-1, run_start_date=2024-05-11 01:36:03.175204+00:00, run_end_date=2024-05-11 01:36:04.643914+00:00, run_duration=1.46871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:36:00.949348+00:00, queued_by_job_id=2, pid=12283 2024-05-11T01:36:06.106027584Z [2024-05-11T01:36:06.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:36:06.107201027Z [2024-05-11T01:36:06.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:35:00+00:00, run_id=scheduled__2024-05-11T01:35:00+00:00, run_start_date=2024-05-11 01:36:00.865512+00:00, run_end_date=2024-05-11 01:36:06.105707+00:00, run_duration=5.240195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:35:00+00:00, data_interval_end=2024-05-11 01:36:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:36:06.125340748Z [2024-05-11T01:36:06.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:36:00+00:00, run_after=2024-05-11T01:37:00+00:00 2024-05-11T01:36:06.164870600Z [2024-05-11T01:36:06.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:36:06.171073888Z [2024-05-11T01:36:06.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=-1, run_start_date=2024-05-11 01:36:03.164883+00:00, run_end_date=2024-05-11 01:36:05.233699+00:00, run_duration=2.068816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:36:00.949348+00:00, queued_by_job_id=2, pid=12282 2024-05-11T01:37:00.855666690Z [2024-05-11T01:37:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:37:00+00:00, run_after=2024-05-11T01:38:00+00:00 2024-05-11T01:37:00.861903595Z [2024-05-11T01:37:00.861+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:37:00.872352152Z [2024-05-11T01:37:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:37:00+00:00, run_after=2024-05-11T01:38:00+00:00 2024-05-11T01:37:00.965517189Z [2024-05-11T01:37:00.964+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:37:00.965594928Z 2024-05-11T01:37:00.965606251Z 2024-05-11T01:37:00.965614902Z 2024-05-11T01:37:00.965623276Z [2024-05-11T01:37:00.965+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:37:00.965665847Z [2024-05-11T01:37:00.965+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:37:00.965729987Z [2024-05-11T01:37:00.965+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:37:00.966756696Z [2024-05-11T01:37:00.966+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:37:00.966777345Z 2024-05-11T01:37:00.966782892Z 2024-05-11T01:37:00.966788188Z 2024-05-11T01:37:00.971668141Z [2024-05-11T01:37:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:37:00.971710481Z [2024-05-11T01:37:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:37:00.971981756Z [2024-05-11T01:37:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:37:00.972063856Z [2024-05-11T01:37:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:37:00.972306116Z [2024-05-11T01:37:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:37:00.972424319Z [2024-05-11T01:37:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:37:01.329142963Z [2024-05-11T01:37:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status queued for try_number 1 2024-05-11T01:37:01.329331391Z [2024-05-11T01:37:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status queued for try_number 1 2024-05-11T01:37:01.329480740Z [2024-05-11T01:37:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status queued for try_number 1 2024-05-11T01:37:01.348348348Z [2024-05-11T01:37:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 726fdcd0-7a6d-4492-b138-612c3d4cfd27 2024-05-11T01:37:01.348726715Z [2024-05-11T01:37:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to ece501d6-72c0-43e8-a921-20256c6fb39c 2024-05-11T01:37:01.349036267Z [2024-05-11T01:37:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef0b37c1-e06e-4c77-8879-37f270925587 2024-05-11T01:37:02.498015770Z [2024-05-11T01:37:02.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:37:02.498513844Z [2024-05-11T01:37:02.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:36:00+00:00, run_id=scheduled__2024-05-11T01:36:00+00:00, run_start_date=2024-05-11 01:37:00.882713+00:00, run_end_date=2024-05-11 01:37:02.498116+00:00, run_duration=1.615403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:36:00+00:00, data_interval_end=2024-05-11 01:37:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:37:02.508960144Z [2024-05-11T01:37:02.508+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:37:00+00:00, run_after=2024-05-11T01:38:00+00:00 2024-05-11T01:37:02.557780889Z [2024-05-11T01:37:02.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status success for try_number 1 2024-05-11T01:37:02.565202622Z [2024-05-11T01:37:02.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:36:00+00:00, map_index=-1, run_start_date=2024-05-11 01:37:01.866084+00:00, run_end_date=2024-05-11 01:37:02.228146+00:00, run_duration=0.362062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:37:00.967774+00:00, queued_by_job_id=2, pid=12315 2024-05-11T01:37:05.424820842Z [2024-05-11T01:37:05.424+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:37:05.425088280Z [2024-05-11T01:37:05.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:36:00+00:00, run_id=scheduled__2024-05-11T01:36:00+00:00, run_start_date=2024-05-11 01:37:00.885037+00:00, run_end_date=2024-05-11 01:37:05.424689+00:00, run_duration=4.539652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:36:00+00:00, data_interval_end=2024-05-11 01:37:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:37:05.437369152Z [2024-05-11T01:37:05.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:37:00+00:00, run_after=2024-05-11T01:38:00+00:00 2024-05-11T01:37:05.445287885Z [2024-05-11T01:37:05.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:37:05.445392758Z [2024-05-11T01:37:05.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:36:00+00:00, run_id=scheduled__2024-05-11T01:36:00+00:00, run_start_date=2024-05-11 01:37:00.887679+00:00, run_end_date=2024-05-11 01:37:05.445146+00:00, run_duration=4.557467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:36:00+00:00, data_interval_end=2024-05-11 01:37:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:37:05.454682433Z [2024-05-11T01:37:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:37:00+00:00, run_after=2024-05-11T01:38:00+00:00 2024-05-11T01:37:05.503125552Z [2024-05-11T01:37:05.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status success for try_number 1 2024-05-11T01:37:05.503272656Z [2024-05-11T01:37:05.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status success for try_number 1 2024-05-11T01:37:05.516852084Z [2024-05-11T01:37:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:36:00+00:00, map_index=-1, run_start_date=2024-05-11 01:37:02.896100+00:00, run_end_date=2024-05-11 01:37:04.507995+00:00, run_duration=1.611895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:37:00.967774+00:00, queued_by_job_id=2, pid=12334 2024-05-11T01:37:05.517144233Z [2024-05-11T01:37:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:36:00+00:00, map_index=-1, run_start_date=2024-05-11 01:37:02.863481+00:00, run_end_date=2024-05-11 01:37:04.828339+00:00, run_duration=1.964858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:37:00.967774+00:00, queued_by_job_id=2, pid=12333 2024-05-11T01:38:00.877432899Z [2024-05-11T01:38:00.876+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:38:00.896110848Z [2024-05-11T01:38:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:38:00+00:00, run_after=2024-05-11T01:39:00+00:00 2024-05-11T01:38:00.914714373Z [2024-05-11T01:38:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:38:00+00:00, run_after=2024-05-11T01:39:00+00:00 2024-05-11T01:38:00.923823842Z [2024-05-11T01:38:00.923+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:38:01.000562658Z [2024-05-11T01:38:00.999+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:38:01.000620037Z 2024-05-11T01:38:01.000635105Z 2024-05-11T01:38:01.000648253Z 2024-05-11T01:38:01.000661670Z 2024-05-11T01:38:01.000789856Z [2024-05-11T01:38:01.000+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:38:01.000818219Z [2024-05-11T01:38:01.000+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:38:01.000823732Z [2024-05-11T01:38:01.000+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:38:01.000828259Z [2024-05-11T01:38:01.000+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:38:01.001507397Z [2024-05-11T01:38:01.001+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:38:01.001518722Z 2024-05-11T01:38:01.001534098Z 2024-05-11T01:38:01.001539110Z 2024-05-11T01:38:01.001544261Z 2024-05-11T01:38:01.009646625Z [2024-05-11T01:38:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:38:01.009701195Z [2024-05-11T01:38:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:38:01.009890128Z [2024-05-11T01:38:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:38:01.009993143Z [2024-05-11T01:38:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:38:01.010249772Z [2024-05-11T01:38:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:38:01.010276193Z [2024-05-11T01:38:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:38:01.010829872Z [2024-05-11T01:38:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:38:01.010842049Z [2024-05-11T01:38:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:38:01.395651595Z [2024-05-11T01:38:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status queued for try_number 1 2024-05-11T01:38:01.395826393Z [2024-05-11T01:38:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:37:00+00:00 exited with status queued for try_number 1 2024-05-11T01:38:01.395935666Z [2024-05-11T01:38:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:37:00+00:00 exited with status queued for try_number 1 2024-05-11T01:38:01.396032930Z [2024-05-11T01:38:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:37:00+00:00 exited with status queued for try_number 1 2024-05-11T01:38:01.412449982Z [2024-05-11T01:38:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to af7e9dfb-190e-4d3e-8a34-a3a0b40f53a6 2024-05-11T01:38:01.412839946Z [2024-05-11T01:38:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to b74adfb4-f261-4522-b98f-1c725e080f83 2024-05-11T01:38:01.412958708Z [2024-05-11T01:38:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to cab38248-06fa-442d-8040-03f3cebac247 2024-05-11T01:38:01.413070985Z [2024-05-11T01:38:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to e860f01c-0215-42fb-9dae-496bbb9244de 2024-05-11T01:38:02.681844789Z [2024-05-11T01:38:02.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:38:02.682529303Z [2024-05-11T01:38:02.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:36:00+00:00, run_id=scheduled__2024-05-11T01:36:00+00:00, run_start_date=2024-05-11 01:38:00.933178+00:00, run_end_date=2024-05-11 01:38:02.681997+00:00, run_duration=1.748819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:36:00+00:00, data_interval_end=2024-05-11 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:38:02.696345528Z [2024-05-11T01:38:02.695+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:38:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:38:02.707231408Z [2024-05-11T01:38:02.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:38:02.707729778Z [2024-05-11T01:38:02.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:37:00+00:00, run_id=scheduled__2024-05-11T01:37:00+00:00, run_start_date=2024-05-11 01:38:00.934318+00:00, run_end_date=2024-05-11 01:38:02.707155+00:00, run_duration=1.772837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:37:00+00:00, data_interval_end=2024-05-11 01:38:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:38:02.726961993Z [2024-05-11T01:38:02.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:38:00+00:00, run_after=2024-05-11T01:39:00+00:00 2024-05-11T01:38:02.803665579Z [2024-05-11T01:38:02.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:36:00+00:00 exited with status success for try_number 1 2024-05-11T01:38:02.804035031Z [2024-05-11T01:38:02.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:37:00+00:00 exited with status success for try_number 1 2024-05-11T01:38:02.816550187Z [2024-05-11T01:38:02.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:36:00+00:00, map_index=-1, run_start_date=2024-05-11 01:38:02.058733+00:00, run_end_date=2024-05-11 01:38:02.410053+00:00, run_duration=0.35132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:38:01.006121+00:00, queued_by_job_id=2, pid=12368 2024-05-11T01:38:02.816958741Z [2024-05-11T01:38:02.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:37:00+00:00, map_index=-1, run_start_date=2024-05-11 01:38:01.877571+00:00, run_end_date=2024-05-11 01:38:02.240593+00:00, run_duration=0.363022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:38:01.006121+00:00, queued_by_job_id=2, pid=12367 2024-05-11T01:38:05.998944365Z [2024-05-11T01:38:05.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:38:05.999259776Z [2024-05-11T01:38:05.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:37:00+00:00, run_id=scheduled__2024-05-11T01:37:00+00:00, run_start_date=2024-05-11 01:38:00.935335+00:00, run_end_date=2024-05-11 01:38:05.998762+00:00, run_duration=5.063427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:37:00+00:00, data_interval_end=2024-05-11 01:38:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:38:06.010006140Z [2024-05-11T01:38:06.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:38:00+00:00, run_after=2024-05-11T01:39:00+00:00 2024-05-11T01:38:06.016704516Z [2024-05-11T01:38:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:38:06.017059488Z [2024-05-11T01:38:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:37:00+00:00, run_id=scheduled__2024-05-11T01:37:00+00:00, run_start_date=2024-05-11 01:38:00.936322+00:00, run_end_date=2024-05-11 01:38:06.016590+00:00, run_duration=5.080268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:37:00+00:00, data_interval_end=2024-05-11 01:38:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:38:06.025339518Z [2024-05-11T01:38:06.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:38:00+00:00, run_after=2024-05-11T01:39:00+00:00 2024-05-11T01:38:06.058627551Z [2024-05-11T01:38:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:37:00+00:00 exited with status success for try_number 1 2024-05-11T01:38:06.058904317Z [2024-05-11T01:38:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:37:00+00:00 exited with status success for try_number 1 2024-05-11T01:38:06.067096288Z [2024-05-11T01:38:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:37:00+00:00, map_index=-1, run_start_date=2024-05-11 01:38:03.122190+00:00, run_end_date=2024-05-11 01:38:04.949717+00:00, run_duration=1.827527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:38:01.006121+00:00, queued_by_job_id=2, pid=12392 2024-05-11T01:38:06.067435653Z [2024-05-11T01:38:06.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:37:00+00:00, map_index=-1, run_start_date=2024-05-11 01:38:02.958758+00:00, run_end_date=2024-05-11 01:38:05.258625+00:00, run_duration=2.299867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:38:01.006121+00:00, queued_by_job_id=2, pid=12391 2024-05-11T01:39:00.322080732Z [2024-05-11T01:39:00.304+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:39:00.322117191Z [2024-05-11T01:39:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:39:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:39:00.335396483Z [2024-05-11T01:39:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:39:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:39:00.398719537Z [2024-05-11T01:39:00.398+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:39:00.398746499Z 2024-05-11T01:39:00.398750263Z 2024-05-11T01:39:00.398753694Z 2024-05-11T01:39:00.398935607Z [2024-05-11T01:39:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:39:00.399139389Z [2024-05-11T01:39:00.398+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:39:00.399317778Z [2024-05-11T01:39:00.399+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:39:00.399954151Z [2024-05-11T01:39:00.399+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:39:00.399965925Z 2024-05-11T01:39:00.399969456Z 2024-05-11T01:39:00.399972738Z 2024-05-11T01:39:00.403034353Z [2024-05-11T01:39:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:39:00.403278150Z [2024-05-11T01:39:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:39:00.403605679Z [2024-05-11T01:39:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:39:00.403802915Z [2024-05-11T01:39:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:39:00.404111066Z [2024-05-11T01:39:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:39:00.404365983Z [2024-05-11T01:39:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:39:00.707914067Z [2024-05-11T01:39:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status queued for try_number 1 2024-05-11T01:39:00.707944005Z [2024-05-11T01:39:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status queued for try_number 1 2024-05-11T01:39:00.707947717Z [2024-05-11T01:39:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status queued for try_number 1 2024-05-11T01:39:00.723121362Z [2024-05-11T01:39:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93de6777-4fe7-4f82-a860-7bce6c9c727a 2024-05-11T01:39:00.723151062Z [2024-05-11T01:39:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ad07706-2a52-448b-846c-9e3505362cfc 2024-05-11T01:39:00.723299501Z [2024-05-11T01:39:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93334373-b895-4878-aa78-e2a261ff898f 2024-05-11T01:39:01.917009507Z [2024-05-11T01:39:01.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:39:01.917406538Z [2024-05-11T01:39:01.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:38:00+00:00, run_id=scheduled__2024-05-11T01:38:00+00:00, run_start_date=2024-05-11 01:39:00.345363+00:00, run_end_date=2024-05-11 01:39:01.917079+00:00, run_duration=1.571716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:38:00+00:00, data_interval_end=2024-05-11 01:39:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:39:01.928145552Z [2024-05-11T01:39:01.927+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:39:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:39:03.117984411Z [2024-05-11T01:39:03.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status success for try_number 1 2024-05-11T01:39:03.123344447Z [2024-05-11T01:39:03.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:38:00+00:00, map_index=-1, run_start_date=2024-05-11 01:39:01.486622+00:00, run_end_date=2024-05-11 01:39:01.886544+00:00, run_duration=0.399922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:39:00.400693+00:00, queued_by_job_id=2, pid=12427 2024-05-11T01:39:04.180028192Z [2024-05-11T01:39:04.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:39:04.180536952Z [2024-05-11T01:39:04.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:38:00+00:00, run_id=scheduled__2024-05-11T01:38:00+00:00, run_start_date=2024-05-11 01:39:00.348560+00:00, run_end_date=2024-05-11 01:39:04.179802+00:00, run_duration=3.831242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:38:00+00:00, data_interval_end=2024-05-11 01:39:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:39:04.207121172Z [2024-05-11T01:39:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:39:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:39:04.221457072Z [2024-05-11T01:39:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:39:04.222138923Z [2024-05-11T01:39:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:38:00+00:00, run_id=scheduled__2024-05-11T01:38:00+00:00, run_start_date=2024-05-11 01:39:00.349639+00:00, run_end_date=2024-05-11 01:39:04.221276+00:00, run_duration=3.871637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:38:00+00:00, data_interval_end=2024-05-11 01:39:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:39:04.235486212Z [2024-05-11T01:39:04.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:39:00+00:00, run_after=2024-05-11T01:40:00+00:00 2024-05-11T01:39:04.290890524Z [2024-05-11T01:39:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status success for try_number 1 2024-05-11T01:39:04.291125374Z [2024-05-11T01:39:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status success for try_number 1 2024-05-11T01:39:04.301569184Z [2024-05-11T01:39:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:38:00+00:00, map_index=-1, run_start_date=2024-05-11 01:39:02.176539+00:00, run_end_date=2024-05-11 01:39:03.442545+00:00, run_duration=1.266006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:39:00.400693+00:00, queued_by_job_id=2, pid=12443 2024-05-11T01:39:04.302261697Z [2024-05-11T01:39:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:38:00+00:00, map_index=-1, run_start_date=2024-05-11 01:39:02.282603+00:00, run_end_date=2024-05-11 01:39:03.869233+00:00, run_duration=1.58663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:39:00.400693+00:00, queued_by_job_id=2, pid=12444 2024-05-11T01:40:00.586105406Z [2024-05-11T01:40:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:41:00+00:00 2024-05-11T01:40:00.601780439Z [2024-05-11T01:40:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:40:00.609468435Z [2024-05-11T01:40:00.609+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:40:00.620598485Z [2024-05-11T01:40:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:41:00+00:00 2024-05-11T01:40:00.626466172Z [2024-05-11T01:40:00.626+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:40:00.727318775Z [2024-05-11T01:40:00.726+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:40:00.727372364Z 2024-05-11T01:40:00.727382382Z 2024-05-11T01:40:00.727391701Z 2024-05-11T01:40:00.727400211Z 2024-05-11T01:40:00.727408546Z 2024-05-11T01:40:00.727555579Z [2024-05-11T01:40:00.727+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:40:00.727681784Z [2024-05-11T01:40:00.727+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:40:00.727799155Z [2024-05-11T01:40:00.727+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:40:00.728024305Z [2024-05-11T01:40:00.727+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:40:00.728155272Z [2024-05-11T01:40:00.727+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:40:00.728928655Z [2024-05-11T01:40:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:40:00.728948198Z 2024-05-11T01:40:00.728957138Z 2024-05-11T01:40:00.728966478Z 2024-05-11T01:40:00.728975123Z 2024-05-11T01:40:00.728984859Z 2024-05-11T01:40:00.733593202Z [2024-05-11T01:40:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:40:00.733629829Z [2024-05-11T01:40:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:40:00.733710141Z [2024-05-11T01:40:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:40:00.733912630Z [2024-05-11T01:40:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:40:00.734287986Z [2024-05-11T01:40:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:40:00.734317128Z [2024-05-11T01:40:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:40:00.734473376Z [2024-05-11T01:40:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:40:00.734565372Z [2024-05-11T01:40:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:40:00.734873980Z [2024-05-11T01:40:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:40:00.734992635Z [2024-05-11T01:40:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:40:01.350991954Z [2024-05-11T01:40:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:01.351305057Z [2024-05-11T01:40:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:01.351491422Z [2024-05-11T01:40:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:39:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:01.351664483Z [2024-05-11T01:40:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:39:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:01.351831705Z [2024-05-11T01:40:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:39:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:01.371491488Z [2024-05-11T01:40:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fee0065-d1db-467b-b4eb-464f73d9351f 2024-05-11T01:40:01.371819556Z [2024-05-11T01:40:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc3c30b7-3105-4c60-ae2f-a067ef249f3d 2024-05-11T01:40:01.372082773Z [2024-05-11T01:40:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b43ff48-7b34-49fb-8091-86937d656ceb 2024-05-11T01:40:01.372306217Z [2024-05-11T01:40:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7992516d-5cbf-4032-9079-0a2c2b6bd332 2024-05-11T01:40:01.372521818Z [2024-05-11T01:40:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to b64f6bf0-c701-4be6-a79b-2552d1e2684b 2024-05-11T01:40:02.770176358Z [2024-05-11T01:40:02.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:40:02.770497895Z [2024-05-11T01:40:02.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:38:00+00:00, run_id=scheduled__2024-05-11T01:38:00+00:00, run_start_date=2024-05-11 01:40:00.636507+00:00, run_end_date=2024-05-11 01:40:02.770117+00:00, run_duration=2.13361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:38:00+00:00, data_interval_end=2024-05-11 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:40:02.780375969Z [2024-05-11T01:40:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:42:00+00:00 2024-05-11T01:40:02.801517831Z [2024-05-11T01:40:02.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:40:02.802207413Z [2024-05-11T01:40:02.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:39:00+00:00, run_id=scheduled__2024-05-11T01:39:00+00:00, run_start_date=2024-05-11 01:40:00.637498+00:00, run_end_date=2024-05-11 01:40:02.801881+00:00, run_duration=2.164383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:39:00+00:00, data_interval_end=2024-05-11 01:40:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:40:02.815302370Z [2024-05-11T01:40:02.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:41:00+00:00 2024-05-11T01:40:02.880737911Z [2024-05-11T01:40:02.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:38:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:02.880759647Z [2024-05-11T01:40:02.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:39:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:02.887712297Z [2024-05-11T01:40:02.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:38:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:01.790666+00:00, run_end_date=2024-05-11 01:40:02.237780+00:00, run_duration=0.447114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:00.730181+00:00, queued_by_job_id=2, pid=12478 2024-05-11T01:40:02.887846441Z [2024-05-11T01:40:02.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:39:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:01.790300+00:00, run_end_date=2024-05-11 01:40:02.206606+00:00, run_duration=0.416306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:00.730181+00:00, queued_by_job_id=2, pid=12479 2024-05-11T01:40:03.975971916Z [2024-05-11T01:40:03.975+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:40:03.976230299Z 2024-05-11T01:40:03.976250306Z [2024-05-11T01:40:03.975+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:40:03.976497324Z [2024-05-11T01:40:03.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:40:03.976533795Z 2024-05-11T01:40:03.978986342Z [2024-05-11T01:40:03.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:40:03.979221150Z [2024-05-11T01:40:03.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:40:04.048787345Z [2024-05-11T01:40:04.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:04.048818028Z [2024-05-11T01:40:04.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:04.070159366Z [2024-05-11T01:40:04.068+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4da4de11-4f6b-47d2-9e9c-a69cc114fce2 2024-05-11T01:40:04.070182246Z [2024-05-11T01:40:04.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:03.147880+00:00, run_end_date=2024-05-11 01:40:03.627789+00:00, run_duration=0.479909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:00.730181+00:00, queued_by_job_id=2, pid=12509 2024-05-11T01:40:05.228080290Z [2024-05-11T01:40:05.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:40:05.235518570Z [2024-05-11T01:40:05.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:39:00+00:00, run_id=scheduled__2024-05-11T01:39:00+00:00, run_start_date=2024-05-11 01:40:00.638445+00:00, run_end_date=2024-05-11 01:40:05.227878+00:00, run_duration=4.589433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:39:00+00:00, data_interval_end=2024-05-11 01:40:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:40:05.238091382Z [2024-05-11T01:40:05.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:41:00+00:00 2024-05-11T01:40:05.243555973Z [2024-05-11T01:40:05.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:40:05.243573670Z [2024-05-11T01:40:05.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:39:00+00:00, run_id=scheduled__2024-05-11T01:39:00+00:00, run_start_date=2024-05-11 01:40:00.639405+00:00, run_end_date=2024-05-11 01:40:05.242712+00:00, run_duration=4.603307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:39:00+00:00, data_interval_end=2024-05-11 01:40:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:40:05.251604352Z [2024-05-11T01:40:05.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:41:00+00:00 2024-05-11T01:40:05.291067315Z [2024-05-11T01:40:05.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:39:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:05.291103390Z [2024-05-11T01:40:05.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:39:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:05.297662043Z [2024-05-11T01:40:05.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:39:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:03.154434+00:00, run_end_date=2024-05-11 01:40:04.766018+00:00, run_duration=1.611584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:00.730181+00:00, queued_by_job_id=2, pid=12510 2024-05-11T01:40:05.297813340Z [2024-05-11T01:40:05.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:39:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:03.134395+00:00, run_end_date=2024-05-11 01:40:05.082245+00:00, run_duration=1.94785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:00.730181+00:00, queued_by_job_id=2, pid=12508 2024-05-11T01:40:06.835528024Z [2024-05-11T01:40:06.835+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:40:06.835555285Z 2024-05-11T01:40:06.835892982Z [2024-05-11T01:40:06.835+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:40:06.836541503Z [2024-05-11T01:40:06.836+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:40:06.836554093Z 2024-05-11T01:40:06.875490612Z [2024-05-11T01:40:06.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:40:06.875509470Z [2024-05-11T01:40:06.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:40:06.928272113Z [2024-05-11T01:40:06.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:06.928322891Z [2024-05-11T01:40:06.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:06.935607592Z [2024-05-11T01:40:06.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02cf94f3-6179-46b9-a932-ed752a91a3cf 2024-05-11T01:40:06.935681841Z [2024-05-11T01:40:06.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:05.583092+00:00, run_end_date=2024-05-11 01:40:05.915568+00:00, run_duration=0.332476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:03.976872+00:00, queued_by_job_id=2, pid=12543 2024-05-11T01:40:09.208965090Z [2024-05-11T01:40:09.208+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:40:09.208994688Z 2024-05-11T01:40:09.209070430Z [2024-05-11T01:40:09.208+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:40:09.209768502Z [2024-05-11T01:40:09.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:40:09.209783369Z 2024-05-11T01:40:09.212461404Z [2024-05-11T01:40:09.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:40:09.212536565Z [2024-05-11T01:40:09.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:40:09.267417308Z [2024-05-11T01:40:09.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status queued for try_number 1 2024-05-11T01:40:09.267448468Z [2024-05-11T01:40:09.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:09.272757787Z [2024-05-11T01:40:09.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a2a7c11-e782-4351-aeba-a564dc86caf3 2024-05-11T01:40:09.272864529Z [2024-05-11T01:40:09.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=0, run_start_date=2024-05-11 01:40:08.613185+00:00, run_end_date=2024-05-11 01:40:08.995862+00:00, run_duration=0.382677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:06.836999+00:00, queued_by_job_id=2, pid=12554 2024-05-11T01:40:11.548588434Z [2024-05-11T01:40:11.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:40:11.549139591Z [2024-05-11T01:40:11.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:35:00+00:00, run_id=scheduled__2024-05-11T01:35:00+00:00, run_start_date=2024-05-11 01:40:00.635281+00:00, run_end_date=2024-05-11 01:40:11.548439+00:00, run_duration=10.913158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:35:00+00:00, data_interval_end=2024-05-11 01:40:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:40:11.556146672Z [2024-05-11T01:40:11.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:40:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:40:11.602782310Z [2024-05-11T01:40:11.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:35:00+00:00 exited with status success for try_number 1 2024-05-11T01:40:11.609954326Z [2024-05-11T01:40:11.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:35:00+00:00, map_index=-1, run_start_date=2024-05-11 01:40:10.780934+00:00, run_end_date=2024-05-11 01:40:11.178764+00:00, run_duration=0.39783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:40:09.210267+00:00, queued_by_job_id=2, pid=12562 2024-05-11T01:40:35.796019592Z [2024-05-11T01:40:35.795+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:41:00.877770987Z [2024-05-11T01:41:00.877+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:41:00+00:00, run_after=2024-05-11T01:42:00+00:00 2024-05-11T01:41:00.893269964Z [2024-05-11T01:41:00.892+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:41:00.914159599Z [2024-05-11T01:41:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:41:00+00:00, run_after=2024-05-11T01:42:00+00:00 2024-05-11T01:41:01.000471141Z [2024-05-11T01:41:01.999+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:41:01.000510397Z 2024-05-11T01:41:01.000518825Z 2024-05-11T01:41:01.000526400Z 2024-05-11T01:41:01.000768155Z [2024-05-11T01:41:01.000+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:41:01.001025814Z [2024-05-11T01:41:01.000+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:41:01.001267455Z [2024-05-11T01:41:01.001+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:41:01.002367327Z [2024-05-11T01:41:01.002+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:41:01.002397402Z 2024-05-11T01:41:01.002407163Z 2024-05-11T01:41:01.002415920Z 2024-05-11T01:41:01.008230210Z [2024-05-11T01:41:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:41:01.008614851Z [2024-05-11T01:41:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:41:01.009213140Z [2024-05-11T01:41:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:41:01.009508821Z [2024-05-11T01:41:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:41:01.010045449Z [2024-05-11T01:41:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:41:01.010492035Z [2024-05-11T01:41:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:41:01.320347012Z [2024-05-11T01:41:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:41:01.320439716Z [2024-05-11T01:41:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:41:01.320570945Z [2024-05-11T01:41:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:41:01.328356596Z [2024-05-11T01:41:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f01c477-b04e-4b01-8b46-f7453ab3a8b3 2024-05-11T01:41:01.328567329Z [2024-05-11T01:41:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae59c39b-8b6d-4e5c-820c-f2c861f69e81 2024-05-11T01:41:01.328722705Z [2024-05-11T01:41:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d69b608-2b0c-41f8-8379-8c020b531fc6 2024-05-11T01:41:02.469683495Z [2024-05-11T01:41:02.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:41:02.469999193Z [2024-05-11T01:41:02.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:40:00+00:00, run_id=scheduled__2024-05-11T01:40:00+00:00, run_start_date=2024-05-11 01:41:00.927600+00:00, run_end_date=2024-05-11 01:41:02.469446+00:00, run_duration=1.541846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:40:00+00:00, data_interval_end=2024-05-11 01:41:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:41:02.479812969Z [2024-05-11T01:41:02.479+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:41:00+00:00, run_after=2024-05-11T01:42:00+00:00 2024-05-11T01:41:02.525385365Z [2024-05-11T01:41:02.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:41:02.534545593Z [2024-05-11T01:41:02.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:41:01.906808+00:00, run_end_date=2024-05-11 01:41:02.281516+00:00, run_duration=0.374708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:41:01.003863+00:00, queued_by_job_id=2, pid=12571 2024-05-11T01:41:05.061038789Z [2024-05-11T01:41:05.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:41:05.061417484Z [2024-05-11T01:41:05.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:40:00+00:00, run_id=scheduled__2024-05-11T01:40:00+00:00, run_start_date=2024-05-11 01:41:00.929032+00:00, run_end_date=2024-05-11 01:41:05.061057+00:00, run_duration=4.132025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:40:00+00:00, data_interval_end=2024-05-11 01:41:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:41:05.069616992Z [2024-05-11T01:41:05.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:41:00+00:00, run_after=2024-05-11T01:42:00+00:00 2024-05-11T01:41:05.152516247Z [2024-05-11T01:41:05.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:41:05.155736858Z [2024-05-11T01:41:05.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:41:02.809328+00:00, run_end_date=2024-05-11 01:41:04.321120+00:00, run_duration=1.511792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:41:01.003863+00:00, queued_by_job_id=2, pid=12589 2024-05-11T01:41:06.158579160Z [2024-05-11T01:41:06.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:41:06.159018176Z [2024-05-11T01:41:06.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:40:00+00:00, run_id=scheduled__2024-05-11T01:40:00+00:00, run_start_date=2024-05-11 01:41:00.930247+00:00, run_end_date=2024-05-11 01:41:06.158381+00:00, run_duration=5.228134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:40:00+00:00, data_interval_end=2024-05-11 01:41:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:41:06.168198338Z [2024-05-11T01:41:06.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:41:00+00:00, run_after=2024-05-11T01:42:00+00:00 2024-05-11T01:41:06.206571490Z [2024-05-11T01:41:06.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:41:06.214278425Z [2024-05-11T01:41:06.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:41:02.795600+00:00, run_end_date=2024-05-11 01:41:05.040456+00:00, run_duration=2.244856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:41:01.003863+00:00, queued_by_job_id=2, pid=12590 2024-05-11T01:42:00.106080397Z [2024-05-11T01:42:00.103+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:42:00.111255345Z [2024-05-11T01:42:00.110+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:42:00.126130844Z [2024-05-11T01:42:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:42:00+00:00, run_after=2024-05-11T01:43:00+00:00 2024-05-11T01:42:00.140205306Z [2024-05-11T01:42:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:42:00+00:00, run_after=2024-05-11T01:43:00+00:00 2024-05-11T01:42:00.209184826Z [2024-05-11T01:42:00.208+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:42:00.209208445Z 2024-05-11T01:42:00.209229894Z 2024-05-11T01:42:00.209233478Z 2024-05-11T01:42:00.209236548Z 2024-05-11T01:42:00.209644473Z [2024-05-11T01:42:00.209+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:42:00.209900041Z [2024-05-11T01:42:00.209+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:42:00.210115276Z [2024-05-11T01:42:00.209+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:42:00.210329401Z [2024-05-11T01:42:00.210+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:42:00.210948323Z [2024-05-11T01:42:00.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:42:00.210959669Z 2024-05-11T01:42:00.210963246Z 2024-05-11T01:42:00.210966301Z 2024-05-11T01:42:00.210969338Z 2024-05-11T01:42:00.214455332Z [2024-05-11T01:42:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:42:00.214761052Z [2024-05-11T01:42:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:42:00.215068386Z [2024-05-11T01:42:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:42:00.215274502Z [2024-05-11T01:42:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:42:00.215623219Z [2024-05-11T01:42:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:42:00.215849856Z [2024-05-11T01:42:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:42:00.216194357Z [2024-05-11T01:42:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:42:00.216450838Z [2024-05-11T01:42:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:42:00.639052383Z [2024-05-11T01:42:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:42:00.639173625Z [2024-05-11T01:42:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:41:00+00:00 exited with status queued for try_number 1 2024-05-11T01:42:00.639309378Z [2024-05-11T01:42:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:41:00+00:00 exited with status queued for try_number 1 2024-05-11T01:42:00.639426177Z [2024-05-11T01:42:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:41:00+00:00 exited with status queued for try_number 1 2024-05-11T01:42:00.663022948Z [2024-05-11T01:42:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62e99134-5952-40c7-818b-afa152dba490 2024-05-11T01:42:00.663225753Z [2024-05-11T01:42:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 424f8ddc-ef90-4b99-bbdb-15552d079cd9 2024-05-11T01:42:00.664085239Z [2024-05-11T01:42:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 586a1288-02e9-493a-b533-7e9c6bd912ee 2024-05-11T01:42:00.664223062Z [2024-05-11T01:42:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to af832958-9148-45e2-b300-4bceab2507f6 2024-05-11T01:42:01.921500628Z [2024-05-11T01:42:01.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:42:01.921747693Z [2024-05-11T01:42:01.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:41:00+00:00, run_id=scheduled__2024-05-11T01:41:00+00:00, run_start_date=2024-05-11 01:42:00.152194+00:00, run_end_date=2024-05-11 01:42:01.921448+00:00, run_duration=1.769254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:41:00+00:00, data_interval_end=2024-05-11 01:42:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:42:01.939956202Z [2024-05-11T01:42:01.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:42:00+00:00, run_after=2024-05-11T01:43:00+00:00 2024-05-11T01:42:03.145172088Z [2024-05-11T01:42:03.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:42:03.145513260Z [2024-05-11T01:42:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:40:00+00:00, run_id=scheduled__2024-05-11T01:40:00+00:00, run_start_date=2024-05-11 01:42:00.150943+00:00, run_end_date=2024-05-11 01:42:03.144957+00:00, run_duration=2.994014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:40:00+00:00, data_interval_end=2024-05-11 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:42:03.158939744Z [2024-05-11T01:42:03.157+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:42:00+00:00, run_after=2024-05-11T01:44:00+00:00 2024-05-11T01:42:03.224655917Z [2024-05-11T01:42:03.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:42:03.224688313Z [2024-05-11T01:42:03.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:41:00+00:00 exited with status success for try_number 1 2024-05-11T01:42:03.231991367Z [2024-05-11T01:42:03.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:42:01.481814+00:00, run_end_date=2024-05-11 01:42:01.889744+00:00, run_duration=0.40793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:42:00.211942+00:00, queued_by_job_id=2, pid=12624 2024-05-11T01:42:03.232123586Z [2024-05-11T01:42:03.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:41:00+00:00, map_index=-1, run_start_date=2024-05-11 01:42:01.479100+00:00, run_end_date=2024-05-11 01:42:01.878714+00:00, run_duration=0.399614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:42:00.211942+00:00, queued_by_job_id=2, pid=12625 2024-05-11T01:42:04.902435806Z [2024-05-11T01:42:04.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:42:04.902950844Z [2024-05-11T01:42:04.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:41:00+00:00, run_id=scheduled__2024-05-11T01:41:00+00:00, run_start_date=2024-05-11 01:42:00.153386+00:00, run_end_date=2024-05-11 01:42:04.902234+00:00, run_duration=4.748848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:41:00+00:00, data_interval_end=2024-05-11 01:42:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:42:04.917676430Z [2024-05-11T01:42:04.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:42:00+00:00, run_after=2024-05-11T01:43:00+00:00 2024-05-11T01:42:04.927849113Z [2024-05-11T01:42:04.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:42:04.928204181Z [2024-05-11T01:42:04.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:41:00+00:00, run_id=scheduled__2024-05-11T01:41:00+00:00, run_start_date=2024-05-11 01:42:00.154991+00:00, run_end_date=2024-05-11 01:42:04.927715+00:00, run_duration=4.772724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:41:00+00:00, data_interval_end=2024-05-11 01:42:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:42:04.938168936Z [2024-05-11T01:42:04.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:42:00+00:00, run_after=2024-05-11T01:43:00+00:00 2024-05-11T01:42:04.985512604Z [2024-05-11T01:42:04.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:41:00+00:00 exited with status success for try_number 1 2024-05-11T01:42:04.985728974Z [2024-05-11T01:42:04.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:41:00+00:00 exited with status success for try_number 1 2024-05-11T01:42:04.992367226Z [2024-05-11T01:42:04.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:41:00+00:00, map_index=-1, run_start_date=2024-05-11 01:42:02.710949+00:00, run_end_date=2024-05-11 01:42:04.373667+00:00, run_duration=1.662718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:42:00.211942+00:00, queued_by_job_id=2, pid=12649 2024-05-11T01:42:04.992698292Z [2024-05-11T01:42:04.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:41:00+00:00, map_index=-1, run_start_date=2024-05-11 01:42:02.474704+00:00, run_end_date=2024-05-11 01:42:04.478496+00:00, run_duration=2.003792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:42:00.211942+00:00, queued_by_job_id=2, pid=12644 2024-05-11T01:43:00.752150470Z [2024-05-11T01:43:00.750+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:43:00.783725669Z [2024-05-11T01:43:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:43:00+00:00, run_after=2024-05-11T01:44:00+00:00 2024-05-11T01:43:00.802378222Z [2024-05-11T01:43:00.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:43:00+00:00, run_after=2024-05-11T01:44:00+00:00 2024-05-11T01:43:00.884081382Z [2024-05-11T01:43:00.883+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:43:00.884127150Z 2024-05-11T01:43:00.884137214Z 2024-05-11T01:43:00.884176975Z 2024-05-11T01:43:00.884303863Z [2024-05-11T01:43:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:43:00.884602025Z [2024-05-11T01:43:00.884+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:43:00.884932649Z [2024-05-11T01:43:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:43:00.886762510Z [2024-05-11T01:43:00.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:43:00.886779524Z 2024-05-11T01:43:00.886783177Z 2024-05-11T01:43:00.886786540Z 2024-05-11T01:43:00.892907501Z [2024-05-11T01:43:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:43:00.893325371Z [2024-05-11T01:43:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:43:00.893897749Z [2024-05-11T01:43:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:43:00.894220984Z [2024-05-11T01:43:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:43:00.894696555Z [2024-05-11T01:43:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:43:00.894888372Z [2024-05-11T01:43:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:43:01.235165846Z [2024-05-11T01:43:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status queued for try_number 1 2024-05-11T01:43:01.235498328Z [2024-05-11T01:43:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status queued for try_number 1 2024-05-11T01:43:01.235748255Z [2024-05-11T01:43:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status queued for try_number 1 2024-05-11T01:43:01.248104390Z [2024-05-11T01:43:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76375046-d586-4178-b2b5-225c73721489 2024-05-11T01:43:01.248355622Z [2024-05-11T01:43:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8a8a5bd-6e71-4a77-b6b2-affa2f3796e3 2024-05-11T01:43:01.248602727Z [2024-05-11T01:43:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91cd007b-2561-407d-be6c-07083d0863c3 2024-05-11T01:43:02.411417071Z [2024-05-11T01:43:02.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:43:02.413209862Z [2024-05-11T01:43:02.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:42:00+00:00, run_id=scheduled__2024-05-11T01:42:00+00:00, run_start_date=2024-05-11 01:43:00.818238+00:00, run_end_date=2024-05-11 01:43:02.411295+00:00, run_duration=1.593057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:42:00+00:00, data_interval_end=2024-05-11 01:43:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:43:02.430345152Z [2024-05-11T01:43:02.430+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:43:00+00:00, run_after=2024-05-11T01:44:00+00:00 2024-05-11T01:43:02.499718654Z [2024-05-11T01:43:02.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status success for try_number 1 2024-05-11T01:43:02.507131196Z [2024-05-11T01:43:02.506+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:42:00+00:00, map_index=-1, run_start_date=2024-05-11 01:43:01.695579+00:00, run_end_date=2024-05-11 01:43:02.111386+00:00, run_duration=0.415807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:43:00.888519+00:00, queued_by_job_id=2, pid=12680 2024-05-11T01:43:05.878802200Z [2024-05-11T01:43:05.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:43:05.879219833Z [2024-05-11T01:43:05.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:42:00+00:00, run_id=scheduled__2024-05-11T01:42:00+00:00, run_start_date=2024-05-11 01:43:00.819504+00:00, run_end_date=2024-05-11 01:43:05.878633+00:00, run_duration=5.059129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:42:00+00:00, data_interval_end=2024-05-11 01:43:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:43:05.893534469Z [2024-05-11T01:43:05.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:43:00+00:00, run_after=2024-05-11T01:44:00+00:00 2024-05-11T01:43:05.940556043Z [2024-05-11T01:43:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status success for try_number 1 2024-05-11T01:43:05.949660829Z [2024-05-11T01:43:05.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:42:00+00:00, map_index=-1, run_start_date=2024-05-11 01:43:02.728072+00:00, run_end_date=2024-05-11 01:43:04.855932+00:00, run_duration=2.12786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:43:00.888519+00:00, queued_by_job_id=2, pid=12699 2024-05-11T01:43:06.984339683Z [2024-05-11T01:43:06.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:43:06.984496234Z [2024-05-11T01:43:06.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:42:00+00:00, run_id=scheduled__2024-05-11T01:42:00+00:00, run_start_date=2024-05-11 01:43:00.820543+00:00, run_end_date=2024-05-11 01:43:06.984240+00:00, run_duration=6.163697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:42:00+00:00, data_interval_end=2024-05-11 01:43:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:43:06.992783343Z [2024-05-11T01:43:06.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:43:00+00:00, run_after=2024-05-11T01:44:00+00:00 2024-05-11T01:43:07.052337964Z [2024-05-11T01:43:07.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status success for try_number 1 2024-05-11T01:43:07.058993792Z [2024-05-11T01:43:07.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:42:00+00:00, map_index=-1, run_start_date=2024-05-11 01:43:02.659458+00:00, run_end_date=2024-05-11 01:43:06.198583+00:00, run_duration=3.539125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:43:00.888519+00:00, queued_by_job_id=2, pid=12698 2024-05-11T01:44:00.630067304Z [2024-05-11T01:44:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:44:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:44:00.639851790Z [2024-05-11T01:44:00.639+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:44:00.646555551Z [2024-05-11T01:44:00.646+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:44:00.657606764Z [2024-05-11T01:44:00.657+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:44:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:44:00.734681763Z [2024-05-11T01:44:00.734+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:44:00.734723227Z 2024-05-11T01:44:00.734733733Z 2024-05-11T01:44:00.734742637Z 2024-05-11T01:44:00.734751393Z 2024-05-11T01:44:00.735034786Z [2024-05-11T01:44:00.734+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:44:00.735392905Z [2024-05-11T01:44:00.735+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:44:00.735880431Z [2024-05-11T01:44:00.735+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:44:00.736264489Z [2024-05-11T01:44:00.735+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:44:00.738770305Z [2024-05-11T01:44:00.738+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:44:00.738799745Z 2024-05-11T01:44:00.738809156Z 2024-05-11T01:44:00.738817409Z 2024-05-11T01:44:00.738825760Z 2024-05-11T01:44:00.744236329Z [2024-05-11T01:44:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:44:00.744484450Z [2024-05-11T01:44:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:44:00.744901580Z [2024-05-11T01:44:00.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:44:00.745159005Z [2024-05-11T01:44:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:44:00.745559654Z [2024-05-11T01:44:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:44:00.745815671Z [2024-05-11T01:44:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:44:00.746258017Z [2024-05-11T01:44:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:44:00.746511365Z [2024-05-11T01:44:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:44:01.045462205Z [2024-05-11T01:44:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status queued for try_number 1 2024-05-11T01:44:01.045494365Z [2024-05-11T01:44:01.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:43:00+00:00 exited with status queued for try_number 1 2024-05-11T01:44:01.046147773Z [2024-05-11T01:44:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:43:00+00:00 exited with status queued for try_number 1 2024-05-11T01:44:01.047796599Z [2024-05-11T01:44:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:43:00+00:00 exited with status queued for try_number 1 2024-05-11T01:44:01.063640878Z [2024-05-11T01:44:01.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80e63dcd-5884-4e5a-8f8f-d0ce3b9aaa67 2024-05-11T01:44:01.063663418Z [2024-05-11T01:44:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bdb44fb-3c96-4d8a-94e3-80853cb623a1 2024-05-11T01:44:01.063667335Z [2024-05-11T01:44:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to a22ae46e-e0f2-4687-9d15-2d440f25dbd9 2024-05-11T01:44:01.064922369Z [2024-05-11T01:44:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8eaedfb-3f7a-486d-bf19-94681dd4e296 2024-05-11T01:44:02.307995119Z [2024-05-11T01:44:02.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:44:02.308070627Z [2024-05-11T01:44:02.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:42:00+00:00, run_id=scheduled__2024-05-11T01:42:00+00:00, run_start_date=2024-05-11 01:44:00.673649+00:00, run_end_date=2024-05-11 01:44:02.306988+00:00, run_duration=1.633339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:42:00+00:00, data_interval_end=2024-05-11 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:44:02.317426010Z [2024-05-11T01:44:02.317+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:44:00+00:00, run_after=2024-05-11T01:46:00+00:00 2024-05-11T01:44:02.331467294Z [2024-05-11T01:44:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:44:02.331876720Z [2024-05-11T01:44:02.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:43:00+00:00, run_id=scheduled__2024-05-11T01:43:00+00:00, run_start_date=2024-05-11 01:44:00.675042+00:00, run_end_date=2024-05-11 01:44:02.331386+00:00, run_duration=1.656344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:43:00+00:00, data_interval_end=2024-05-11 01:44:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:44:02.342711680Z [2024-05-11T01:44:02.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:44:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:44:02.392458942Z [2024-05-11T01:44:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:42:00+00:00 exited with status success for try_number 1 2024-05-11T01:44:02.392888071Z [2024-05-11T01:44:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:43:00+00:00 exited with status success for try_number 1 2024-05-11T01:44:02.402584607Z [2024-05-11T01:44:02.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:42:00+00:00, map_index=-1, run_start_date=2024-05-11 01:44:01.532753+00:00, run_end_date=2024-05-11 01:44:01.846481+00:00, run_duration=0.313728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:44:00.740271+00:00, queued_by_job_id=2, pid=12728 2024-05-11T01:44:02.403083516Z [2024-05-11T01:44:02.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:43:00+00:00, map_index=-1, run_start_date=2024-05-11 01:44:01.798028+00:00, run_end_date=2024-05-11 01:44:02.165142+00:00, run_duration=0.367114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:44:00.740271+00:00, queued_by_job_id=2, pid=12737 2024-05-11T01:44:04.592271523Z [2024-05-11T01:44:04.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:44:04.592622233Z [2024-05-11T01:44:04.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:43:00+00:00, run_id=scheduled__2024-05-11T01:43:00+00:00, run_start_date=2024-05-11 01:44:00.676250+00:00, run_end_date=2024-05-11 01:44:04.592152+00:00, run_duration=3.915902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:43:00+00:00, data_interval_end=2024-05-11 01:44:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:44:04.606215911Z [2024-05-11T01:44:04.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:44:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:44:04.645269045Z [2024-05-11T01:44:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:43:00+00:00 exited with status success for try_number 1 2024-05-11T01:44:04.650097305Z [2024-05-11T01:44:04.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:43:00+00:00, map_index=-1, run_start_date=2024-05-11 01:44:02.647677+00:00, run_end_date=2024-05-11 01:44:04.153314+00:00, run_duration=1.505637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:44:00.740271+00:00, queued_by_job_id=2, pid=12755 2024-05-11T01:44:05.708400378Z [2024-05-11T01:44:05.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:44:05.710891943Z [2024-05-11T01:44:05.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:43:00+00:00, run_id=scheduled__2024-05-11T01:43:00+00:00, run_start_date=2024-05-11 01:44:00.677395+00:00, run_end_date=2024-05-11 01:44:05.708304+00:00, run_duration=5.030909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:43:00+00:00, data_interval_end=2024-05-11 01:44:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:44:05.726652820Z [2024-05-11T01:44:05.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:44:00+00:00, run_after=2024-05-11T01:45:00+00:00 2024-05-11T01:44:05.758167951Z [2024-05-11T01:44:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:43:00+00:00 exited with status success for try_number 1 2024-05-11T01:44:05.763488748Z [2024-05-11T01:44:05.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:43:00+00:00, map_index=-1, run_start_date=2024-05-11 01:44:02.738534+00:00, run_end_date=2024-05-11 01:44:05.427261+00:00, run_duration=2.688727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:44:00.740271+00:00, queued_by_job_id=2, pid=12756 2024-05-11T01:45:00.954423193Z [2024-05-11T01:45:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:45:00.967871565Z [2024-05-11T01:45:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:46:00+00:00 2024-05-11T01:45:00.985171275Z [2024-05-11T01:45:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:46:00+00:00 2024-05-11T01:45:00.994440684Z [2024-05-11T01:45:00.994+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:45:01.182131633Z [2024-05-11T01:45:01.181+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:45:01.182169951Z 2024-05-11T01:45:01.182174196Z 2024-05-11T01:45:01.182177449Z 2024-05-11T01:45:01.182180897Z 2024-05-11T01:45:01.182681311Z [2024-05-11T01:45:01.182+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:45:01.182967456Z [2024-05-11T01:45:01.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:45:01.183303317Z [2024-05-11T01:45:01.183+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:45:01.183551128Z [2024-05-11T01:45:01.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:45:01.184357141Z [2024-05-11T01:45:01.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:45:01.184364256Z 2024-05-11T01:45:01.184367652Z 2024-05-11T01:45:01.184370882Z 2024-05-11T01:45:01.184373943Z 2024-05-11T01:45:01.195768071Z [2024-05-11T01:45:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:45:01.196527443Z [2024-05-11T01:45:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:45:01.196913679Z [2024-05-11T01:45:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:45:01.197211729Z [2024-05-11T01:45:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:45:01.197579197Z [2024-05-11T01:45:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:45:01.197795600Z [2024-05-11T01:45:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:45:01.198205379Z [2024-05-11T01:45:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:45:01.198446771Z [2024-05-11T01:45:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:45:01.826079843Z [2024-05-11T01:45:01.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:01.826395534Z [2024-05-11T01:45:01.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:01.826810363Z [2024-05-11T01:45:01.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:01.827019350Z [2024-05-11T01:45:01.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:01.845062560Z [2024-05-11T01:45:01.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e14d09c-163a-46bc-9cd1-c9147616b69a 2024-05-11T01:45:01.846497306Z [2024-05-11T01:45:01.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b840968-a22c-4c20-be36-915349aaf239 2024-05-11T01:45:01.849627251Z [2024-05-11T01:45:01.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dd1934a-11a4-425d-9d9b-4d8d442add4d 2024-05-11T01:45:01.849779919Z [2024-05-11T01:45:01.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fd15623-bd0e-4118-a1a6-d63878a2ff34 2024-05-11T01:45:03.147005656Z [2024-05-11T01:45:03.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:45:03.147540859Z [2024-05-11T01:45:03.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:44:00+00:00, run_id=scheduled__2024-05-11T01:44:00+00:00, run_start_date=2024-05-11 01:45:01.007088+00:00, run_end_date=2024-05-11 01:45:03.147152+00:00, run_duration=2.140064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:44:00+00:00, data_interval_end=2024-05-11 01:45:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:45:03.158656071Z [2024-05-11T01:45:03.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:46:00+00:00 2024-05-11T01:45:03.289539785Z [2024-05-11T01:45:03.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:03.308856106Z [2024-05-11T01:45:03.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:44:00+00:00, map_index=-1, run_start_date=2024-05-11 01:45:02.386228+00:00, run_end_date=2024-05-11 01:45:02.900999+00:00, run_duration=0.514771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:01.185557+00:00, queued_by_job_id=2, pid=12789 2024-05-11T01:45:05.582147279Z [2024-05-11T01:45:05.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:45:05.582486511Z [2024-05-11T01:45:05.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:44:00+00:00, run_id=scheduled__2024-05-11T01:44:00+00:00, run_start_date=2024-05-11 01:45:01.010748+00:00, run_end_date=2024-05-11 01:45:05.582087+00:00, run_duration=4.571339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:44:00+00:00, data_interval_end=2024-05-11 01:45:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:45:05.601032117Z [2024-05-11T01:45:05.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:46:00+00:00 2024-05-11T01:45:05.607241330Z [2024-05-11T01:45:05.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:45:05.607511474Z [2024-05-11T01:45:05.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:44:00+00:00, run_id=scheduled__2024-05-11T01:44:00+00:00, run_start_date=2024-05-11 01:45:01.008147+00:00, run_end_date=2024-05-11 01:45:05.607170+00:00, run_duration=4.599023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:44:00+00:00, data_interval_end=2024-05-11 01:45:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:45:05.616127696Z [2024-05-11T01:45:05.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:46:00+00:00 2024-05-11T01:45:05.632897317Z [2024-05-11T01:45:05.632+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:45:05.632928128Z 2024-05-11T01:45:05.632968198Z [2024-05-11T01:45:05.632+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:45:05.633600638Z [2024-05-11T01:45:05.633+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:45:05.633627737Z 2024-05-11T01:45:05.635761016Z [2024-05-11T01:45:05.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:45:05.635985311Z [2024-05-11T01:45:05.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:45:05.721122273Z [2024-05-11T01:45:05.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:05.723298355Z [2024-05-11T01:45:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:05.723529907Z [2024-05-11T01:45:05.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:05.723724543Z [2024-05-11T01:45:05.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:05.730866937Z [2024-05-11T01:45:05.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:45:04.024550+00:00, run_end_date=2024-05-11 01:45:04.423034+00:00, run_duration=0.398484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:01.185557+00:00, queued_by_job_id=2, pid=12819 2024-05-11T01:45:05.731371356Z [2024-05-11T01:45:05.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 533c74b2-5e59-444f-a2b4-ecce9f10a1f3 2024-05-11T01:45:05.732066654Z [2024-05-11T01:45:05.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:44:00+00:00, map_index=-1, run_start_date=2024-05-11 01:45:04.239799+00:00, run_end_date=2024-05-11 01:45:05.554265+00:00, run_duration=1.314466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:01.185557+00:00, queued_by_job_id=2, pid=12820 2024-05-11T01:45:05.732641839Z [2024-05-11T01:45:05.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:44:00+00:00, map_index=-1, run_start_date=2024-05-11 01:45:03.480228+00:00, run_end_date=2024-05-11 01:45:05.250545+00:00, run_duration=1.770317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:01.185557+00:00, queued_by_job_id=2, pid=12803 2024-05-11T01:45:08.044945215Z [2024-05-11T01:45:08.044+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:45:08.044977060Z 2024-05-11T01:45:08.045147612Z [2024-05-11T01:45:08.044+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:45:08.049695934Z [2024-05-11T01:45:08.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:45:08.049718741Z 2024-05-11T01:45:08.053607505Z [2024-05-11T01:45:08.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:45:08.054113844Z [2024-05-11T01:45:08.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:45:08.179244834Z [2024-05-11T01:45:08.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:08.179272028Z [2024-05-11T01:45:08.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:08.198927148Z [2024-05-11T01:45:08.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ecf9ba7-ab41-459f-bdc4-9d36c9a87188 2024-05-11T01:45:08.198955574Z [2024-05-11T01:45:08.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:45:07.352799+00:00, run_end_date=2024-05-11 01:45:07.826460+00:00, run_duration=0.473661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:05.634018+00:00, queued_by_job_id=2, pid=12848 2024-05-11T01:45:10.405029796Z [2024-05-11T01:45:10.404+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:45:10.405064264Z 2024-05-11T01:45:10.405345807Z [2024-05-11T01:45:10.405+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:45:10.407252608Z [2024-05-11T01:45:10.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:45:10.407277641Z 2024-05-11T01:45:10.410433020Z [2024-05-11T01:45:10.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:45:10.410756810Z [2024-05-11T01:45:10.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:45:10.480837010Z [2024-05-11T01:45:10.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status queued for try_number 1 2024-05-11T01:45:10.481043257Z [2024-05-11T01:45:10.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:10.487482346Z [2024-05-11T01:45:10.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f7ad38-e6af-4c4d-a230-2dcd9dae4023 2024-05-11T01:45:10.487821223Z [2024-05-11T01:45:10.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=0, run_start_date=2024-05-11 01:45:09.819847+00:00, run_end_date=2024-05-11 01:45:10.173394+00:00, run_duration=0.353547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:08.050464+00:00, queued_by_job_id=2, pid=12859 2024-05-11T01:45:13.300050103Z [2024-05-11T01:45:13.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:45:13.300134735Z [2024-05-11T01:45:13.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:40:00+00:00, run_id=scheduled__2024-05-11T01:40:00+00:00, run_start_date=2024-05-11 01:45:01.005852+00:00, run_end_date=2024-05-11 01:45:13.299865+00:00, run_duration=12.294013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:40:00+00:00, data_interval_end=2024-05-11 01:45:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:45:13.306683528Z [2024-05-11T01:45:13.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:45:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:45:13.342686791Z [2024-05-11T01:45:13.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:40:00+00:00 exited with status success for try_number 1 2024-05-11T01:45:13.350247927Z [2024-05-11T01:45:13.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:40:00+00:00, map_index=-1, run_start_date=2024-05-11 01:45:12.150668+00:00, run_end_date=2024-05-11 01:45:12.596029+00:00, run_duration=0.445361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:45:10.407879+00:00, queued_by_job_id=2, pid=12867 2024-05-11T01:45:35.874186387Z [2024-05-11T01:45:35.873+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:46:00.109804047Z [2024-05-11T01:46:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:46:00.123689879Z [2024-05-11T01:46:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:46:00+00:00, run_after=2024-05-11T01:47:00+00:00 2024-05-11T01:46:00.130651992Z [2024-05-11T01:46:00.130+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:46:00.144620157Z [2024-05-11T01:46:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:46:00+00:00, run_after=2024-05-11T01:47:00+00:00 2024-05-11T01:46:00.218749534Z [2024-05-11T01:46:00.218+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:46:00.218788081Z 2024-05-11T01:46:00.218793877Z 2024-05-11T01:46:00.218798165Z 2024-05-11T01:46:00.218802482Z 2024-05-11T01:46:00.218880694Z [2024-05-11T01:46:00.218+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:46:00.218887052Z [2024-05-11T01:46:00.218+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:46:00.218891618Z [2024-05-11T01:46:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:46:00.218993490Z [2024-05-11T01:46:00.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:46:00.219533296Z [2024-05-11T01:46:00.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:46:00.219543674Z 2024-05-11T01:46:00.219552310Z 2024-05-11T01:46:00.219579386Z 2024-05-11T01:46:00.219584230Z 2024-05-11T01:46:00.222686514Z [2024-05-11T01:46:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:46:00.222777729Z [2024-05-11T01:46:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:46:00.222942523Z [2024-05-11T01:46:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:46:00.223016503Z [2024-05-11T01:46:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:46:00.223163020Z [2024-05-11T01:46:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:46:00.223281698Z [2024-05-11T01:46:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:46:00.223468549Z [2024-05-11T01:46:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:46:00.223530302Z [2024-05-11T01:46:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:46:00.715824231Z [2024-05-11T01:46:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status queued for try_number 1 2024-05-11T01:46:00.715922432Z [2024-05-11T01:46:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:46:00.715927452Z [2024-05-11T01:46:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:46:00.716087233Z [2024-05-11T01:46:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:46:00.724019408Z [2024-05-11T01:46:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b06d528-173f-43f2-ad75-1d41750eeab5 2024-05-11T01:46:00.724095235Z [2024-05-11T01:46:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2005f6d-921a-473b-8d01-6a99a9f1e178 2024-05-11T01:46:00.724190350Z [2024-05-11T01:46:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b1616d-f0a0-48d2-879c-3542f9e3da88 2024-05-11T01:46:00.724283520Z [2024-05-11T01:46:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07b34453-60b5-476f-b66a-58081f383bb9 2024-05-11T01:46:02.074910481Z [2024-05-11T01:46:02.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:46:02.075115903Z [2024-05-11T01:46:02.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:44:00+00:00, run_id=scheduled__2024-05-11T01:44:00+00:00, run_start_date=2024-05-11 01:46:00.153959+00:00, run_end_date=2024-05-11 01:46:02.074830+00:00, run_duration=1.920871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:44:00+00:00, data_interval_end=2024-05-11 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:46:02.083349076Z [2024-05-11T01:46:02.082+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:46:00+00:00, run_after=2024-05-11T01:48:00+00:00 2024-05-11T01:46:02.100197002Z [2024-05-11T01:46:02.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:46:02.100345610Z [2024-05-11T01:46:02.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:45:00+00:00, run_id=scheduled__2024-05-11T01:45:00+00:00, run_start_date=2024-05-11 01:46:00.155058+00:00, run_end_date=2024-05-11 01:46:02.100091+00:00, run_duration=1.945033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:45:00+00:00, data_interval_end=2024-05-11 01:46:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:46:02.111089770Z [2024-05-11T01:46:02.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:46:00+00:00, run_after=2024-05-11T01:47:00+00:00 2024-05-11T01:46:02.153640030Z [2024-05-11T01:46:02.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:44:00+00:00 exited with status success for try_number 1 2024-05-11T01:46:02.153672755Z [2024-05-11T01:46:02.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:46:02.162543709Z [2024-05-11T01:46:02.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:44:00+00:00, map_index=-1, run_start_date=2024-05-11 01:46:01.143998+00:00, run_end_date=2024-05-11 01:46:01.607023+00:00, run_duration=0.463025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:46:00.220305+00:00, queued_by_job_id=2, pid=12877 2024-05-11T01:46:02.162808421Z [2024-05-11T01:46:02.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=-1, run_start_date=2024-05-11 01:46:01.433335+00:00, run_end_date=2024-05-11 01:46:01.871657+00:00, run_duration=0.438322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:46:00.220305+00:00, queued_by_job_id=2, pid=12878 2024-05-11T01:46:04.126151821Z [2024-05-11T01:46:04.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:46:04.126520344Z [2024-05-11T01:46:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:45:00+00:00, run_id=scheduled__2024-05-11T01:45:00+00:00, run_start_date=2024-05-11 01:46:00.156021+00:00, run_end_date=2024-05-11 01:46:04.126070+00:00, run_duration=3.970049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:45:00+00:00, data_interval_end=2024-05-11 01:46:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:46:04.134755086Z [2024-05-11T01:46:04.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:46:00+00:00, run_after=2024-05-11T01:47:00+00:00 2024-05-11T01:46:05.214578606Z [2024-05-11T01:46:05.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:46:05.217144408Z [2024-05-11T01:46:05.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:45:00+00:00, run_id=scheduled__2024-05-11T01:45:00+00:00, run_start_date=2024-05-11 01:46:00.157131+00:00, run_end_date=2024-05-11 01:46:05.214732+00:00, run_duration=5.057601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:45:00+00:00, data_interval_end=2024-05-11 01:46:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:46:05.228028930Z [2024-05-11T01:46:05.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:46:00+00:00, run_after=2024-05-11T01:47:00+00:00 2024-05-11T01:46:05.271995856Z [2024-05-11T01:46:05.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:46:05.272407045Z [2024-05-11T01:46:05.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:46:05.283565485Z [2024-05-11T01:46:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=-1, run_start_date=2024-05-11 01:46:02.541479+00:00, run_end_date=2024-05-11 01:46:04.055790+00:00, run_duration=1.514311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:46:00.220305+00:00, queued_by_job_id=2, pid=12898 2024-05-11T01:46:05.284114019Z [2024-05-11T01:46:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=-1, run_start_date=2024-05-11 01:46:02.763630+00:00, run_end_date=2024-05-11 01:46:04.689130+00:00, run_duration=1.9255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:46:00.220305+00:00, queued_by_job_id=2, pid=12902 2024-05-11T01:47:00.975279694Z [2024-05-11T01:47:00.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:47:00+00:00, run_after=2024-05-11T01:48:00+00:00 2024-05-11T01:47:00.987481896Z [2024-05-11T01:47:00.986+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:47:01.005002034Z [2024-05-11T01:47:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:47:00+00:00, run_after=2024-05-11T01:48:00+00:00 2024-05-11T01:47:01.137478216Z [2024-05-11T01:47:01.136+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:47:01.137515536Z 2024-05-11T01:47:01.137522297Z 2024-05-11T01:47:01.137528255Z 2024-05-11T01:47:01.138475650Z [2024-05-11T01:47:01.138+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:47:01.138773760Z [2024-05-11T01:47:01.138+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:47:01.139021336Z [2024-05-11T01:47:01.138+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:47:01.140405839Z [2024-05-11T01:47:01.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:47:01.140424598Z 2024-05-11T01:47:01.140431455Z 2024-05-11T01:47:01.140437768Z 2024-05-11T01:47:01.150995842Z [2024-05-11T01:47:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:47:01.151220956Z [2024-05-11T01:47:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:47:01.151494608Z [2024-05-11T01:47:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:47:01.151659753Z [2024-05-11T01:47:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:47:01.151933974Z [2024-05-11T01:47:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:47:01.152097727Z [2024-05-11T01:47:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:47:01.348393584Z [2024-05-11T01:47:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status queued for try_number 1 2024-05-11T01:47:01.348424330Z [2024-05-11T01:47:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status queued for try_number 1 2024-05-11T01:47:01.348478313Z [2024-05-11T01:47:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status queued for try_number 1 2024-05-11T01:47:01.356502937Z [2024-05-11T01:47:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb7deec4-9b8c-4ead-bada-bef19f80f874 2024-05-11T01:47:01.356531331Z [2024-05-11T01:47:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03c8ebbc-e1f7-4e20-95d0-dc41b38451ed 2024-05-11T01:47:01.356654293Z [2024-05-11T01:47:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cd460de-259c-4160-bd2d-b5f385b7278d 2024-05-11T01:47:02.484530864Z [2024-05-11T01:47:02.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:47:02.484734872Z [2024-05-11T01:47:02.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:46:00+00:00, run_id=scheduled__2024-05-11T01:46:00+00:00, run_start_date=2024-05-11 01:47:01.030284+00:00, run_end_date=2024-05-11 01:47:02.484410+00:00, run_duration=1.454126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:46:00+00:00, data_interval_end=2024-05-11 01:47:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:47:02.495326377Z [2024-05-11T01:47:02.494+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:47:00+00:00, run_after=2024-05-11T01:48:00+00:00 2024-05-11T01:47:02.536462694Z [2024-05-11T01:47:02.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status success for try_number 1 2024-05-11T01:47:02.550331631Z [2024-05-11T01:47:02.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:46:00+00:00, map_index=-1, run_start_date=2024-05-11 01:47:01.921830+00:00, run_end_date=2024-05-11 01:47:02.286826+00:00, run_duration=0.364996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:47:01.146173+00:00, queued_by_job_id=2, pid=12934 2024-05-11T01:47:05.052473599Z [2024-05-11T01:47:05.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:47:05.052870548Z [2024-05-11T01:47:05.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:46:00+00:00, run_id=scheduled__2024-05-11T01:46:00+00:00, run_start_date=2024-05-11 01:47:01.031528+00:00, run_end_date=2024-05-11 01:47:05.052545+00:00, run_duration=4.021017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:46:00+00:00, data_interval_end=2024-05-11 01:47:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:47:05.062182060Z [2024-05-11T01:47:05.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:47:00+00:00, run_after=2024-05-11T01:48:00+00:00 2024-05-11T01:47:05.082840416Z [2024-05-11T01:47:05.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:47:05.083487986Z [2024-05-11T01:47:05.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:46:00+00:00, run_id=scheduled__2024-05-11T01:46:00+00:00, run_start_date=2024-05-11 01:47:01.032588+00:00, run_end_date=2024-05-11 01:47:05.082739+00:00, run_duration=4.050151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:46:00+00:00, data_interval_end=2024-05-11 01:47:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:47:05.099211455Z [2024-05-11T01:47:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:47:00+00:00, run_after=2024-05-11T01:48:00+00:00 2024-05-11T01:47:05.140456290Z [2024-05-11T01:47:05.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status success for try_number 1 2024-05-11T01:47:05.140532539Z [2024-05-11T01:47:05.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status success for try_number 1 2024-05-11T01:47:05.157940892Z [2024-05-11T01:47:05.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:46:00+00:00, map_index=-1, run_start_date=2024-05-11 01:47:02.878155+00:00, run_end_date=2024-05-11 01:47:04.223426+00:00, run_duration=1.345271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:47:01.146173+00:00, queued_by_job_id=2, pid=12953 2024-05-11T01:47:05.158447088Z [2024-05-11T01:47:05.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:46:00+00:00, map_index=-1, run_start_date=2024-05-11 01:47:02.789304+00:00, run_end_date=2024-05-11 01:47:04.597115+00:00, run_duration=1.807811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:47:01.146173+00:00, queued_by_job_id=2, pid=12952 2024-05-11T01:48:00.888052997Z [2024-05-11T01:48:00.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:48:00+00:00, run_after=2024-05-11T01:49:00+00:00 2024-05-11T01:48:00.895670725Z [2024-05-11T01:48:00.895+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:48:00.902021201Z [2024-05-11T01:48:00.901+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:48:00.914924463Z [2024-05-11T01:48:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:48:00+00:00, run_after=2024-05-11T01:49:00+00:00 2024-05-11T01:48:01.022003399Z [2024-05-11T01:48:01.019+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:48:01.022026326Z 2024-05-11T01:48:01.022042194Z 2024-05-11T01:48:01.022045953Z 2024-05-11T01:48:01.022049235Z 2024-05-11T01:48:01.022053265Z [2024-05-11T01:48:01.020+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:48:01.022056430Z [2024-05-11T01:48:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:48:01.022059508Z [2024-05-11T01:48:01.020+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:48:01.022076565Z [2024-05-11T01:48:01.020+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:48:01.022079743Z [2024-05-11T01:48:01.021+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:48:01.022082881Z 2024-05-11T01:48:01.022085872Z 2024-05-11T01:48:01.022088845Z 2024-05-11T01:48:01.022092000Z 2024-05-11T01:48:01.028381520Z [2024-05-11T01:48:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:48:01.042058022Z [2024-05-11T01:48:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:48:01.042084364Z [2024-05-11T01:48:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:48:01.042088354Z [2024-05-11T01:48:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:48:01.042091573Z [2024-05-11T01:48:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:48:01.042094719Z [2024-05-11T01:48:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:48:01.042097886Z [2024-05-11T01:48:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:48:01.042115580Z [2024-05-11T01:48:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:48:01.538077446Z [2024-05-11T01:48:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status queued for try_number 1 2024-05-11T01:48:01.538157778Z [2024-05-11T01:48:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:47:00+00:00 exited with status queued for try_number 1 2024-05-11T01:48:01.538180007Z [2024-05-11T01:48:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:47:00+00:00 exited with status queued for try_number 1 2024-05-11T01:48:01.538206123Z [2024-05-11T01:48:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:47:00+00:00 exited with status queued for try_number 1 2024-05-11T01:48:01.548650521Z [2024-05-11T01:48:01.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbc9789d-0548-4dd2-884e-a8943c1f00fa 2024-05-11T01:48:01.548727765Z [2024-05-11T01:48:01.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94781a9a-cad7-4c02-8896-9a948b8018c4 2024-05-11T01:48:01.548782060Z [2024-05-11T01:48:01.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e565a13-9229-4fb9-a8e6-7dc77841d3db 2024-05-11T01:48:01.548917487Z [2024-05-11T01:48:01.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbd4a9e4-f618-494a-aed1-d4e0134e0405 2024-05-11T01:48:02.936683175Z [2024-05-11T01:48:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:48:02.937247885Z [2024-05-11T01:48:02.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:46:00+00:00, run_id=scheduled__2024-05-11T01:46:00+00:00, run_start_date=2024-05-11 01:48:00.927557+00:00, run_end_date=2024-05-11 01:48:02.936602+00:00, run_duration=2.009045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:46:00+00:00, data_interval_end=2024-05-11 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:48:02.948816053Z [2024-05-11T01:48:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:48:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:48:02.962214159Z [2024-05-11T01:48:02.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:48:02.963228640Z [2024-05-11T01:48:02.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:47:00+00:00, run_id=scheduled__2024-05-11T01:47:00+00:00, run_start_date=2024-05-11 01:48:00.928907+00:00, run_end_date=2024-05-11 01:48:02.962367+00:00, run_duration=2.03346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:47:00+00:00, data_interval_end=2024-05-11 01:48:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:48:02.984406878Z [2024-05-11T01:48:02.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:48:00+00:00, run_after=2024-05-11T01:49:00+00:00 2024-05-11T01:48:03.034360868Z [2024-05-11T01:48:03.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:46:00+00:00 exited with status success for try_number 1 2024-05-11T01:48:03.034479022Z [2024-05-11T01:48:03.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:47:00+00:00 exited with status success for try_number 1 2024-05-11T01:48:03.045519482Z [2024-05-11T01:48:03.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:46:00+00:00, map_index=-1, run_start_date=2024-05-11 01:48:01.988971+00:00, run_end_date=2024-05-11 01:48:02.466722+00:00, run_duration=0.477751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:48:01.023465+00:00, queued_by_job_id=2, pid=12985 2024-05-11T01:48:03.045818814Z [2024-05-11T01:48:03.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:47:00+00:00, map_index=-1, run_start_date=2024-05-11 01:48:02.135567+00:00, run_end_date=2024-05-11 01:48:02.495262+00:00, run_duration=0.359695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:48:01.023465+00:00, queued_by_job_id=2, pid=12986 2024-05-11T01:48:06.016398750Z [2024-05-11T01:48:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:48:06.016726479Z [2024-05-11T01:48:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:47:00+00:00, run_id=scheduled__2024-05-11T01:47:00+00:00, run_start_date=2024-05-11 01:48:00.929935+00:00, run_end_date=2024-05-11 01:48:06.016305+00:00, run_duration=5.08637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:47:00+00:00, data_interval_end=2024-05-11 01:48:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:48:06.026371768Z [2024-05-11T01:48:06.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:48:00+00:00, run_after=2024-05-11T01:49:00+00:00 2024-05-11T01:48:06.034154957Z [2024-05-11T01:48:06.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:48:06.035053732Z [2024-05-11T01:48:06.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:47:00+00:00, run_id=scheduled__2024-05-11T01:47:00+00:00, run_start_date=2024-05-11 01:48:00.930915+00:00, run_end_date=2024-05-11 01:48:06.034049+00:00, run_duration=5.103134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:47:00+00:00, data_interval_end=2024-05-11 01:48:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:48:06.043620360Z [2024-05-11T01:48:06.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:48:00+00:00, run_after=2024-05-11T01:49:00+00:00 2024-05-11T01:48:06.080812222Z [2024-05-11T01:48:06.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:47:00+00:00 exited with status success for try_number 1 2024-05-11T01:48:06.081050388Z [2024-05-11T01:48:06.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:47:00+00:00 exited with status success for try_number 1 2024-05-11T01:48:06.102347086Z [2024-05-11T01:48:06.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:47:00+00:00, map_index=-1, run_start_date=2024-05-11 01:48:03.247101+00:00, run_end_date=2024-05-11 01:48:05.252490+00:00, run_duration=2.005389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:48:01.023465+00:00, queued_by_job_id=2, pid=13010 2024-05-11T01:48:06.102549134Z [2024-05-11T01:48:06.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:47:00+00:00, map_index=-1, run_start_date=2024-05-11 01:48:03.186830+00:00, run_end_date=2024-05-11 01:48:05.546143+00:00, run_duration=2.359313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:48:01.023465+00:00, queued_by_job_id=2, pid=13009 2024-05-11T01:49:00.680230356Z [2024-05-11T01:49:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:49:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:49:00.693328848Z [2024-05-11T01:49:00.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:49:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:49:00.699988049Z [2024-05-11T01:49:00.699+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:49:00.757303099Z [2024-05-11T01:49:00.756+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:49:00.757330957Z 2024-05-11T01:49:00.757334400Z 2024-05-11T01:49:00.757337479Z 2024-05-11T01:49:00.757341056Z [2024-05-11T01:49:00.757+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:49:00.757579821Z [2024-05-11T01:49:00.757+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:49:00.757733321Z [2024-05-11T01:49:00.757+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:49:00.758389545Z [2024-05-11T01:49:00.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:49:00.758401810Z 2024-05-11T01:49:00.758421442Z 2024-05-11T01:49:00.758424823Z 2024-05-11T01:49:00.762119739Z [2024-05-11T01:49:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:49:00.762262620Z [2024-05-11T01:49:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:49:00.762485003Z [2024-05-11T01:49:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:49:00.762641646Z [2024-05-11T01:49:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:49:00.762822459Z [2024-05-11T01:49:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:49:00.762858054Z [2024-05-11T01:49:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:49:01.053968856Z [2024-05-11T01:49:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status queued for try_number 1 2024-05-11T01:49:01.053993769Z [2024-05-11T01:49:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status queued for try_number 1 2024-05-11T01:49:01.053997293Z [2024-05-11T01:49:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status queued for try_number 1 2024-05-11T01:49:01.065958265Z [2024-05-11T01:49:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 663c1433-62fc-4abf-a020-f750495eeac3 2024-05-11T01:49:01.065979665Z [2024-05-11T01:49:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdc99521-6738-4677-a09f-54d0efbdc58b 2024-05-11T01:49:01.065997509Z [2024-05-11T01:49:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4af47fbc-47ea-4a97-aea9-f9d100fab24f 2024-05-11T01:49:02.965717132Z [2024-05-11T01:49:02.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:49:02.966102783Z [2024-05-11T01:49:02.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:48:00+00:00, run_id=scheduled__2024-05-11T01:48:00+00:00, run_start_date=2024-05-11 01:49:00.710062+00:00, run_end_date=2024-05-11 01:49:02.965730+00:00, run_duration=2.255668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:48:00+00:00, data_interval_end=2024-05-11 01:49:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:49:02.986320733Z [2024-05-11T01:49:02.985+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:49:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:49:03.055035242Z [2024-05-11T01:49:03.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status success for try_number 1 2024-05-11T01:49:03.061870210Z [2024-05-11T01:49:03.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:48:00+00:00, map_index=-1, run_start_date=2024-05-11 01:49:01.688690+00:00, run_end_date=2024-05-11 01:49:02.045395+00:00, run_duration=0.356705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:49:00.759334+00:00, queued_by_job_id=2, pid=13043 2024-05-11T01:49:05.225811716Z [2024-05-11T01:49:05.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:49:05.225924226Z [2024-05-11T01:49:05.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:48:00+00:00, run_id=scheduled__2024-05-11T01:48:00+00:00, run_start_date=2024-05-11 01:49:00.711359+00:00, run_end_date=2024-05-11 01:49:05.225673+00:00, run_duration=4.514314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:48:00+00:00, data_interval_end=2024-05-11 01:49:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:49:05.234600877Z [2024-05-11T01:49:05.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:49:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:49:05.247203534Z [2024-05-11T01:49:05.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:49:05.247258168Z [2024-05-11T01:49:05.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:48:00+00:00, run_id=scheduled__2024-05-11T01:48:00+00:00, run_start_date=2024-05-11 01:49:00.712437+00:00, run_end_date=2024-05-11 01:49:05.247022+00:00, run_duration=4.534585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:48:00+00:00, data_interval_end=2024-05-11 01:49:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:49:05.256246900Z [2024-05-11T01:49:05.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:49:00+00:00, run_after=2024-05-11T01:50:00+00:00 2024-05-11T01:49:05.295959726Z [2024-05-11T01:49:05.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status success for try_number 1 2024-05-11T01:49:05.295999702Z [2024-05-11T01:49:05.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status success for try_number 1 2024-05-11T01:49:05.302909419Z [2024-05-11T01:49:05.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:48:00+00:00, map_index=-1, run_start_date=2024-05-11 01:49:02.550360+00:00, run_end_date=2024-05-11 01:49:04.110021+00:00, run_duration=1.559661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:49:00.759334+00:00, queued_by_job_id=2, pid=13061 2024-05-11T01:49:05.302952056Z [2024-05-11T01:49:05.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:48:00+00:00, map_index=-1, run_start_date=2024-05-11 01:49:02.713845+00:00, run_end_date=2024-05-11 01:49:04.591525+00:00, run_duration=1.87768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:49:00.759334+00:00, queued_by_job_id=2, pid=13062 2024-05-11T01:50:01.053931956Z [2024-05-11T01:50:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:51:00+00:00 2024-05-11T01:50:01.076344562Z [2024-05-11T01:50:01.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:50:01.083629427Z [2024-05-11T01:50:01.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:50:01.101407979Z [2024-05-11T01:50:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:50:01.115016129Z [2024-05-11T01:50:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:51:00+00:00 2024-05-11T01:50:01.202530645Z [2024-05-11T01:50:01.202+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T01:50:01.202556874Z 2024-05-11T01:50:01.202560793Z 2024-05-11T01:50:01.202578160Z 2024-05-11T01:50:01.202581706Z 2024-05-11T01:50:01.202584835Z 2024-05-11T01:50:01.202594120Z [2024-05-11T01:50:01.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:50:01.202605699Z [2024-05-11T01:50:01.202+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:50:01.202731884Z [2024-05-11T01:50:01.202+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:50:01.202849801Z [2024-05-11T01:50:01.202+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:50:01.202943539Z [2024-05-11T01:50:01.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:50:01.203611304Z [2024-05-11T01:50:01.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:50:01.203619064Z 2024-05-11T01:50:01.203622522Z 2024-05-11T01:50:01.203625853Z 2024-05-11T01:50:01.203628958Z 2024-05-11T01:50:01.203632068Z 2024-05-11T01:50:01.207755830Z [2024-05-11T01:50:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:50:01.207801653Z [2024-05-11T01:50:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:50:01.208048671Z [2024-05-11T01:50:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:50:01.208113159Z [2024-05-11T01:50:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:50:01.208320631Z [2024-05-11T01:50:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:50:01.208365857Z [2024-05-11T01:50:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:50:01.208551738Z [2024-05-11T01:50:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:50:01.208606329Z [2024-05-11T01:50:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:50:01.208781493Z [2024-05-11T01:50:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:50:01.208846482Z [2024-05-11T01:50:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:50:01.652414022Z [2024-05-11T01:50:01.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:01.652440453Z [2024-05-11T01:50:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:01.652445625Z [2024-05-11T01:50:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:49:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:01.652449065Z [2024-05-11T01:50:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:49:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:01.652452319Z [2024-05-11T01:50:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:49:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:01.671908149Z [2024-05-11T01:50:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5e9f80c-b68a-4f94-9805-643da2cb37f6 2024-05-11T01:50:01.671930889Z [2024-05-11T01:50:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f1d86a9-48f2-4149-a4f3-6dbcad187644 2024-05-11T01:50:01.671934529Z [2024-05-11T01:50:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80e5fcea-a69d-4193-8dbc-80a057fdd3af 2024-05-11T01:50:01.671967758Z [2024-05-11T01:50:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34bd971d-142a-4c18-b001-9f53a8c94657 2024-05-11T01:50:01.671971224Z [2024-05-11T01:50:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to a830a6f8-026d-4447-a811-c58f277d3fc3 2024-05-11T01:50:03.390139269Z [2024-05-11T01:50:03.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:50:03.390408257Z [2024-05-11T01:50:03.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:48:00+00:00, run_id=scheduled__2024-05-11T01:48:00+00:00, run_start_date=2024-05-11 01:50:01.127367+00:00, run_end_date=2024-05-11 01:50:03.390061+00:00, run_duration=2.262694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:48:00+00:00, data_interval_end=2024-05-11 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:50:03.398776342Z [2024-05-11T01:50:03.398+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:52:00+00:00 2024-05-11T01:50:03.414456821Z [2024-05-11T01:50:03.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:50:03.414481806Z [2024-05-11T01:50:03.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:49:00+00:00, run_id=scheduled__2024-05-11T01:49:00+00:00, run_start_date=2024-05-11 01:50:01.128720+00:00, run_end_date=2024-05-11 01:50:03.413791+00:00, run_duration=2.285071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:49:00+00:00, data_interval_end=2024-05-11 01:50:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:50:03.432731066Z [2024-05-11T01:50:03.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:51:00+00:00 2024-05-11T01:50:03.506371710Z [2024-05-11T01:50:03.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:48:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:03.506387312Z [2024-05-11T01:50:03.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:49:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:03.527304610Z [2024-05-11T01:50:03.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:49:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:02.129227+00:00, run_end_date=2024-05-11 01:50:02.604498+00:00, run_duration=0.475271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:01.204765+00:00, queued_by_job_id=2, pid=13097 2024-05-11T01:50:03.529630457Z [2024-05-11T01:50:03.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:48:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:02.431161+00:00, run_end_date=2024-05-11 01:50:02.857983+00:00, run_duration=0.426822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:01.204765+00:00, queued_by_job_id=2, pid=13098 2024-05-11T01:50:04.622726742Z [2024-05-11T01:50:04.622+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:50:04.622760605Z 2024-05-11T01:50:04.622859091Z [2024-05-11T01:50:04.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:50:04.626074011Z [2024-05-11T01:50:04.623+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:50:04.626096194Z 2024-05-11T01:50:04.628992356Z [2024-05-11T01:50:04.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:50:04.629161821Z [2024-05-11T01:50:04.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:50:04.700079497Z [2024-05-11T01:50:04.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:04.700168715Z [2024-05-11T01:50:04.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:04.711463688Z [2024-05-11T01:50:04.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfd93475-4d54-4e78-8203-192262667e4a 2024-05-11T01:50:04.711865517Z [2024-05-11T01:50:04.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:03.397184+00:00, run_end_date=2024-05-11 01:50:03.780689+00:00, run_duration=0.383505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:01.204765+00:00, queued_by_job_id=2, pid=13122 2024-05-11T01:50:04.757841828Z [2024-05-11T01:50:04.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:50:04.758188014Z [2024-05-11T01:50:04.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:49:00+00:00, run_id=scheduled__2024-05-11T01:49:00+00:00, run_start_date=2024-05-11 01:50:01.129752+00:00, run_end_date=2024-05-11 01:50:04.757763+00:00, run_duration=3.628011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:49:00+00:00, data_interval_end=2024-05-11 01:50:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:50:04.767225225Z [2024-05-11T01:50:04.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:51:00+00:00 2024-05-11T01:50:05.876392440Z [2024-05-11T01:50:05.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:50:05.876709700Z [2024-05-11T01:50:05.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:49:00+00:00, run_id=scheduled__2024-05-11T01:49:00+00:00, run_start_date=2024-05-11 01:50:01.130961+00:00, run_end_date=2024-05-11 01:50:05.876393+00:00, run_duration=4.745432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:49:00+00:00, data_interval_end=2024-05-11 01:50:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:50:05.886783909Z [2024-05-11T01:50:05.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:51:00+00:00 2024-05-11T01:50:05.940593024Z [2024-05-11T01:50:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:49:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:05.940827181Z [2024-05-11T01:50:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:49:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:05.947361387Z [2024-05-11T01:50:05.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:49:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:03.562836+00:00, run_end_date=2024-05-11 01:50:04.726885+00:00, run_duration=1.164049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:01.204765+00:00, queued_by_job_id=2, pid=13128 2024-05-11T01:50:05.947676603Z [2024-05-11T01:50:05.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:49:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:03.692415+00:00, run_end_date=2024-05-11 01:50:05.319709+00:00, run_duration=1.627294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:01.204765+00:00, queued_by_job_id=2, pid=13129 2024-05-11T01:50:07.033936707Z [2024-05-11T01:50:07.033+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:50:07.033967486Z 2024-05-11T01:50:07.035284513Z [2024-05-11T01:50:07.033+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:50:07.036633844Z [2024-05-11T01:50:07.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:50:07.036660905Z 2024-05-11T01:50:07.039604345Z [2024-05-11T01:50:07.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:50:07.041377281Z [2024-05-11T01:50:07.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:50:07.093726961Z [2024-05-11T01:50:07.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:07.094009795Z [2024-05-11T01:50:07.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:07.099596700Z [2024-05-11T01:50:07.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1cabfd6-ad88-4bff-b756-26a47563cfd6 2024-05-11T01:50:07.099970562Z [2024-05-11T01:50:07.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:06.394456+00:00, run_end_date=2024-05-11 01:50:06.712787+00:00, run_duration=0.318331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:04.626463+00:00, queued_by_job_id=2, pid=13162 2024-05-11T01:50:09.362152913Z [2024-05-11T01:50:09.361+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:50:09.362206756Z 2024-05-11T01:50:09.362423678Z [2024-05-11T01:50:09.362+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:50:09.363025499Z [2024-05-11T01:50:09.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:50:09.363038396Z 2024-05-11T01:50:09.365534689Z [2024-05-11T01:50:09.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:50:09.365805621Z [2024-05-11T01:50:09.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:50:09.417667999Z [2024-05-11T01:50:09.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status queued for try_number 1 2024-05-11T01:50:09.418041397Z [2024-05-11T01:50:09.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:09.423816606Z [2024-05-11T01:50:09.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebd7a17a-3f51-4db2-a43f-eb95bc8a88c5 2024-05-11T01:50:09.424163085Z [2024-05-11T01:50:09.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=0, run_start_date=2024-05-11 01:50:08.740630+00:00, run_end_date=2024-05-11 01:50:09.067404+00:00, run_duration=0.326774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:07.037239+00:00, queued_by_job_id=2, pid=13173 2024-05-11T01:50:12.178173266Z [2024-05-11T01:50:12.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:50:12.178437039Z [2024-05-11T01:50:12.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:45:00+00:00, run_id=scheduled__2024-05-11T01:45:00+00:00, run_start_date=2024-05-11 01:50:01.125940+00:00, run_end_date=2024-05-11 01:50:12.178100+00:00, run_duration=11.05216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:45:00+00:00, data_interval_end=2024-05-11 01:50:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:50:12.185276546Z [2024-05-11T01:50:12.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:50:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:50:12.231424952Z [2024-05-11T01:50:12.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:45:00+00:00 exited with status success for try_number 1 2024-05-11T01:50:12.238778421Z [2024-05-11T01:50:12.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:45:00+00:00, map_index=-1, run_start_date=2024-05-11 01:50:11.034885+00:00, run_end_date=2024-05-11 01:50:11.402580+00:00, run_duration=0.367695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:50:09.363528+00:00, queued_by_job_id=2, pid=13181 2024-05-11T01:50:35.938112656Z [2024-05-11T01:50:35.937+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:51:00.393632457Z [2024-05-11T01:51:00.393+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:51:00.407653731Z [2024-05-11T01:51:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:51:00+00:00, run_after=2024-05-11T01:52:00+00:00 2024-05-11T01:51:00.420308471Z [2024-05-11T01:51:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:51:00+00:00, run_after=2024-05-11T01:52:00+00:00 2024-05-11T01:51:00.485195835Z [2024-05-11T01:51:00.484+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:51:00.485236484Z 2024-05-11T01:51:00.485243478Z 2024-05-11T01:51:00.485249870Z 2024-05-11T01:51:00.485659489Z [2024-05-11T01:51:00.485+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:51:00.486090266Z [2024-05-11T01:51:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:51:00.486352867Z [2024-05-11T01:51:00.486+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:51:00.487656091Z [2024-05-11T01:51:00.487+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:51:00.487686880Z 2024-05-11T01:51:00.487693577Z 2024-05-11T01:51:00.487699332Z 2024-05-11T01:51:00.494955615Z [2024-05-11T01:51:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:51:00.495076864Z [2024-05-11T01:51:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:51:00.495434725Z [2024-05-11T01:51:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:51:00.495551661Z [2024-05-11T01:51:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:51:00.495875673Z [2024-05-11T01:51:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:51:00.495996896Z [2024-05-11T01:51:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:51:00.755862431Z [2024-05-11T01:51:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:51:00.755901293Z [2024-05-11T01:51:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:51:00.755913787Z [2024-05-11T01:51:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:51:00.782981262Z [2024-05-11T01:51:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b9c535-52f2-4681-acc9-30ec1bc0e97f 2024-05-11T01:51:00.783019250Z [2024-05-11T01:51:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 527bcd73-7558-49d5-9fc0-1c1f23d4f15f 2024-05-11T01:51:00.783136306Z [2024-05-11T01:51:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c19f4e0-eb6a-419f-ba18-9b6ccea0c40b 2024-05-11T01:51:01.919278229Z [2024-05-11T01:51:01.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:51:01.919505522Z [2024-05-11T01:51:01.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:50:00+00:00, run_id=scheduled__2024-05-11T01:50:00+00:00, run_start_date=2024-05-11 01:51:00.429736+00:00, run_end_date=2024-05-11 01:51:01.919055+00:00, run_duration=1.489319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:50:00+00:00, data_interval_end=2024-05-11 01:51:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:51:01.941748540Z [2024-05-11T01:51:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:51:00+00:00, run_after=2024-05-11T01:52:00+00:00 2024-05-11T01:51:02.016741153Z [2024-05-11T01:51:02.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:51:02.022404992Z [2024-05-11T01:51:02.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:51:01.240971+00:00, run_end_date=2024-05-11 01:51:01.663105+00:00, run_duration=0.422134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:51:00.490108+00:00, queued_by_job_id=2, pid=13190 2024-05-11T01:51:05.138857971Z [2024-05-11T01:51:05.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:51:05.139285145Z [2024-05-11T01:51:05.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:50:00+00:00, run_id=scheduled__2024-05-11T01:50:00+00:00, run_start_date=2024-05-11 01:51:00.430973+00:00, run_end_date=2024-05-11 01:51:05.138694+00:00, run_duration=4.707721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:50:00+00:00, data_interval_end=2024-05-11 01:51:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:51:05.152477730Z [2024-05-11T01:51:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:51:00+00:00, run_after=2024-05-11T01:52:00+00:00 2024-05-11T01:51:05.205189395Z [2024-05-11T01:51:05.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:51:05.211885841Z [2024-05-11T01:51:05.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:51:02.284064+00:00, run_end_date=2024-05-11 01:51:04.633734+00:00, run_duration=2.34967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:51:00.490108+00:00, queued_by_job_id=2, pid=13208 2024-05-11T01:51:06.247369882Z [2024-05-11T01:51:06.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:51:06.247806929Z [2024-05-11T01:51:06.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:50:00+00:00, run_id=scheduled__2024-05-11T01:50:00+00:00, run_start_date=2024-05-11 01:51:00.431979+00:00, run_end_date=2024-05-11 01:51:06.247277+00:00, run_duration=5.815298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:50:00+00:00, data_interval_end=2024-05-11 01:51:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:51:06.256354623Z [2024-05-11T01:51:06.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:51:00+00:00, run_after=2024-05-11T01:52:00+00:00 2024-05-11T01:51:06.284887543Z [2024-05-11T01:51:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:51:06.289843474Z [2024-05-11T01:51:06.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:51:02.337667+00:00, run_end_date=2024-05-11 01:51:05.409545+00:00, run_duration=3.071878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:51:00.490108+00:00, queued_by_job_id=2, pid=13209 2024-05-11T01:52:01.082808842Z [2024-05-11T01:52:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:52:00+00:00, run_after=2024-05-11T01:53:00+00:00 2024-05-11T01:52:01.097641658Z [2024-05-11T01:52:01.097+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:52:01.111417762Z [2024-05-11T01:52:01.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:52:00+00:00, run_after=2024-05-11T01:53:00+00:00 2024-05-11T01:52:01.119562318Z [2024-05-11T01:52:01.119+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:52:01.274212915Z [2024-05-11T01:52:01.273+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:52:01.274241321Z 2024-05-11T01:52:01.274245956Z 2024-05-11T01:52:01.274249503Z 2024-05-11T01:52:01.274253006Z 2024-05-11T01:52:01.274464860Z [2024-05-11T01:52:01.274+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:52:01.274649048Z [2024-05-11T01:52:01.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:52:01.274829684Z [2024-05-11T01:52:01.274+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:52:01.275009371Z [2024-05-11T01:52:01.274+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:52:01.275668279Z [2024-05-11T01:52:01.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:52:01.275675532Z 2024-05-11T01:52:01.275679225Z 2024-05-11T01:52:01.275682817Z 2024-05-11T01:52:01.275686181Z 2024-05-11T01:52:01.279481503Z [2024-05-11T01:52:01.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:52:01.279724697Z [2024-05-11T01:52:01.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:52:01.280048318Z [2024-05-11T01:52:01.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:52:01.280245639Z [2024-05-11T01:52:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:52:01.280528032Z [2024-05-11T01:52:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:52:01.280720998Z [2024-05-11T01:52:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:52:01.281017515Z [2024-05-11T01:52:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:52:01.281221199Z [2024-05-11T01:52:01.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:52:02.099600369Z [2024-05-11T01:52:02.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:52:02.099657724Z [2024-05-11T01:52:02.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:51:00+00:00 exited with status queued for try_number 1 2024-05-11T01:52:02.101169683Z [2024-05-11T01:52:02.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:51:00+00:00 exited with status queued for try_number 1 2024-05-11T01:52:02.101185042Z [2024-05-11T01:52:02.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:51:00+00:00 exited with status queued for try_number 1 2024-05-11T01:52:02.141944933Z [2024-05-11T01:52:02.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to f98f9be2-b760-495d-8006-58948a4c97bc 2024-05-11T01:52:02.141967009Z [2024-05-11T01:52:02.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99badaf7-ee58-4b4b-8fb1-9f6b26b9ed0d 2024-05-11T01:52:02.141971021Z [2024-05-11T01:52:02.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd0a73ff-2a4b-4871-ba31-5a8b114f993c 2024-05-11T01:52:02.141975081Z [2024-05-11T01:52:02.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40b26e6f-6297-4878-8d8f-c6676d84cbf3 2024-05-11T01:52:03.870548002Z [2024-05-11T01:52:03.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:52:03.870872796Z [2024-05-11T01:52:03.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:51:00+00:00, run_id=scheduled__2024-05-11T01:51:00+00:00, run_start_date=2024-05-11 01:52:01.131225+00:00, run_end_date=2024-05-11 01:52:03.870464+00:00, run_duration=2.739239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:51:00+00:00, data_interval_end=2024-05-11 01:52:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:52:03.882425629Z [2024-05-11T01:52:03.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:52:00+00:00, run_after=2024-05-11T01:53:00+00:00 2024-05-11T01:52:03.890785689Z [2024-05-11T01:52:03.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:52:03.890943644Z [2024-05-11T01:52:03.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:50:00+00:00, run_id=scheduled__2024-05-11T01:50:00+00:00, run_start_date=2024-05-11 01:52:01.129998+00:00, run_end_date=2024-05-11 01:52:03.890686+00:00, run_duration=2.760688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:50:00+00:00, data_interval_end=2024-05-11 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:52:03.900791099Z [2024-05-11T01:52:03.900+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:52:00+00:00, run_after=2024-05-11T01:54:00+00:00 2024-05-11T01:52:03.946780850Z [2024-05-11T01:52:03.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:52:03.946820280Z [2024-05-11T01:52:03.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:51:00+00:00 exited with status success for try_number 1 2024-05-11T01:52:03.956887044Z [2024-05-11T01:52:03.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:51:00+00:00, map_index=-1, run_start_date=2024-05-11 01:52:02.702657+00:00, run_end_date=2024-05-11 01:52:03.258535+00:00, run_duration=0.555878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:52:01.276616+00:00, queued_by_job_id=2, pid=13242 2024-05-11T01:52:03.957633462Z [2024-05-11T01:52:03.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:52:02.490765+00:00, run_end_date=2024-05-11 01:52:02.944392+00:00, run_duration=0.453627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:52:01.276616+00:00, queued_by_job_id=2, pid=13241 2024-05-11T01:52:06.161025667Z [2024-05-11T01:52:06.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:52:06.161501288Z [2024-05-11T01:52:06.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:51:00+00:00, run_id=scheduled__2024-05-11T01:51:00+00:00, run_start_date=2024-05-11 01:52:01.132348+00:00, run_end_date=2024-05-11 01:52:06.161182+00:00, run_duration=5.028834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:51:00+00:00, data_interval_end=2024-05-11 01:52:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:52:06.171824800Z [2024-05-11T01:52:06.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:52:00+00:00, run_after=2024-05-11T01:53:00+00:00 2024-05-11T01:52:06.184513490Z [2024-05-11T01:52:06.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:52:06.184918668Z [2024-05-11T01:52:06.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:51:00+00:00, run_id=scheduled__2024-05-11T01:51:00+00:00, run_start_date=2024-05-11 01:52:01.133318+00:00, run_end_date=2024-05-11 01:52:06.184532+00:00, run_duration=5.051214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:51:00+00:00, data_interval_end=2024-05-11 01:52:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:52:06.196189859Z [2024-05-11T01:52:06.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:52:00+00:00, run_after=2024-05-11T01:53:00+00:00 2024-05-11T01:52:06.232425394Z [2024-05-11T01:52:06.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:51:00+00:00 exited with status success for try_number 1 2024-05-11T01:52:06.232613099Z [2024-05-11T01:52:06.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:51:00+00:00 exited with status success for try_number 1 2024-05-11T01:52:06.238358297Z [2024-05-11T01:52:06.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:51:00+00:00, map_index=-1, run_start_date=2024-05-11 01:52:04.279014+00:00, run_end_date=2024-05-11 01:52:05.969833+00:00, run_duration=1.690819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:52:01.276616+00:00, queued_by_job_id=2, pid=13271 2024-05-11T01:52:06.238625001Z [2024-05-11T01:52:06.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:51:00+00:00, map_index=-1, run_start_date=2024-05-11 01:52:03.886686+00:00, run_end_date=2024-05-11 01:52:05.302612+00:00, run_duration=1.415926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:52:01.276616+00:00, queued_by_job_id=2, pid=13260 2024-05-11T01:53:00.843070315Z [2024-05-11T01:53:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:53:00+00:00, run_after=2024-05-11T01:54:00+00:00 2024-05-11T01:53:00.851415377Z [2024-05-11T01:53:00.850+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:53:00.873777197Z [2024-05-11T01:53:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:53:00+00:00, run_after=2024-05-11T01:54:00+00:00 2024-05-11T01:53:00.971955258Z [2024-05-11T01:53:00.971+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:53:00.971988420Z 2024-05-11T01:53:00.971995225Z 2024-05-11T01:53:00.972001105Z 2024-05-11T01:53:00.972089672Z [2024-05-11T01:53:00.971+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:53:00.972611545Z [2024-05-11T01:53:00.972+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:53:00.973036622Z [2024-05-11T01:53:00.972+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:53:00.975300084Z [2024-05-11T01:53:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:53:00.975337432Z 2024-05-11T01:53:00.975346314Z 2024-05-11T01:53:00.975354100Z 2024-05-11T01:53:00.982633874Z [2024-05-11T01:53:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:53:00.982949919Z [2024-05-11T01:53:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:53:00.983550113Z [2024-05-11T01:53:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:53:00.983760111Z [2024-05-11T01:53:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:53:00.984181634Z [2024-05-11T01:53:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:53:00.984542574Z [2024-05-11T01:53:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:53:01.453648174Z [2024-05-11T01:53:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status queued for try_number 1 2024-05-11T01:53:01.453787093Z [2024-05-11T01:53:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status queued for try_number 1 2024-05-11T01:53:01.453939995Z [2024-05-11T01:53:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status queued for try_number 1 2024-05-11T01:53:01.462268449Z [2024-05-11T01:53:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 221e8ccc-5c0a-44a1-830e-8f69a2ef4c53 2024-05-11T01:53:01.462333512Z [2024-05-11T01:53:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47fec02a-f4c5-4b72-bd5b-6c551de655e2 2024-05-11T01:53:01.462430303Z [2024-05-11T01:53:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56b3630e-100b-4f0d-a1c1-5b5c1826f4d7 2024-05-11T01:53:03.354327594Z [2024-05-11T01:53:03.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:53:03.354670082Z [2024-05-11T01:53:03.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:52:00+00:00, run_id=scheduled__2024-05-11T01:52:00+00:00, run_start_date=2024-05-11 01:53:00.889511+00:00, run_end_date=2024-05-11 01:53:03.354302+00:00, run_duration=2.464791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:52:00+00:00, data_interval_end=2024-05-11 01:53:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:53:03.365561957Z [2024-05-11T01:53:03.365+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:53:00+00:00, run_after=2024-05-11T01:54:00+00:00 2024-05-11T01:53:03.424680154Z [2024-05-11T01:53:03.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status success for try_number 1 2024-05-11T01:53:03.432063429Z [2024-05-11T01:53:03.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:52:00+00:00, map_index=-1, run_start_date=2024-05-11 01:53:01.940355+00:00, run_end_date=2024-05-11 01:53:02.446751+00:00, run_duration=0.506396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:53:00.977286+00:00, queued_by_job_id=2, pid=13297 2024-05-11T01:53:04.864885775Z [2024-05-11T01:53:04.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:53:04.865139986Z [2024-05-11T01:53:04.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:52:00+00:00, run_id=scheduled__2024-05-11T01:52:00+00:00, run_start_date=2024-05-11 01:53:00.891047+00:00, run_end_date=2024-05-11 01:53:04.864658+00:00, run_duration=3.973611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:52:00+00:00, data_interval_end=2024-05-11 01:53:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:53:04.878137497Z [2024-05-11T01:53:04.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:53:00+00:00, run_after=2024-05-11T01:54:00+00:00 2024-05-11T01:53:04.884247580Z [2024-05-11T01:53:04.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:53:04.884472590Z [2024-05-11T01:53:04.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:52:00+00:00, run_id=scheduled__2024-05-11T01:52:00+00:00, run_start_date=2024-05-11 01:53:00.892473+00:00, run_end_date=2024-05-11 01:53:04.884123+00:00, run_duration=3.99165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:52:00+00:00, data_interval_end=2024-05-11 01:53:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:53:04.896659902Z [2024-05-11T01:53:04.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:53:00+00:00, run_after=2024-05-11T01:54:00+00:00 2024-05-11T01:53:04.954528925Z [2024-05-11T01:53:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status success for try_number 1 2024-05-11T01:53:04.955182560Z [2024-05-11T01:53:04.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status success for try_number 1 2024-05-11T01:53:04.969411576Z [2024-05-11T01:53:04.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:52:00+00:00, map_index=-1, run_start_date=2024-05-11 01:53:02.834581+00:00, run_end_date=2024-05-11 01:53:04.482413+00:00, run_duration=1.647832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:53:00.977286+00:00, queued_by_job_id=2, pid=13315 2024-05-11T01:53:04.970195097Z [2024-05-11T01:53:04.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:52:00+00:00, map_index=-1, run_start_date=2024-05-11 01:53:03.051495+00:00, run_end_date=2024-05-11 01:53:04.599738+00:00, run_duration=1.548243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:53:00.977286+00:00, queued_by_job_id=2, pid=13316 2024-05-11T01:54:00.817148623Z [2024-05-11T01:54:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:54:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:54:00.828244767Z [2024-05-11T01:54:00.827+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:54:00.837440636Z [2024-05-11T01:54:00.837+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:54:00.853001901Z [2024-05-11T01:54:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:54:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:54:00.945521125Z [2024-05-11T01:54:00.944+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:54:00.945558608Z 2024-05-11T01:54:00.945568911Z 2024-05-11T01:54:00.945577707Z 2024-05-11T01:54:00.945586383Z 2024-05-11T01:54:00.945803202Z [2024-05-11T01:54:00.945+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:54:00.946123473Z [2024-05-11T01:54:00.945+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:54:00.946393315Z [2024-05-11T01:54:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:54:00.946640859Z [2024-05-11T01:54:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:54:00.947806143Z [2024-05-11T01:54:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:54:00.947827391Z 2024-05-11T01:54:00.947836423Z 2024-05-11T01:54:00.947844867Z 2024-05-11T01:54:00.947853314Z 2024-05-11T01:54:00.954896263Z [2024-05-11T01:54:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:54:00.955102372Z [2024-05-11T01:54:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:54:00.955430950Z [2024-05-11T01:54:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:54:00.955541365Z [2024-05-11T01:54:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:54:00.956018439Z [2024-05-11T01:54:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:54:00.956324474Z [2024-05-11T01:54:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:54:00.956697262Z [2024-05-11T01:54:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:54:00.957048201Z [2024-05-11T01:54:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:54:01.522085050Z [2024-05-11T01:54:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status queued for try_number 1 2024-05-11T01:54:01.522134124Z [2024-05-11T01:54:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:53:00+00:00 exited with status queued for try_number 1 2024-05-11T01:54:01.522199523Z [2024-05-11T01:54:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:53:00+00:00 exited with status queued for try_number 1 2024-05-11T01:54:01.522264165Z [2024-05-11T01:54:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:53:00+00:00 exited with status queued for try_number 1 2024-05-11T01:54:01.536708313Z [2024-05-11T01:54:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31a2d588-5f5a-4698-89f1-bc8e55672d4d 2024-05-11T01:54:01.536764855Z [2024-05-11T01:54:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cdf5611-f644-4505-af68-fd8f9fa4f9b7 2024-05-11T01:54:01.536870829Z [2024-05-11T01:54:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96a55567-8ed7-460a-bd40-aba161177f8d 2024-05-11T01:54:01.536990070Z [2024-05-11T01:54:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a1f55a6-d163-4af3-ba21-20c589763990 2024-05-11T01:54:02.739721131Z [2024-05-11T01:54:02.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:54:02.740214141Z [2024-05-11T01:54:02.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:52:00+00:00, run_id=scheduled__2024-05-11T01:52:00+00:00, run_start_date=2024-05-11 01:54:00.864426+00:00, run_end_date=2024-05-11 01:54:02.739610+00:00, run_duration=1.875184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:52:00+00:00, data_interval_end=2024-05-11 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:54:02.754824040Z [2024-05-11T01:54:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:54:00+00:00, run_after=2024-05-11T01:56:00+00:00 2024-05-11T01:54:02.764453672Z [2024-05-11T01:54:02.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:54:02.764667571Z [2024-05-11T01:54:02.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:53:00+00:00, run_id=scheduled__2024-05-11T01:53:00+00:00, run_start_date=2024-05-11 01:54:00.865672+00:00, run_end_date=2024-05-11 01:54:02.764289+00:00, run_duration=1.898617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:53:00+00:00, data_interval_end=2024-05-11 01:54:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:54:02.776032109Z [2024-05-11T01:54:02.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:54:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:54:02.833833348Z [2024-05-11T01:54:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:52:00+00:00 exited with status success for try_number 1 2024-05-11T01:54:02.833878723Z [2024-05-11T01:54:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:53:00+00:00 exited with status success for try_number 1 2024-05-11T01:54:02.844221508Z [2024-05-11T01:54:02.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:53:00+00:00, map_index=-1, run_start_date=2024-05-11 01:54:02.201695+00:00, run_end_date=2024-05-11 01:54:02.590276+00:00, run_duration=0.388581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:54:00.949373+00:00, queued_by_job_id=2, pid=13355 2024-05-11T01:54:02.844653172Z [2024-05-11T01:54:02.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:52:00+00:00, map_index=-1, run_start_date=2024-05-11 01:54:01.748830+00:00, run_end_date=2024-05-11 01:54:02.052326+00:00, run_duration=0.303496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:54:00.949373+00:00, queued_by_job_id=2, pid=13344 2024-05-11T01:54:06.630588808Z [2024-05-11T01:54:06.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:54:06.631024372Z [2024-05-11T01:54:06.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:53:00+00:00, run_id=scheduled__2024-05-11T01:53:00+00:00, run_start_date=2024-05-11 01:54:00.866788+00:00, run_end_date=2024-05-11 01:54:06.630671+00:00, run_duration=5.763883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:53:00+00:00, data_interval_end=2024-05-11 01:54:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:54:06.643367075Z [2024-05-11T01:54:06.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:54:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:54:06.661287815Z [2024-05-11T01:54:06.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:54:06.661676419Z [2024-05-11T01:54:06.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:53:00+00:00, run_id=scheduled__2024-05-11T01:53:00+00:00, run_start_date=2024-05-11 01:54:00.868073+00:00, run_end_date=2024-05-11 01:54:06.661333+00:00, run_duration=5.79326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:53:00+00:00, data_interval_end=2024-05-11 01:54:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:54:06.671225863Z [2024-05-11T01:54:06.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:54:00+00:00, run_after=2024-05-11T01:55:00+00:00 2024-05-11T01:54:06.710842175Z [2024-05-11T01:54:06.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:53:00+00:00 exited with status success for try_number 1 2024-05-11T01:54:06.717325483Z [2024-05-11T01:54:06.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:53:00+00:00, map_index=-1, run_start_date=2024-05-11 01:54:03.288542+00:00, run_end_date=2024-05-11 01:54:06.209558+00:00, run_duration=2.921016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:54:00.949373+00:00, queued_by_job_id=2, pid=13374 2024-05-11T01:54:07.835995667Z [2024-05-11T01:54:07.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:53:00+00:00 exited with status success for try_number 1 2024-05-11T01:54:07.841918557Z [2024-05-11T01:54:07.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:53:00+00:00, map_index=-1, run_start_date=2024-05-11 01:54:03.266831+00:00, run_end_date=2024-05-11 01:54:06.548920+00:00, run_duration=3.282089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:54:00.949373+00:00, queued_by_job_id=2, pid=13373 2024-05-11T01:55:00.700688490Z [2024-05-11T01:55:00.700+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T01:56:00+00:00 2024-05-11T01:55:00.719093430Z [2024-05-11T01:55:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:55:00.740009818Z [2024-05-11T01:55:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T01:56:00+00:00 2024-05-11T01:55:00.750582014Z [2024-05-11T01:55:00.750+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:55:00.833824356Z [2024-05-11T01:55:00.833+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:55:00.833883389Z 2024-05-11T01:55:00.833892505Z 2024-05-11T01:55:00.833897151Z 2024-05-11T01:55:00.833902521Z 2024-05-11T01:55:00.834000660Z [2024-05-11T01:55:00.833+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:55:00.834048473Z [2024-05-11T01:55:00.833+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:55:00.834063916Z [2024-05-11T01:55:00.833+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:55:00.834096300Z [2024-05-11T01:55:00.834+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:55:00.834766547Z [2024-05-11T01:55:00.834+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:55:00.834783290Z 2024-05-11T01:55:00.834790159Z 2024-05-11T01:55:00.834795735Z 2024-05-11T01:55:00.834800766Z 2024-05-11T01:55:00.838556671Z [2024-05-11T01:55:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T01:55:00.838648161Z [2024-05-11T01:55:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:55:00.838820818Z [2024-05-11T01:55:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:55:00.838886377Z [2024-05-11T01:55:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:55:00.839091165Z [2024-05-11T01:55:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:55:00.839157543Z [2024-05-11T01:55:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:55:00.839292162Z [2024-05-11T01:55:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:55:00.839360735Z [2024-05-11T01:55:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:55:01.363381960Z [2024-05-11T01:55:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:01.363459133Z [2024-05-11T01:55:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:01.363595030Z [2024-05-11T01:55:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:01.363683947Z [2024-05-11T01:55:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:01.379362235Z [2024-05-11T01:55:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e9e8c12-9ba4-4c4a-a957-768775b3b902 2024-05-11T01:55:01.380243167Z [2024-05-11T01:55:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9a2f2a7-2f4f-4436-bd69-f62a0dbcbe87 2024-05-11T01:55:01.380492837Z [2024-05-11T01:55:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to d35f279c-dca2-40c2-a894-4ac145167338 2024-05-11T01:55:01.380671865Z [2024-05-11T01:55:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a545681-6130-4795-b166-8f12eb34dbab 2024-05-11T01:55:02.617037470Z [2024-05-11T01:55:02.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:55:02.617622562Z [2024-05-11T01:55:02.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:54:00+00:00, run_id=scheduled__2024-05-11T01:54:00+00:00, run_start_date=2024-05-11 01:55:00.769716+00:00, run_end_date=2024-05-11 01:55:02.617247+00:00, run_duration=1.847531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:54:00+00:00, data_interval_end=2024-05-11 01:55:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:55:02.628605632Z [2024-05-11T01:55:02.628+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T01:56:00+00:00 2024-05-11T01:55:02.684140800Z [2024-05-11T01:55:02.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:02.695596084Z [2024-05-11T01:55:02.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:54:00+00:00, map_index=-1, run_start_date=2024-05-11 01:55:01.932491+00:00, run_end_date=2024-05-11 01:55:02.388059+00:00, run_duration=0.455568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:00.835496+00:00, queued_by_job_id=2, pid=13407 2024-05-11T01:55:03.996172298Z [2024-05-11T01:55:03.995+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:55:03.996198534Z 2024-05-11T01:55:03.996402895Z [2024-05-11T01:55:03.996+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:55:03.997059377Z [2024-05-11T01:55:03.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:55:03.997071117Z 2024-05-11T01:55:03.999480934Z [2024-05-11T01:55:03.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T01:55:03.999735117Z [2024-05-11T01:55:03.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:55:04.090057307Z [2024-05-11T01:55:04.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:04.095060324Z [2024-05-11T01:55:04.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d3af8ff-d242-4c3f-b26c-64b55fb8060a 2024-05-11T01:55:04.196704452Z [2024-05-11T01:55:04.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:04.205722125Z [2024-05-11T01:55:04.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:55:03.518778+00:00, run_end_date=2024-05-11 01:55:03.949737+00:00, run_duration=0.430959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:00.835496+00:00, queued_by_job_id=2, pid=13438 2024-05-11T01:55:05.261776469Z [2024-05-11T01:55:05.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:55:05.262064328Z [2024-05-11T01:55:05.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:54:00+00:00, run_id=scheduled__2024-05-11T01:54:00+00:00, run_start_date=2024-05-11 01:55:00.770763+00:00, run_end_date=2024-05-11 01:55:05.261692+00:00, run_duration=4.490929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:54:00+00:00, data_interval_end=2024-05-11 01:55:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:55:05.275217692Z [2024-05-11T01:55:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T01:56:00+00:00 2024-05-11T01:55:05.358508703Z [2024-05-11T01:55:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:05.368597583Z [2024-05-11T01:55:05.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:54:00+00:00, map_index=-1, run_start_date=2024-05-11 01:55:03.268436+00:00, run_end_date=2024-05-11 01:55:04.951560+00:00, run_duration=1.683124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:00.835496+00:00, queued_by_job_id=2, pid=13432 2024-05-11T01:55:06.412582063Z [2024-05-11T01:55:06.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:55:06.413103936Z [2024-05-11T01:55:06.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:54:00+00:00, run_id=scheduled__2024-05-11T01:54:00+00:00, run_start_date=2024-05-11 01:55:00.771726+00:00, run_end_date=2024-05-11 01:55:06.412501+00:00, run_duration=5.640775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:54:00+00:00, data_interval_end=2024-05-11 01:55:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:55:06.428193489Z [2024-05-11T01:55:06.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T01:56:00+00:00 2024-05-11T01:55:06.477983331Z [2024-05-11T01:55:06.477+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:55:06.478026473Z 2024-05-11T01:55:06.478303290Z [2024-05-11T01:55:06.477+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:55:06.479180345Z [2024-05-11T01:55:06.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:55:06.479196580Z 2024-05-11T01:55:06.482992391Z [2024-05-11T01:55:06.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T01:55:06.483140914Z [2024-05-11T01:55:06.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:55:06.570437567Z [2024-05-11T01:55:06.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:06.570482497Z [2024-05-11T01:55:06.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:06.570507788Z [2024-05-11T01:55:06.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:06.578270205Z [2024-05-11T01:55:06.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:55:05.708828+00:00, run_end_date=2024-05-11 01:55:06.048582+00:00, run_duration=0.339754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:03.997519+00:00, queued_by_job_id=2, pid=13466 2024-05-11T01:55:06.578343085Z [2024-05-11T01:55:06.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:54:00+00:00, map_index=-1, run_start_date=2024-05-11 01:55:03.055000+00:00, run_end_date=2024-05-11 01:55:06.116889+00:00, run_duration=3.061889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:00.835496+00:00, queued_by_job_id=2, pid=13426 2024-05-11T01:55:06.578525519Z [2024-05-11T01:55:06.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37badead-6c6b-45cc-bb8e-553ca9603fc5 2024-05-11T01:55:08.894233190Z [2024-05-11T01:55:08.893+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T01:55:08.894271794Z 2024-05-11T01:55:08.894704471Z [2024-05-11T01:55:08.894+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:55:08.895694487Z [2024-05-11T01:55:08.895+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:55:08.895706396Z 2024-05-11T01:55:08.898528358Z [2024-05-11T01:55:08.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:55:08.898906432Z [2024-05-11T01:55:08.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:55:08.950986332Z [2024-05-11T01:55:08.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status queued for try_number 1 2024-05-11T01:55:08.951279091Z [2024-05-11T01:55:08.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:08.961377115Z [2024-05-11T01:55:08.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dac61e3-1c3b-4f86-87b5-016d44c98589 2024-05-11T01:55:08.961512423Z [2024-05-11T01:55:08.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=0, run_start_date=2024-05-11 01:55:08.197289+00:00, run_end_date=2024-05-11 01:55:08.520217+00:00, run_duration=0.322928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:06.479810+00:00, queued_by_job_id=2, pid=13477 2024-05-11T01:55:11.159820188Z [2024-05-11T01:55:11.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:55:11.160106426Z [2024-05-11T01:55:11.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:50:00+00:00, run_id=scheduled__2024-05-11T01:50:00+00:00, run_start_date=2024-05-11 01:55:00.768112+00:00, run_end_date=2024-05-11 01:55:11.159796+00:00, run_duration=10.391684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:50:00+00:00, data_interval_end=2024-05-11 01:55:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T01:55:11.168602073Z [2024-05-11T01:55:11.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:55:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:55:11.207958898Z [2024-05-11T01:55:11.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:50:00+00:00 exited with status success for try_number 1 2024-05-11T01:55:11.212663159Z [2024-05-11T01:55:11.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:50:00+00:00, map_index=-1, run_start_date=2024-05-11 01:55:10.474196+00:00, run_end_date=2024-05-11 01:55:10.810091+00:00, run_duration=0.335895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:55:08.896235+00:00, queued_by_job_id=2, pid=13485 2024-05-11T01:55:36.019521335Z [2024-05-11T01:55:36.019+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T01:56:00.679125586Z [2024-05-11T01:56:00.678+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:56:00.693770266Z [2024-05-11T01:56:00.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:56:00+00:00, run_after=2024-05-11T01:57:00+00:00 2024-05-11T01:56:00.702047377Z [2024-05-11T01:56:00.701+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:56:00.714889075Z [2024-05-11T01:56:00.714+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:56:00+00:00, run_after=2024-05-11T01:57:00+00:00 2024-05-11T01:56:00.799144690Z [2024-05-11T01:56:00.798+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:56:00.799195976Z 2024-05-11T01:56:00.799205613Z 2024-05-11T01:56:00.799212779Z 2024-05-11T01:56:00.799220135Z 2024-05-11T01:56:00.799259316Z [2024-05-11T01:56:00.798+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:56:00.799281259Z [2024-05-11T01:56:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:56:00.799310789Z [2024-05-11T01:56:00.799+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:56:00.799574072Z [2024-05-11T01:56:00.799+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:56:00.800129817Z [2024-05-11T01:56:00.799+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:56:00.800145913Z 2024-05-11T01:56:00.800168638Z 2024-05-11T01:56:00.800176651Z 2024-05-11T01:56:00.800183968Z 2024-05-11T01:56:00.803770897Z [2024-05-11T01:56:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:56:00.803807387Z [2024-05-11T01:56:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:56:00.804083073Z [2024-05-11T01:56:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:56:00.804161607Z [2024-05-11T01:56:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:56:00.804329219Z [2024-05-11T01:56:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:56:00.804386470Z [2024-05-11T01:56:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:56:00.804666610Z [2024-05-11T01:56:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:56:00.804692840Z [2024-05-11T01:56:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:56:01.362022452Z [2024-05-11T01:56:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status queued for try_number 1 2024-05-11T01:56:01.362059865Z [2024-05-11T01:56:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:56:01.362075181Z [2024-05-11T01:56:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:56:01.362294009Z [2024-05-11T01:56:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T01:56:01.373083544Z [2024-05-11T01:56:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3c8886f-2a93-4f48-8038-6eb628cf3727 2024-05-11T01:56:01.374291878Z [2024-05-11T01:56:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac5a4654-4d1e-4011-8f33-5c7fc79c0813 2024-05-11T01:56:01.374570372Z [2024-05-11T01:56:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1877c5c-e673-4d81-b3ab-6268afe87abb 2024-05-11T01:56:01.374953324Z [2024-05-11T01:56:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bfd33bf-580a-452e-a926-c25815c774e7 2024-05-11T01:56:02.595095616Z [2024-05-11T01:56:02.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:56:02.595819726Z [2024-05-11T01:56:02.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:54:00+00:00, run_id=scheduled__2024-05-11T01:54:00+00:00, run_start_date=2024-05-11 01:56:00.730412+00:00, run_end_date=2024-05-11 01:56:02.595404+00:00, run_duration=1.864992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:54:00+00:00, data_interval_end=2024-05-11 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:56:02.603464145Z [2024-05-11T01:56:02.603+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:56:00+00:00, run_after=2024-05-11T01:58:00+00:00 2024-05-11T01:56:02.616784754Z [2024-05-11T01:56:02.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:56:02.617085388Z [2024-05-11T01:56:02.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:55:00+00:00, run_id=scheduled__2024-05-11T01:55:00+00:00, run_start_date=2024-05-11 01:56:00.731798+00:00, run_end_date=2024-05-11 01:56:02.616755+00:00, run_duration=1.884957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:55:00+00:00, data_interval_end=2024-05-11 01:56:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:56:02.627294627Z [2024-05-11T01:56:02.626+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:56:00+00:00, run_after=2024-05-11T01:57:00+00:00 2024-05-11T01:56:02.727129836Z [2024-05-11T01:56:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:56:02.737856195Z [2024-05-11T01:56:02.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=-1, run_start_date=2024-05-11 01:56:01.755097+00:00, run_end_date=2024-05-11 01:56:02.401993+00:00, run_duration=0.646896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:56:00.800926+00:00, queued_by_job_id=2, pid=13495 2024-05-11T01:56:03.646354019Z [2024-05-11T01:56:03.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:54:00+00:00 exited with status success for try_number 1 2024-05-11T01:56:03.652504452Z [2024-05-11T01:56:03.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:54:00+00:00, map_index=-1, run_start_date=2024-05-11 01:56:01.929419+00:00, run_end_date=2024-05-11 01:56:02.496961+00:00, run_duration=0.567542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:56:00.800926+00:00, queued_by_job_id=2, pid=13496 2024-05-11T01:56:05.502033093Z [2024-05-11T01:56:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:56:05.502554777Z [2024-05-11T01:56:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:55:00+00:00, run_id=scheduled__2024-05-11T01:55:00+00:00, run_start_date=2024-05-11 01:56:00.733388+00:00, run_end_date=2024-05-11 01:56:05.502176+00:00, run_duration=4.768788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:55:00+00:00, data_interval_end=2024-05-11 01:56:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:56:05.512203871Z [2024-05-11T01:56:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:56:00+00:00, run_after=2024-05-11T01:57:00+00:00 2024-05-11T01:56:05.520803299Z [2024-05-11T01:56:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:56:05.521287026Z [2024-05-11T01:56:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:55:00+00:00, run_id=scheduled__2024-05-11T01:55:00+00:00, run_start_date=2024-05-11 01:56:00.734558+00:00, run_end_date=2024-05-11 01:56:05.520951+00:00, run_duration=4.786393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:55:00+00:00, data_interval_end=2024-05-11 01:56:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:56:05.530956552Z [2024-05-11T01:56:05.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:56:00+00:00, run_after=2024-05-11T01:57:00+00:00 2024-05-11T01:56:05.584644652Z [2024-05-11T01:56:05.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:56:05.585302420Z [2024-05-11T01:56:05.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T01:56:05.596946092Z [2024-05-11T01:56:05.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=-1, run_start_date=2024-05-11 01:56:03.250161+00:00, run_end_date=2024-05-11 01:56:04.615835+00:00, run_duration=1.365674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:56:00.800926+00:00, queued_by_job_id=2, pid=13519 2024-05-11T01:56:05.597617383Z [2024-05-11T01:56:05.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=-1, run_start_date=2024-05-11 01:56:03.251436+00:00, run_end_date=2024-05-11 01:56:05.155713+00:00, run_duration=1.904277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:56:00.800926+00:00, queued_by_job_id=2, pid=13520 2024-05-11T01:57:00.547925888Z [2024-05-11T01:57:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:57:00+00:00, run_after=2024-05-11T01:58:00+00:00 2024-05-11T01:57:00.573472327Z [2024-05-11T01:57:00.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:57:00+00:00, run_after=2024-05-11T01:58:00+00:00 2024-05-11T01:57:00.586827276Z [2024-05-11T01:57:00.586+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:57:00.672854232Z [2024-05-11T01:57:00.672+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:57:00.672879757Z 2024-05-11T01:57:00.672883491Z 2024-05-11T01:57:00.672886681Z 2024-05-11T01:57:00.673045923Z [2024-05-11T01:57:00.672+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:57:00.673277285Z [2024-05-11T01:57:00.673+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:57:00.673479659Z [2024-05-11T01:57:00.673+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:57:00.674303365Z [2024-05-11T01:57:00.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:57:00.674315360Z 2024-05-11T01:57:00.674318778Z 2024-05-11T01:57:00.674321935Z 2024-05-11T01:57:00.677785796Z [2024-05-11T01:57:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:57:00.677966818Z [2024-05-11T01:57:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:57:00.678236280Z [2024-05-11T01:57:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:57:00.678404794Z [2024-05-11T01:57:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:57:00.678657993Z [2024-05-11T01:57:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:57:00.678807789Z [2024-05-11T01:57:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:57:00.921651042Z [2024-05-11T01:57:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status queued for try_number 1 2024-05-11T01:57:00.921965517Z [2024-05-11T01:57:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status queued for try_number 1 2024-05-11T01:57:00.922194719Z [2024-05-11T01:57:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status queued for try_number 1 2024-05-11T01:57:00.929531311Z [2024-05-11T01:57:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to f03d0bbe-683f-4f52-a2a8-5bc04714645c 2024-05-11T01:57:00.929843532Z [2024-05-11T01:57:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6066d88b-0624-4ec0-b946-fd7a8cf55f3e 2024-05-11T01:57:00.930112836Z [2024-05-11T01:57:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc485adc-e359-48a1-b0c2-16e42f7a5ac0 2024-05-11T01:57:03.205067193Z [2024-05-11T01:57:03.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:57:03.205636482Z [2024-05-11T01:57:03.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:56:00+00:00, run_id=scheduled__2024-05-11T01:56:00+00:00, run_start_date=2024-05-11 01:57:00.606404+00:00, run_end_date=2024-05-11 01:57:03.204955+00:00, run_duration=2.598551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:56:00+00:00, data_interval_end=2024-05-11 01:57:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:57:03.222170519Z [2024-05-11T01:57:03.221+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:57:00+00:00, run_after=2024-05-11T01:58:00+00:00 2024-05-11T01:57:03.268272563Z [2024-05-11T01:57:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status success for try_number 1 2024-05-11T01:57:03.275334056Z [2024-05-11T01:57:03.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:56:00+00:00, map_index=-1, run_start_date=2024-05-11 01:57:01.709016+00:00, run_end_date=2024-05-11 01:57:02.097261+00:00, run_duration=0.388245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:57:00.675245+00:00, queued_by_job_id=2, pid=13552 2024-05-11T01:57:04.340532484Z [2024-05-11T01:57:04.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:57:04.340920156Z [2024-05-11T01:57:04.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:56:00+00:00, run_id=scheduled__2024-05-11T01:56:00+00:00, run_start_date=2024-05-11 01:57:00.608520+00:00, run_end_date=2024-05-11 01:57:04.340472+00:00, run_duration=3.731952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:56:00+00:00, data_interval_end=2024-05-11 01:57:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:57:04.351918790Z [2024-05-11T01:57:04.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:57:00+00:00, run_after=2024-05-11T01:58:00+00:00 2024-05-11T01:57:04.405193880Z [2024-05-11T01:57:04.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status success for try_number 1 2024-05-11T01:57:04.415235119Z [2024-05-11T01:57:04.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:56:00+00:00, map_index=-1, run_start_date=2024-05-11 01:57:02.636755+00:00, run_end_date=2024-05-11 01:57:03.842647+00:00, run_duration=1.205892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:57:00.675245+00:00, queued_by_job_id=2, pid=13570 2024-05-11T01:57:04.707809859Z [2024-05-11T01:57:04.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:57:04.708618518Z [2024-05-11T01:57:04.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:56:00+00:00, run_id=scheduled__2024-05-11T01:56:00+00:00, run_start_date=2024-05-11 01:57:00.610537+00:00, run_end_date=2024-05-11 01:57:04.707458+00:00, run_duration=4.096921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:56:00+00:00, data_interval_end=2024-05-11 01:57:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:57:04.734494195Z [2024-05-11T01:57:04.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:57:00+00:00, run_after=2024-05-11T01:58:00+00:00 2024-05-11T01:57:04.787082241Z [2024-05-11T01:57:04.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status success for try_number 1 2024-05-11T01:57:04.794921973Z [2024-05-11T01:57:04.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:56:00+00:00, map_index=-1, run_start_date=2024-05-11 01:57:02.849106+00:00, run_end_date=2024-05-11 01:57:04.490296+00:00, run_duration=1.64119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:57:00.675245+00:00, queued_by_job_id=2, pid=13571 2024-05-11T01:58:00.376338283Z [2024-05-11T01:58:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:58:00+00:00, run_after=2024-05-11T01:59:00+00:00 2024-05-11T01:58:00.384684823Z [2024-05-11T01:58:00.384+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:58:00.391852021Z [2024-05-11T01:58:00.391+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:58:00.403925828Z [2024-05-11T01:58:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:58:00+00:00, run_after=2024-05-11T01:59:00+00:00 2024-05-11T01:58:00.500817256Z [2024-05-11T01:58:00.500+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T01:58:00.500865880Z 2024-05-11T01:58:00.500923494Z 2024-05-11T01:58:00.500937374Z 2024-05-11T01:58:00.500945962Z 2024-05-11T01:58:00.501110447Z [2024-05-11T01:58:00.500+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T01:58:00.502027475Z [2024-05-11T01:58:00.501+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:58:00.502610799Z [2024-05-11T01:58:00.502+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:58:00.502976283Z [2024-05-11T01:58:00.502+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:58:00.504256281Z [2024-05-11T01:58:00.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:58:00.504294204Z 2024-05-11T01:58:00.504302847Z 2024-05-11T01:58:00.504330806Z 2024-05-11T01:58:00.504339724Z 2024-05-11T01:58:00.510494484Z [2024-05-11T01:58:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:58:00.510894941Z [2024-05-11T01:58:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:58:00.511348249Z [2024-05-11T01:58:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:58:00.511547937Z [2024-05-11T01:58:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:58:00.511822228Z [2024-05-11T01:58:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:58:00.511996778Z [2024-05-11T01:58:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:58:00.512237645Z [2024-05-11T01:58:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:58:00.512391279Z [2024-05-11T01:58:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:58:00.967056821Z [2024-05-11T01:58:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status queued for try_number 1 2024-05-11T01:58:00.967326499Z [2024-05-11T01:58:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:57:00+00:00 exited with status queued for try_number 1 2024-05-11T01:58:00.967551605Z [2024-05-11T01:58:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:57:00+00:00 exited with status queued for try_number 1 2024-05-11T01:58:00.967691385Z [2024-05-11T01:58:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:57:00+00:00 exited with status queued for try_number 1 2024-05-11T01:58:00.985994490Z [2024-05-11T01:58:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to f67bce98-167f-4a74-af73-3135b8c7a5d6 2024-05-11T01:58:00.986240177Z [2024-05-11T01:58:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to b57b9537-5528-4472-8807-94dcca3a75da 2024-05-11T01:58:00.986512944Z [2024-05-11T01:58:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 845de46e-41e8-4d54-888c-4f5673fb6354 2024-05-11T01:58:00.986777627Z [2024-05-11T01:58:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 290f2b6c-2648-410c-b3df-f5c46ceec55c 2024-05-11T01:58:02.327364292Z [2024-05-11T01:58:02.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:58:02.328096173Z [2024-05-11T01:58:02.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:56:00+00:00, run_id=scheduled__2024-05-11T01:56:00+00:00, run_start_date=2024-05-11 01:58:00.415268+00:00, run_end_date=2024-05-11 01:58:02.327516+00:00, run_duration=1.912248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:56:00+00:00, data_interval_end=2024-05-11 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T01:58:02.340514953Z [2024-05-11T01:58:02.340+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T01:58:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:58:02.351837034Z [2024-05-11T01:58:02.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:58:02.352326435Z [2024-05-11T01:58:02.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:57:00+00:00, run_id=scheduled__2024-05-11T01:57:00+00:00, run_start_date=2024-05-11 01:58:00.416605+00:00, run_end_date=2024-05-11 01:58:02.351887+00:00, run_duration=1.935282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:57:00+00:00, data_interval_end=2024-05-11 01:58:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:58:02.376548752Z [2024-05-11T01:58:02.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:58:00+00:00, run_after=2024-05-11T01:59:00+00:00 2024-05-11T01:58:02.436196029Z [2024-05-11T01:58:02.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:56:00+00:00 exited with status success for try_number 1 2024-05-11T01:58:02.438203570Z [2024-05-11T01:58:02.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:57:00+00:00 exited with status success for try_number 1 2024-05-11T01:58:02.451361623Z [2024-05-11T01:58:02.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:57:00+00:00, map_index=-1, run_start_date=2024-05-11 01:58:01.526542+00:00, run_end_date=2024-05-11 01:58:01.932357+00:00, run_duration=0.405815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:58:00.506017+00:00, queued_by_job_id=2, pid=13604 2024-05-11T01:58:02.451572469Z [2024-05-11T01:58:02.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:56:00+00:00, map_index=-1, run_start_date=2024-05-11 01:58:01.570456+00:00, run_end_date=2024-05-11 01:58:02.031873+00:00, run_duration=0.461417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:58:00.506017+00:00, queued_by_job_id=2, pid=13605 2024-05-11T01:58:04.599115235Z [2024-05-11T01:58:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:58:04.599532381Z [2024-05-11T01:58:04.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:57:00+00:00, run_id=scheduled__2024-05-11T01:57:00+00:00, run_start_date=2024-05-11 01:58:00.417622+00:00, run_end_date=2024-05-11 01:58:04.599224+00:00, run_duration=4.181602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:57:00+00:00, data_interval_end=2024-05-11 01:58:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:58:04.611157125Z [2024-05-11T01:58:04.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:58:00+00:00, run_after=2024-05-11T01:59:00+00:00 2024-05-11T01:58:04.618794738Z [2024-05-11T01:58:04.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:58:04.619205618Z [2024-05-11T01:58:04.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:57:00+00:00, run_id=scheduled__2024-05-11T01:57:00+00:00, run_start_date=2024-05-11 01:58:00.418558+00:00, run_end_date=2024-05-11 01:58:04.618912+00:00, run_duration=4.200354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:57:00+00:00, data_interval_end=2024-05-11 01:58:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:58:04.628350094Z [2024-05-11T01:58:04.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:58:00+00:00, run_after=2024-05-11T01:59:00+00:00 2024-05-11T01:58:04.663603893Z [2024-05-11T01:58:04.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:57:00+00:00 exited with status success for try_number 1 2024-05-11T01:58:04.663709472Z [2024-05-11T01:58:04.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:57:00+00:00 exited with status success for try_number 1 2024-05-11T01:58:04.669813342Z [2024-05-11T01:58:04.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:57:00+00:00, map_index=-1, run_start_date=2024-05-11 01:58:02.480561+00:00, run_end_date=2024-05-11 01:58:03.773529+00:00, run_duration=1.292968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:58:00.506017+00:00, queued_by_job_id=2, pid=13628 2024-05-11T01:58:04.670090761Z [2024-05-11T01:58:04.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:57:00+00:00, map_index=-1, run_start_date=2024-05-11 01:58:02.540789+00:00, run_end_date=2024-05-11 01:58:04.236924+00:00, run_duration=1.696135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:58:00.506017+00:00, queued_by_job_id=2, pid=13629 2024-05-11T01:59:00.077901096Z [2024-05-11T01:59:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:59:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:59:00.090097056Z [2024-05-11T01:59:00.089+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:59:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:59:00.101195129Z [2024-05-11T01:59:00.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T01:59:00.156181605Z [2024-05-11T01:59:00.155+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T01:59:00.156206003Z 2024-05-11T01:59:00.156224635Z 2024-05-11T01:59:00.156227922Z 2024-05-11T01:59:00.156437963Z [2024-05-11T01:59:00.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:59:00.156598757Z [2024-05-11T01:59:00.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T01:59:00.156759791Z [2024-05-11T01:59:00.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T01:59:00.157341825Z [2024-05-11T01:59:00.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T01:59:00.157358245Z 2024-05-11T01:59:00.157361812Z 2024-05-11T01:59:00.157364877Z 2024-05-11T01:59:00.160394742Z [2024-05-11T01:59:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:59:00.160605975Z [2024-05-11T01:59:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:59:00.160962964Z [2024-05-11T01:59:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:59:00.160984018Z [2024-05-11T01:59:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:59:00.161227686Z [2024-05-11T01:59:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T01:59:00.161370589Z [2024-05-11T01:59:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:59:00.644618136Z [2024-05-11T01:59:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status queued for try_number 1 2024-05-11T01:59:00.645917896Z [2024-05-11T01:59:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status queued for try_number 1 2024-05-11T01:59:00.647325547Z [2024-05-11T01:59:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status queued for try_number 1 2024-05-11T01:59:00.667720280Z [2024-05-11T01:59:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27153d15-8658-4e6e-ae57-52a88bde5945 2024-05-11T01:59:00.668146902Z [2024-05-11T01:59:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97bd03f4-0d0c-4df8-8bcc-38d617164d91 2024-05-11T01:59:00.670138495Z [2024-05-11T01:59:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to e67a12b7-dbc2-46a1-9150-d453cd53e29a 2024-05-11T01:59:01.837544169Z [2024-05-11T01:59:01.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:59:01.838260519Z [2024-05-11T01:59:01.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:58:00+00:00, run_id=scheduled__2024-05-11T01:58:00+00:00, run_start_date=2024-05-11 01:59:00.111089+00:00, run_end_date=2024-05-11 01:59:01.837621+00:00, run_duration=1.726532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:58:00+00:00, data_interval_end=2024-05-11 01:59:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T01:59:01.849308076Z [2024-05-11T01:59:01.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T01:59:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:59:01.894446664Z [2024-05-11T01:59:01.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status success for try_number 1 2024-05-11T01:59:01.902649783Z [2024-05-11T01:59:01.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:58:00+00:00, map_index=-1, run_start_date=2024-05-11 01:59:01.031721+00:00, run_end_date=2024-05-11 01:59:01.433548+00:00, run_duration=0.401827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:59:00.158233+00:00, queued_by_job_id=2, pid=13661 2024-05-11T01:59:04.201827033Z [2024-05-11T01:59:04.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:59:04.202352857Z [2024-05-11T01:59:04.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:58:00+00:00, run_id=scheduled__2024-05-11T01:58:00+00:00, run_start_date=2024-05-11 01:59:00.112361+00:00, run_end_date=2024-05-11 01:59:04.201723+00:00, run_duration=4.089362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:58:00+00:00, data_interval_end=2024-05-11 01:59:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T01:59:04.211503634Z [2024-05-11T01:59:04.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:59:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:59:04.253926245Z [2024-05-11T01:59:04.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status success for try_number 1 2024-05-11T01:59:04.258643617Z [2024-05-11T01:59:04.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:58:00+00:00, map_index=-1, run_start_date=2024-05-11 01:59:02.048525+00:00, run_end_date=2024-05-11 01:59:03.400832+00:00, run_duration=1.352307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:59:00.158233+00:00, queued_by_job_id=2, pid=13674 2024-05-11T01:59:05.192599126Z [2024-05-11T01:59:05.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T01:59:05.192818668Z [2024-05-11T01:59:05.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:58:00+00:00, run_id=scheduled__2024-05-11T01:58:00+00:00, run_start_date=2024-05-11 01:59:00.113324+00:00, run_end_date=2024-05-11 01:59:05.192450+00:00, run_duration=5.079126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:58:00+00:00, data_interval_end=2024-05-11 01:59:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T01:59:05.203502168Z [2024-05-11T01:59:05.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T01:59:00+00:00, run_after=2024-05-11T02:00:00+00:00 2024-05-11T01:59:05.235179412Z [2024-05-11T01:59:05.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status success for try_number 1 2024-05-11T01:59:05.240779065Z [2024-05-11T01:59:05.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:58:00+00:00, map_index=-1, run_start_date=2024-05-11 01:59:02.357673+00:00, run_end_date=2024-05-11 01:59:04.660328+00:00, run_duration=2.302655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 01:59:00.158233+00:00, queued_by_job_id=2, pid=13683 2024-05-11T02:00:00.097020051Z [2024-05-11T02:00:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:01:00+00:00 2024-05-11T02:00:00.106055277Z [2024-05-11T02:00:00.102+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:00:00.122044677Z [2024-05-11T02:00:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:01:00+00:00 2024-05-11T02:00:00.166084050Z [2024-05-11T02:00:00.162+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:00:00.187217815Z [2024-05-11T02:00:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:00:00.306013650Z [2024-05-11T02:00:00.299+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T02:00:00.306038852Z 2024-05-11T02:00:00.306042936Z 2024-05-11T02:00:00.306051172Z 2024-05-11T02:00:00.306054549Z 2024-05-11T02:00:00.306058072Z 2024-05-11T02:00:00.306061352Z [2024-05-11T02:00:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:00:00.306066907Z [2024-05-11T02:00:00.300+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:00:00.306070817Z [2024-05-11T02:00:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:00:00.306075403Z [2024-05-11T02:00:00.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:00:00.306079637Z [2024-05-11T02:00:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:00:00.306084998Z [2024-05-11T02:00:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:00:00.306089730Z 2024-05-11T02:00:00.306094537Z 2024-05-11T02:00:00.306099483Z 2024-05-11T02:00:00.306104364Z 2024-05-11T02:00:00.306109366Z 2024-05-11T02:00:00.318486419Z [2024-05-11T02:00:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:00:00.318517238Z [2024-05-11T02:00:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:00:00.318540543Z [2024-05-11T02:00:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:00:00.318545393Z [2024-05-11T02:00:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:00:00.318548661Z [2024-05-11T02:00:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:00:00.318551962Z [2024-05-11T02:00:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:00:00.318555629Z [2024-05-11T02:00:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:00:00.318558614Z [2024-05-11T02:00:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:00:00.321532781Z [2024-05-11T02:00:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:00:00.322101487Z [2024-05-11T02:00:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:00:00.919451945Z [2024-05-11T02:00:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:00.922377039Z [2024-05-11T02:00:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:00.922498009Z [2024-05-11T02:00:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:59:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:00.922999975Z [2024-05-11T02:00:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:59:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:00.923109233Z [2024-05-11T02:00:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:59:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:00.935636732Z [2024-05-11T02:00:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80af49b0-d98f-4a7f-9b2b-19cbf231c257 2024-05-11T02:00:00.935865821Z [2024-05-11T02:00:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b2bdb03-e151-4b59-ba3b-4c31987cf8fb 2024-05-11T02:00:00.936094785Z [2024-05-11T02:00:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d22451b-320d-43a9-a90e-20d7defceca4 2024-05-11T02:00:00.936317490Z [2024-05-11T02:00:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 913d7976-bd53-4c59-a1d1-2c76e08f2073 2024-05-11T02:00:00.936495786Z [2024-05-11T02:00:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2851de2b-21d7-401d-8f9e-2a1ad74ab3cb 2024-05-11T02:00:03.041961581Z [2024-05-11T02:00:03.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:00:03.042319993Z [2024-05-11T02:00:03.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 01:58:00+00:00, run_id=scheduled__2024-05-11T01:58:00+00:00, run_start_date=2024-05-11 02:00:00.199875+00:00, run_end_date=2024-05-11 02:00:03.041705+00:00, run_duration=2.84183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:58:00+00:00, data_interval_end=2024-05-11 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:00:03.050620222Z [2024-05-11T02:00:03.050+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:02:00+00:00 2024-05-11T02:00:03.079546590Z [2024-05-11T02:00:03.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:00:03.080059056Z [2024-05-11T02:00:03.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 01:59:00+00:00, run_id=scheduled__2024-05-11T01:59:00+00:00, run_start_date=2024-05-11 02:00:00.201046+00:00, run_end_date=2024-05-11 02:00:03.079409+00:00, run_duration=2.878363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:59:00+00:00, data_interval_end=2024-05-11 02:00:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:00:03.092338304Z [2024-05-11T02:00:03.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:01:00+00:00 2024-05-11T02:00:03.137846824Z [2024-05-11T02:00:03.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T01:58:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:03.137930238Z [2024-05-11T02:00:03.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:59:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:03.147714124Z [2024-05-11T02:00:03.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T01:58:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:01.766834+00:00, run_end_date=2024-05-11 02:00:02.393814+00:00, run_duration=0.62698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:00.302742+00:00, queued_by_job_id=2, pid=13709 2024-05-11T02:00:03.148037451Z [2024-05-11T02:00:03.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:59:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:02.273991+00:00, run_end_date=2024-05-11 02:00:02.831058+00:00, run_duration=0.557067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:00.302742+00:00, queued_by_job_id=2, pid=13721 2024-05-11T02:00:04.291023897Z [2024-05-11T02:00:04.282+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:00:04.291070179Z 2024-05-11T02:00:04.291081740Z [2024-05-11T02:00:04.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:00:04.291123901Z [2024-05-11T02:00:04.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:00:04.291131450Z 2024-05-11T02:00:04.295554118Z [2024-05-11T02:00:04.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:00:04.296086983Z [2024-05-11T02:00:04.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:00:04.365637141Z [2024-05-11T02:00:04.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:04.365697443Z [2024-05-11T02:00:04.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:04.376913065Z [2024-05-11T02:00:04.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6c06b2-c31b-44e0-afb5-5c1e654a2e19 2024-05-11T02:00:04.376983803Z [2024-05-11T02:00:04.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:03.474545+00:00, run_end_date=2024-05-11 02:00:03.911721+00:00, run_duration=0.437176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:00.302742+00:00, queued_by_job_id=2, pid=13746 2024-05-11T02:00:05.552159431Z [2024-05-11T02:00:05.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:00:05.552574895Z [2024-05-11T02:00:05.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:59:00+00:00, run_id=scheduled__2024-05-11T01:59:00+00:00, run_start_date=2024-05-11 02:00:00.203881+00:00, run_end_date=2024-05-11 02:00:05.552078+00:00, run_duration=5.348197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:59:00+00:00, data_interval_end=2024-05-11 02:00:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:00:05.564989600Z [2024-05-11T02:00:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:01:00+00:00 2024-05-11T02:00:05.574828257Z [2024-05-11T02:00:05.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:00:05.575310624Z [2024-05-11T02:00:05.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:59:00+00:00, run_id=scheduled__2024-05-11T01:59:00+00:00, run_start_date=2024-05-11 02:00:00.202825+00:00, run_end_date=2024-05-11 02:00:05.574719+00:00, run_duration=5.371894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:59:00+00:00, data_interval_end=2024-05-11 02:00:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:00:05.587012366Z [2024-05-11T02:00:05.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:01:00+00:00 2024-05-11T02:00:05.648866342Z [2024-05-11T02:00:05.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:59:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:05.649046570Z [2024-05-11T02:00:05.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T01:59:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:05.656219999Z [2024-05-11T02:00:05.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:59:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:03.521833+00:00, run_end_date=2024-05-11 02:00:04.874290+00:00, run_duration=1.352457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:00.302742+00:00, queued_by_job_id=2, pid=13751 2024-05-11T02:00:05.656584796Z [2024-05-11T02:00:05.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T01:59:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:03.125131+00:00, run_end_date=2024-05-11 02:00:05.037396+00:00, run_duration=1.912265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:00.302742+00:00, queued_by_job_id=2, pid=13734 2024-05-11T02:00:06.971710973Z [2024-05-11T02:00:06.971+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:00:06.971777668Z 2024-05-11T02:00:06.971795664Z [2024-05-11T02:00:06.971+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:00:06.972521939Z [2024-05-11T02:00:06.972+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:00:06.972536782Z 2024-05-11T02:00:06.976888228Z [2024-05-11T02:00:06.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:00:06.976931910Z [2024-05-11T02:00:06.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:00:07.064478091Z [2024-05-11T02:00:07.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:07.064515627Z [2024-05-11T02:00:07.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:07.079316800Z [2024-05-11T02:00:07.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96c33655-eb7a-464c-993d-37c07c46e7ef 2024-05-11T02:00:07.079493129Z [2024-05-11T02:00:07.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:05.940261+00:00, run_end_date=2024-05-11 02:00:06.288478+00:00, run_duration=0.348217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:04.285227+00:00, queued_by_job_id=2, pid=13779 2024-05-11T02:00:10.458236267Z [2024-05-11T02:00:10.457+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:00:10.458288532Z 2024-05-11T02:00:10.459321603Z [2024-05-11T02:00:10.458+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:00:10.463626076Z [2024-05-11T02:00:10.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:00:10.463660210Z 2024-05-11T02:00:10.468425723Z [2024-05-11T02:00:10.468+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:00:10.468910460Z [2024-05-11T02:00:10.468+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:00:10.535092642Z [2024-05-11T02:00:10.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status queued for try_number 1 2024-05-11T02:00:10.535281461Z [2024-05-11T02:00:10.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:10.543361556Z [2024-05-11T02:00:10.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 800cc44f-ed9e-4aa8-b609-1895f432f60c 2024-05-11T02:00:10.543686767Z [2024-05-11T02:00:10.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=0, run_start_date=2024-05-11 02:00:08.710400+00:00, run_end_date=2024-05-11 02:00:10.146931+00:00, run_duration=1.436531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:06.972904+00:00, queued_by_job_id=2, pid=13790 2024-05-11T02:00:12.847022232Z [2024-05-11T02:00:12.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:00:12.847384222Z [2024-05-11T02:00:12.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 01:55:00+00:00, run_id=scheduled__2024-05-11T01:55:00+00:00, run_start_date=2024-05-11 02:00:00.198363+00:00, run_end_date=2024-05-11 02:00:12.846923+00:00, run_duration=12.64856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 01:55:00+00:00, data_interval_end=2024-05-11 02:00:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:00:12.854151840Z [2024-05-11T02:00:12.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:00:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:00:12.899203071Z [2024-05-11T02:00:12.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T01:55:00+00:00 exited with status success for try_number 1 2024-05-11T02:00:12.905793025Z [2024-05-11T02:00:12.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T01:55:00+00:00, map_index=-1, run_start_date=2024-05-11 02:00:12.248511+00:00, run_end_date=2024-05-11 02:00:12.666393+00:00, run_duration=0.417882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:00:10.464618+00:00, queued_by_job_id=2, pid=13803 2024-05-11T02:00:36.086061216Z [2024-05-11T02:00:36.085+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:01:01.076438138Z [2024-05-11T02:01:01.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:01:01.091226231Z [2024-05-11T02:01:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:01:00+00:00, run_after=2024-05-11T02:02:00+00:00 2024-05-11T02:01:01.108765073Z [2024-05-11T02:01:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:01:00+00:00, run_after=2024-05-11T02:02:00+00:00 2024-05-11T02:01:01.177106008Z [2024-05-11T02:01:01.176+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:01:01.177152188Z 2024-05-11T02:01:01.177159486Z 2024-05-11T02:01:01.177164870Z 2024-05-11T02:01:01.177217326Z [2024-05-11T02:01:01.176+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:01:01.177385100Z [2024-05-11T02:01:01.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:01:01.177488521Z [2024-05-11T02:01:01.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:01:01.178303660Z [2024-05-11T02:01:01.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:01:01.178315706Z 2024-05-11T02:01:01.178319857Z 2024-05-11T02:01:01.178323870Z 2024-05-11T02:01:01.181311601Z [2024-05-11T02:01:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:01:01.181461341Z [2024-05-11T02:01:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:01:01.181738416Z [2024-05-11T02:01:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:01:01.181847278Z [2024-05-11T02:01:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:01:01.182159044Z [2024-05-11T02:01:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:01:01.182272665Z [2024-05-11T02:01:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:01:01.387128661Z [2024-05-11T02:01:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:01:01.387253871Z [2024-05-11T02:01:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:01:01.387372058Z [2024-05-11T02:01:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:01:01.394850799Z [2024-05-11T02:01:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to aed5540f-c4fd-46a6-ad13-0aa87ac2ae8b 2024-05-11T02:01:01.395084156Z [2024-05-11T02:01:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 959146d7-1a4e-4b80-bbf4-d803ed92b267 2024-05-11T02:01:01.395327227Z [2024-05-11T02:01:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to e031b374-9f77-447d-b252-3b5755ead8d9 2024-05-11T02:01:02.586988746Z [2024-05-11T02:01:02.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:01:02.587683021Z [2024-05-11T02:01:02.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:00:00+00:00, run_id=scheduled__2024-05-11T02:00:00+00:00, run_start_date=2024-05-11 02:01:01.126708+00:00, run_end_date=2024-05-11 02:01:02.586956+00:00, run_duration=1.460248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:00:00+00:00, data_interval_end=2024-05-11 02:01:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:01:02.606127320Z [2024-05-11T02:01:02.604+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:01:00+00:00, run_after=2024-05-11T02:02:00+00:00 2024-05-11T02:01:02.691239105Z [2024-05-11T02:01:02.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:01:02.700100770Z [2024-05-11T02:01:02.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:01:01.953111+00:00, run_end_date=2024-05-11 02:01:02.375529+00:00, run_duration=0.422418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:01:01.178953+00:00, queued_by_job_id=2, pid=13812 2024-05-11T02:01:05.175305269Z [2024-05-11T02:01:05.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:01:05.175594406Z [2024-05-11T02:01:05.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:00:00+00:00, run_id=scheduled__2024-05-11T02:00:00+00:00, run_start_date=2024-05-11 02:01:01.128512+00:00, run_end_date=2024-05-11 02:01:05.175216+00:00, run_duration=4.046704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:00:00+00:00, data_interval_end=2024-05-11 02:01:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:01:05.186832534Z [2024-05-11T02:01:05.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:01:00+00:00, run_after=2024-05-11T02:02:00+00:00 2024-05-11T02:01:05.234541458Z [2024-05-11T02:01:05.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:01:05.242174033Z [2024-05-11T02:01:05.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:01:03.024138+00:00, run_end_date=2024-05-11 02:01:04.826888+00:00, run_duration=1.80275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:01:01.178953+00:00, queued_by_job_id=2, pid=13830 2024-05-11T02:01:05.907759931Z [2024-05-11T02:01:05.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:01:05.908025676Z [2024-05-11T02:01:05.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:00:00+00:00, run_id=scheduled__2024-05-11T02:00:00+00:00, run_start_date=2024-05-11 02:01:01.129676+00:00, run_end_date=2024-05-11 02:01:05.907612+00:00, run_duration=4.777936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:00:00+00:00, data_interval_end=2024-05-11 02:01:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:01:05.917144730Z [2024-05-11T02:01:05.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:01:00+00:00, run_after=2024-05-11T02:02:00+00:00 2024-05-11T02:01:05.951176655Z [2024-05-11T02:01:05.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:01:05.959956366Z [2024-05-11T02:01:05.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:01:03.149251+00:00, run_end_date=2024-05-11 02:01:05.244539+00:00, run_duration=2.095288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:01:01.178953+00:00, queued_by_job_id=2, pid=13831 2024-05-11T02:02:00.950357139Z [2024-05-11T02:02:00.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:02:00+00:00, run_after=2024-05-11T02:03:00+00:00 2024-05-11T02:02:00.958884440Z [2024-05-11T02:02:00.958+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:02:00.965247198Z [2024-05-11T02:02:00.964+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:02:00.976893941Z [2024-05-11T02:02:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:02:00+00:00, run_after=2024-05-11T02:03:00+00:00 2024-05-11T02:02:01.069565641Z [2024-05-11T02:02:01.069+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:02:01.069593469Z 2024-05-11T02:02:01.069598127Z 2024-05-11T02:02:01.069601512Z 2024-05-11T02:02:01.069605173Z 2024-05-11T02:02:01.071259400Z [2024-05-11T02:02:01.069+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:02:01.071771886Z [2024-05-11T02:02:01.071+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:02:01.073158010Z [2024-05-11T02:02:01.071+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:02:01.073174139Z [2024-05-11T02:02:01.072+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:02:01.073653498Z [2024-05-11T02:02:01.073+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:02:01.073666537Z 2024-05-11T02:02:01.073670659Z 2024-05-11T02:02:01.073684665Z 2024-05-11T02:02:01.073690732Z 2024-05-11T02:02:01.082120373Z [2024-05-11T02:02:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:02:01.082137589Z [2024-05-11T02:02:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:02:01.082142331Z [2024-05-11T02:02:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:02:01.082145639Z [2024-05-11T02:02:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:02:01.082149003Z [2024-05-11T02:02:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:02:01.082152046Z [2024-05-11T02:02:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:02:01.082155009Z [2024-05-11T02:02:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:02:01.082158050Z [2024-05-11T02:02:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:02:01.677904268Z [2024-05-11T02:02:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:02:01.677969802Z [2024-05-11T02:02:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:01:00+00:00 exited with status queued for try_number 1 2024-05-11T02:02:01.677998904Z [2024-05-11T02:02:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:01:00+00:00 exited with status queued for try_number 1 2024-05-11T02:02:01.678098182Z [2024-05-11T02:02:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:01:00+00:00 exited with status queued for try_number 1 2024-05-11T02:02:01.696591341Z [2024-05-11T02:02:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d70722-81d9-4c28-a76d-a79e0ff1bc0c 2024-05-11T02:02:01.696656552Z [2024-05-11T02:02:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ba8beb9-589f-48c2-a0cb-90b3fbe75893 2024-05-11T02:02:01.696764248Z [2024-05-11T02:02:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ef19a4b-d3f1-4b32-8229-f40deb9f9a8e 2024-05-11T02:02:01.696860352Z [2024-05-11T02:02:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 784fb8b8-1536-4a90-8c9b-002be2ff5582 2024-05-11T02:02:02.867340587Z [2024-05-11T02:02:02.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:02:02.867532266Z [2024-05-11T02:02:02.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:00:00+00:00, run_id=scheduled__2024-05-11T02:00:00+00:00, run_start_date=2024-05-11 02:02:00.989133+00:00, run_end_date=2024-05-11 02:02:02.867239+00:00, run_duration=1.878106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:00:00+00:00, data_interval_end=2024-05-11 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:02:02.875571437Z [2024-05-11T02:02:02.875+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:02:00+00:00, run_after=2024-05-11T02:04:00+00:00 2024-05-11T02:02:02.888011430Z [2024-05-11T02:02:02.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:02:02.888158564Z [2024-05-11T02:02:02.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:01:00+00:00, run_id=scheduled__2024-05-11T02:01:00+00:00, run_start_date=2024-05-11 02:02:00.990498+00:00, run_end_date=2024-05-11 02:02:02.887917+00:00, run_duration=1.897419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:01:00+00:00, data_interval_end=2024-05-11 02:02:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:02:02.903572843Z [2024-05-11T02:02:02.903+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:02:00+00:00, run_after=2024-05-11T02:03:00+00:00 2024-05-11T02:02:02.959136019Z [2024-05-11T02:02:02.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:02:02.959190965Z [2024-05-11T02:02:02.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:01:00+00:00 exited with status success for try_number 1 2024-05-11T02:02:02.968932479Z [2024-05-11T02:02:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:02:01.862980+00:00, run_end_date=2024-05-11 02:02:02.244945+00:00, run_duration=0.381965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:02:01.074922+00:00, queued_by_job_id=2, pid=13864 2024-05-11T02:02:02.969152729Z [2024-05-11T02:02:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:01:00+00:00, map_index=-1, run_start_date=2024-05-11 02:02:01.975250+00:00, run_end_date=2024-05-11 02:02:02.420490+00:00, run_duration=0.44524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:02:01.074922+00:00, queued_by_job_id=2, pid=13865 2024-05-11T02:02:04.942430888Z [2024-05-11T02:02:04.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:02:04.942737235Z [2024-05-11T02:02:04.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:01:00+00:00, run_id=scheduled__2024-05-11T02:01:00+00:00, run_start_date=2024-05-11 02:02:00.991621+00:00, run_end_date=2024-05-11 02:02:04.942253+00:00, run_duration=3.950632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:01:00+00:00, data_interval_end=2024-05-11 02:02:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:02:04.953178416Z [2024-05-11T02:02:04.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:02:00+00:00, run_after=2024-05-11T02:03:00+00:00 2024-05-11T02:02:04.991293899Z [2024-05-11T02:02:04.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:01:00+00:00 exited with status success for try_number 1 2024-05-11T02:02:04.998338675Z [2024-05-11T02:02:04.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:01:00+00:00, map_index=-1, run_start_date=2024-05-11 02:02:03.173898+00:00, run_end_date=2024-05-11 02:02:04.722287+00:00, run_duration=1.548389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:02:01.074922+00:00, queued_by_job_id=2, pid=13889 2024-05-11T02:02:06.060284935Z [2024-05-11T02:02:06.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:02:06.061933074Z [2024-05-11T02:02:06.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:01:00+00:00, run_id=scheduled__2024-05-11T02:01:00+00:00, run_start_date=2024-05-11 02:02:00.992726+00:00, run_end_date=2024-05-11 02:02:06.061419+00:00, run_duration=5.068693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:01:00+00:00, data_interval_end=2024-05-11 02:02:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:02:06.069997748Z [2024-05-11T02:02:06.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:02:00+00:00, run_after=2024-05-11T02:03:00+00:00 2024-05-11T02:02:06.104471240Z [2024-05-11T02:02:06.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:01:00+00:00 exited with status success for try_number 1 2024-05-11T02:02:06.114274580Z [2024-05-11T02:02:06.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:01:00+00:00, map_index=-1, run_start_date=2024-05-11 02:02:03.070529+00:00, run_end_date=2024-05-11 02:02:05.030448+00:00, run_duration=1.959919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:02:01.074922+00:00, queued_by_job_id=2, pid=13888 2024-05-11T02:03:00.141319484Z [2024-05-11T02:03:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:03:00+00:00, run_after=2024-05-11T02:04:00+00:00 2024-05-11T02:03:00.167612784Z [2024-05-11T02:03:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:03:00+00:00, run_after=2024-05-11T02:04:00+00:00 2024-05-11T02:03:00.174741894Z [2024-05-11T02:03:00.174+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:03:00.249570538Z [2024-05-11T02:03:00.249+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:03:00.249626199Z 2024-05-11T02:03:00.249635672Z 2024-05-11T02:03:00.249642566Z 2024-05-11T02:03:00.249941427Z [2024-05-11T02:03:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:03:00.250167454Z [2024-05-11T02:03:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:03:00.250452906Z [2024-05-11T02:03:00.250+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:03:00.251557940Z [2024-05-11T02:03:00.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:03:00.251568958Z 2024-05-11T02:03:00.251574985Z 2024-05-11T02:03:00.251580987Z 2024-05-11T02:03:00.265631569Z [2024-05-11T02:03:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:03:00.265905641Z [2024-05-11T02:03:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:03:00.266287671Z [2024-05-11T02:03:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:03:00.266558465Z [2024-05-11T02:03:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:03:00.267292716Z [2024-05-11T02:03:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:03:00.267528297Z [2024-05-11T02:03:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:03:00.535086856Z [2024-05-11T02:03:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status queued for try_number 1 2024-05-11T02:03:00.535111260Z [2024-05-11T02:03:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status queued for try_number 1 2024-05-11T02:03:00.535406476Z [2024-05-11T02:03:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status queued for try_number 1 2024-05-11T02:03:00.553691047Z [2024-05-11T02:03:00.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b6b993c-ff8e-4cdb-ab6d-f8b15c2317ed 2024-05-11T02:03:00.556577213Z [2024-05-11T02:03:00.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 912b5607-da79-4db3-8e14-82ff2fa2a6af 2024-05-11T02:03:00.556840466Z [2024-05-11T02:03:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec49c3ee-e1a9-4a72-9fd5-b669c72951e5 2024-05-11T02:03:01.744559430Z [2024-05-11T02:03:01.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:03:01.744978379Z [2024-05-11T02:03:01.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:02:00+00:00, run_id=scheduled__2024-05-11T02:02:00+00:00, run_start_date=2024-05-11 02:03:00.184041+00:00, run_end_date=2024-05-11 02:03:01.744653+00:00, run_duration=1.560612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:02:00+00:00, data_interval_end=2024-05-11 02:03:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:03:01.754187037Z [2024-05-11T02:03:01.753+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:03:00+00:00, run_after=2024-05-11T02:04:00+00:00 2024-05-11T02:03:01.816002062Z [2024-05-11T02:03:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status success for try_number 1 2024-05-11T02:03:01.822149796Z [2024-05-11T02:03:01.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:02:00+00:00, map_index=-1, run_start_date=2024-05-11 02:03:01.196229+00:00, run_end_date=2024-05-11 02:03:01.570197+00:00, run_duration=0.373968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:03:00.252995+00:00, queued_by_job_id=2, pid=13921 2024-05-11T02:03:03.960526874Z [2024-05-11T02:03:03.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:03:03.960605916Z [2024-05-11T02:03:03.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:02:00+00:00, run_id=scheduled__2024-05-11T02:02:00+00:00, run_start_date=2024-05-11 02:03:00.185416+00:00, run_end_date=2024-05-11 02:03:03.960263+00:00, run_duration=3.774847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:02:00+00:00, data_interval_end=2024-05-11 02:03:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:03:03.968964934Z [2024-05-11T02:03:03.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:03:00+00:00, run_after=2024-05-11T02:04:00+00:00 2024-05-11T02:03:03.975216018Z [2024-05-11T02:03:03.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:03:03.975373933Z [2024-05-11T02:03:03.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:02:00+00:00, run_id=scheduled__2024-05-11T02:02:00+00:00, run_start_date=2024-05-11 02:03:00.186688+00:00, run_end_date=2024-05-11 02:03:03.975072+00:00, run_duration=3.788384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:02:00+00:00, data_interval_end=2024-05-11 02:03:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:03:03.984017594Z [2024-05-11T02:03:03.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:03:00+00:00, run_after=2024-05-11T02:04:00+00:00 2024-05-11T02:03:04.023295630Z [2024-05-11T02:03:04.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status success for try_number 1 2024-05-11T02:03:04.029694075Z [2024-05-11T02:03:04.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:02:00+00:00, map_index=-1, run_start_date=2024-05-11 02:03:02.097225+00:00, run_end_date=2024-05-11 02:03:03.358829+00:00, run_duration=1.261604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:03:00.252995+00:00, queued_by_job_id=2, pid=13939 2024-05-11T02:03:05.115212313Z [2024-05-11T02:03:05.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status success for try_number 1 2024-05-11T02:03:05.120340216Z [2024-05-11T02:03:05.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:02:00+00:00, map_index=-1, run_start_date=2024-05-11 02:03:02.175473+00:00, run_end_date=2024-05-11 02:03:03.895247+00:00, run_duration=1.719774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:03:00.252995+00:00, queued_by_job_id=2, pid=13940 2024-05-11T02:04:00.446929818Z [2024-05-11T02:04:00.446+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:04:00.459496071Z [2024-05-11T02:04:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:04:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:04:00.467711097Z [2024-05-11T02:04:00.467+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:04:00.480661012Z [2024-05-11T02:04:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:04:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:04:00.594270768Z [2024-05-11T02:04:00.593+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:04:00.594303212Z 2024-05-11T02:04:00.594308736Z 2024-05-11T02:04:00.594312932Z 2024-05-11T02:04:00.594317208Z 2024-05-11T02:04:00.594594796Z [2024-05-11T02:04:00.594+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:04:00.594841289Z [2024-05-11T02:04:00.594+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:04:00.595098713Z [2024-05-11T02:04:00.594+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:04:00.595349716Z [2024-05-11T02:04:00.595+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:04:00.596141982Z [2024-05-11T02:04:00.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:04:00.596156046Z 2024-05-11T02:04:00.596160633Z 2024-05-11T02:04:00.596164565Z 2024-05-11T02:04:00.596168469Z 2024-05-11T02:04:00.600487115Z [2024-05-11T02:04:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:04:00.600918970Z [2024-05-11T02:04:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:04:00.601390617Z [2024-05-11T02:04:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:04:00.601895215Z [2024-05-11T02:04:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:04:00.602308831Z [2024-05-11T02:04:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:04:00.602592526Z [2024-05-11T02:04:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:04:00.603063140Z [2024-05-11T02:04:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:04:00.603191659Z [2024-05-11T02:04:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:04:00.927072645Z [2024-05-11T02:04:00.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status queued for try_number 1 2024-05-11T02:04:00.927311081Z [2024-05-11T02:04:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:03:00+00:00 exited with status queued for try_number 1 2024-05-11T02:04:00.927425522Z [2024-05-11T02:04:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:03:00+00:00 exited with status queued for try_number 1 2024-05-11T02:04:00.927532532Z [2024-05-11T02:04:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:03:00+00:00 exited with status queued for try_number 1 2024-05-11T02:04:00.943256717Z [2024-05-11T02:04:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 622ac20d-701e-4ab7-b3fb-31307c57329b 2024-05-11T02:04:00.943465277Z [2024-05-11T02:04:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7de5a9b9-7e89-49d0-9d25-0fc912160b92 2024-05-11T02:04:00.943630294Z [2024-05-11T02:04:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to ece01b9d-1406-487c-a997-75ac6324da75 2024-05-11T02:04:00.943796134Z [2024-05-11T02:04:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to a98569b9-e6ef-4b8f-83ab-940a91f538dd 2024-05-11T02:04:02.852610028Z [2024-05-11T02:04:02.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:04:02.853030600Z [2024-05-11T02:04:02.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:03:00+00:00, run_id=scheduled__2024-05-11T02:03:00+00:00, run_start_date=2024-05-11 02:04:00.495273+00:00, run_end_date=2024-05-11 02:04:02.852522+00:00, run_duration=2.357249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:03:00+00:00, data_interval_end=2024-05-11 02:04:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:04:02.861980578Z [2024-05-11T02:04:02.861+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:04:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:04:02.868956100Z [2024-05-11T02:04:02.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:04:02.869361386Z [2024-05-11T02:04:02.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:02:00+00:00, run_id=scheduled__2024-05-11T02:02:00+00:00, run_start_date=2024-05-11 02:04:00.493898+00:00, run_end_date=2024-05-11 02:04:02.868850+00:00, run_duration=2.374952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:02:00+00:00, data_interval_end=2024-05-11 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:04:02.877362002Z [2024-05-11T02:04:02.876+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:04:00+00:00, run_after=2024-05-11T02:06:00+00:00 2024-05-11T02:04:02.943788668Z [2024-05-11T02:04:02.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:02:00+00:00 exited with status success for try_number 1 2024-05-11T02:04:02.946189082Z [2024-05-11T02:04:02.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:03:00+00:00 exited with status success for try_number 1 2024-05-11T02:04:02.954442363Z [2024-05-11T02:04:02.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:03:00+00:00, map_index=-1, run_start_date=2024-05-11 02:04:01.758352+00:00, run_end_date=2024-05-11 02:04:02.255854+00:00, run_duration=0.497502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:04:00.597243+00:00, queued_by_job_id=2, pid=13974 2024-05-11T02:04:02.954969409Z [2024-05-11T02:04:02.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:02:00+00:00, map_index=-1, run_start_date=2024-05-11 02:04:01.524889+00:00, run_end_date=2024-05-11 02:04:02.277460+00:00, run_duration=0.752571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:04:00.597243+00:00, queued_by_job_id=2, pid=13973 2024-05-11T02:04:05.115892167Z [2024-05-11T02:04:05.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:04:05.116332578Z [2024-05-11T02:04:05.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:03:00+00:00, run_id=scheduled__2024-05-11T02:03:00+00:00, run_start_date=2024-05-11 02:04:00.496459+00:00, run_end_date=2024-05-11 02:04:05.115980+00:00, run_duration=4.619521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:03:00+00:00, data_interval_end=2024-05-11 02:04:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:04:05.125265336Z [2024-05-11T02:04:05.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:04:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:04:05.217825894Z [2024-05-11T02:04:05.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:03:00+00:00 exited with status success for try_number 1 2024-05-11T02:04:05.225323146Z [2024-05-11T02:04:05.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:03:00+00:00, map_index=-1, run_start_date=2024-05-11 02:04:02.790656+00:00, run_end_date=2024-05-11 02:04:04.144194+00:00, run_duration=1.353538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:04:00.597243+00:00, queued_by_job_id=2, pid=13997 2024-05-11T02:04:06.277794554Z [2024-05-11T02:04:06.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:04:06.278415515Z [2024-05-11T02:04:06.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:03:00+00:00, run_id=scheduled__2024-05-11T02:03:00+00:00, run_start_date=2024-05-11 02:04:00.497502+00:00, run_end_date=2024-05-11 02:04:06.277997+00:00, run_duration=5.780495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:03:00+00:00, data_interval_end=2024-05-11 02:04:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:04:06.292139502Z [2024-05-11T02:04:06.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:04:00+00:00, run_after=2024-05-11T02:05:00+00:00 2024-05-11T02:04:06.322459717Z [2024-05-11T02:04:06.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:03:00+00:00 exited with status success for try_number 1 2024-05-11T02:04:06.327854329Z [2024-05-11T02:04:06.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:03:00+00:00, map_index=-1, run_start_date=2024-05-11 02:04:02.893845+00:00, run_end_date=2024-05-11 02:04:05.240917+00:00, run_duration=2.347072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:04:00.597243+00:00, queued_by_job_id=2, pid=13998 2024-05-11T02:05:00.785899113Z [2024-05-11T02:05:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:06:00+00:00 2024-05-11T02:05:00.797428630Z [2024-05-11T02:05:00.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:06:00+00:00 2024-05-11T02:05:00.808889848Z [2024-05-11T02:05:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:05:00.815154997Z [2024-05-11T02:05:00.814+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:05:00.886266403Z [2024-05-11T02:05:00.885+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:05:00.886325088Z 2024-05-11T02:05:00.886329809Z 2024-05-11T02:05:00.886333037Z 2024-05-11T02:05:00.886336220Z 2024-05-11T02:05:00.886348564Z [2024-05-11T02:05:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:05:00.886396361Z [2024-05-11T02:05:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:05:00.886444260Z [2024-05-11T02:05:00.886+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:05:00.886518431Z [2024-05-11T02:05:00.886+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:05:00.887037780Z [2024-05-11T02:05:00.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:05:00.887046477Z 2024-05-11T02:05:00.887050008Z 2024-05-11T02:05:00.887053307Z 2024-05-11T02:05:00.887056412Z 2024-05-11T02:05:00.890056750Z [2024-05-11T02:05:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:05:00.890187769Z [2024-05-11T02:05:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:05:00.890370861Z [2024-05-11T02:05:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:05:00.890453437Z [2024-05-11T02:05:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:05:00.890609757Z [2024-05-11T02:05:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:05:00.890692993Z [2024-05-11T02:05:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:05:00.890829064Z [2024-05-11T02:05:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:05:00.890912116Z [2024-05-11T02:05:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:05:01.336949332Z [2024-05-11T02:05:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:01.337133346Z [2024-05-11T02:05:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:01.337303574Z [2024-05-11T02:05:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:01.337457906Z [2024-05-11T02:05:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:01.346556754Z [2024-05-11T02:05:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00ee5a91-e1f0-404c-a059-350cf067b860 2024-05-11T02:05:01.346775546Z [2024-05-11T02:05:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to be475677-8932-45e7-90b6-57e41cd70402 2024-05-11T02:05:01.346980574Z [2024-05-11T02:05:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 356a4081-7e1c-4687-b05c-c15acb4986e4 2024-05-11T02:05:01.347272504Z [2024-05-11T02:05:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d0e4a8e-c526-4909-b3c2-f38c2007cb84 2024-05-11T02:05:02.547526080Z [2024-05-11T02:05:02.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:05:02.547922157Z [2024-05-11T02:05:02.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:04:00+00:00, run_id=scheduled__2024-05-11T02:04:00+00:00, run_start_date=2024-05-11 02:05:00.824861+00:00, run_end_date=2024-05-11 02:05:02.547435+00:00, run_duration=1.722574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:04:00+00:00, data_interval_end=2024-05-11 02:05:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:05:02.564353704Z [2024-05-11T02:05:02.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:06:00+00:00 2024-05-11T02:05:02.654838899Z [2024-05-11T02:05:02.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:02.661398108Z [2024-05-11T02:05:02.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:04:00+00:00, map_index=-1, run_start_date=2024-05-11 02:05:01.767153+00:00, run_end_date=2024-05-11 02:05:02.189758+00:00, run_duration=0.422605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:00.887727+00:00, queued_by_job_id=2, pid=14031 2024-05-11T02:05:03.756019852Z [2024-05-11T02:05:03.755+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:05:03.756055433Z 2024-05-11T02:05:03.756141305Z [2024-05-11T02:05:03.755+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:05:03.756606991Z [2024-05-11T02:05:03.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:05:03.756616916Z 2024-05-11T02:05:03.759691430Z [2024-05-11T02:05:03.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:05:03.759958879Z [2024-05-11T02:05:03.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:05:03.834824014Z [2024-05-11T02:05:03.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:03.834899393Z [2024-05-11T02:05:03.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:03.841253160Z [2024-05-11T02:05:03.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75d0776b-7111-4248-8d98-d33580d712a5 2024-05-11T02:05:03.841449868Z [2024-05-11T02:05:03.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:05:03.012090+00:00, run_end_date=2024-05-11 02:05:03.447220+00:00, run_duration=0.43513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:00.887727+00:00, queued_by_job_id=2, pid=14061 2024-05-11T02:05:05.028557394Z [2024-05-11T02:05:05.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:05:05.028939896Z [2024-05-11T02:05:05.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:04:00+00:00, run_id=scheduled__2024-05-11T02:04:00+00:00, run_start_date=2024-05-11 02:05:00.825839+00:00, run_end_date=2024-05-11 02:05:05.028420+00:00, run_duration=4.202581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:04:00+00:00, data_interval_end=2024-05-11 02:05:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:05:05.038543843Z [2024-05-11T02:05:05.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:06:00+00:00 2024-05-11T02:05:05.045575005Z [2024-05-11T02:05:05.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:05:05.045983500Z [2024-05-11T02:05:05.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:04:00+00:00, run_id=scheduled__2024-05-11T02:04:00+00:00, run_start_date=2024-05-11 02:05:00.826836+00:00, run_end_date=2024-05-11 02:05:05.045492+00:00, run_duration=4.218656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:04:00+00:00, data_interval_end=2024-05-11 02:05:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:05:05.057498315Z [2024-05-11T02:05:05.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:06:00+00:00 2024-05-11T02:05:05.114679776Z [2024-05-11T02:05:05.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:05.114872868Z [2024-05-11T02:05:05.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:05.122564082Z [2024-05-11T02:05:05.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:04:00+00:00, map_index=-1, run_start_date=2024-05-11 02:05:02.651438+00:00, run_end_date=2024-05-11 02:05:04.128187+00:00, run_duration=1.476749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:00.887727+00:00, queued_by_job_id=2, pid=14045 2024-05-11T02:05:05.123098682Z [2024-05-11T02:05:05.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:04:00+00:00, map_index=-1, run_start_date=2024-05-11 02:05:03.055193+00:00, run_end_date=2024-05-11 02:05:04.878019+00:00, run_duration=1.822826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:00.887727+00:00, queued_by_job_id=2, pid=14062 2024-05-11T02:05:06.205415168Z [2024-05-11T02:05:06.204+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:05:06.205433406Z 2024-05-11T02:05:06.205501515Z [2024-05-11T02:05:06.205+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:05:06.206838674Z [2024-05-11T02:05:06.206+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:05:06.206862436Z 2024-05-11T02:05:06.209327647Z [2024-05-11T02:05:06.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:05:06.209414307Z [2024-05-11T02:05:06.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:05:06.289839743Z [2024-05-11T02:05:06.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:06.289887558Z [2024-05-11T02:05:06.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:06.297133567Z [2024-05-11T02:05:06.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16173733-ca0c-4cb5-b03a-58e1ac703e62 2024-05-11T02:05:06.297288919Z [2024-05-11T02:05:06.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:05:05.452301+00:00, run_end_date=2024-05-11 02:05:05.791375+00:00, run_duration=0.339074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:03.756953+00:00, queued_by_job_id=2, pid=14090 2024-05-11T02:05:09.938948725Z [2024-05-11T02:05:09.938+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:05:09.939020698Z 2024-05-11T02:05:09.939058663Z [2024-05-11T02:05:09.938+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:05:09.939659541Z [2024-05-11T02:05:09.939+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:05:09.939681767Z 2024-05-11T02:05:09.941965498Z [2024-05-11T02:05:09.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:05:09.942129040Z [2024-05-11T02:05:09.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:05:10.037263669Z [2024-05-11T02:05:10.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status queued for try_number 1 2024-05-11T02:05:10.037452378Z [2024-05-11T02:05:10.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:10.042803590Z [2024-05-11T02:05:10.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to a02cf824-44ea-4082-8a86-b8dd91c64135 2024-05-11T02:05:10.043142108Z [2024-05-11T02:05:10.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=0, run_start_date=2024-05-11 02:05:07.961189+00:00, run_end_date=2024-05-11 02:05:09.292209+00:00, run_duration=1.33102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:06.207565+00:00, queued_by_job_id=2, pid=14101 2024-05-11T02:05:12.327362309Z [2024-05-11T02:05:12.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:05:12.328286049Z [2024-05-11T02:05:12.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:00:00+00:00, run_id=scheduled__2024-05-11T02:00:00+00:00, run_start_date=2024-05-11 02:05:00.823650+00:00, run_end_date=2024-05-11 02:05:12.327215+00:00, run_duration=11.503565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:00:00+00:00, data_interval_end=2024-05-11 02:05:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:05:12.335207981Z [2024-05-11T02:05:12.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:05:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:05:12.378787863Z [2024-05-11T02:05:12.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:00:00+00:00 exited with status success for try_number 1 2024-05-11T02:05:12.388903473Z [2024-05-11T02:05:12.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:00:00+00:00, map_index=-1, run_start_date=2024-05-11 02:05:11.654576+00:00, run_end_date=2024-05-11 02:05:12.127964+00:00, run_duration=0.473388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:05:09.940057+00:00, queued_by_job_id=2, pid=14114 2024-05-11T02:05:36.162742067Z [2024-05-11T02:05:36.161+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:06:00.626252698Z [2024-05-11T02:06:00.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:06:00+00:00, run_after=2024-05-11T02:07:00+00:00 2024-05-11T02:06:00.641059475Z [2024-05-11T02:06:00.640+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:06:00.653557324Z [2024-05-11T02:06:00.653+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:06:00.677738858Z [2024-05-11T02:06:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:06:00+00:00, run_after=2024-05-11T02:07:00+00:00 2024-05-11T02:06:00.810970661Z [2024-05-11T02:06:00.810+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:06:00.810993225Z 2024-05-11T02:06:00.810997890Z 2024-05-11T02:06:00.811001265Z 2024-05-11T02:06:00.811004673Z 2024-05-11T02:06:00.811014426Z [2024-05-11T02:06:00.810+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:06:00.811125235Z [2024-05-11T02:06:00.810+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:06:00.811205010Z [2024-05-11T02:06:00.811+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:06:00.811278764Z [2024-05-11T02:06:00.811+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:06:00.811996328Z [2024-05-11T02:06:00.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:06:00.812007996Z 2024-05-11T02:06:00.812011652Z 2024-05-11T02:06:00.812015596Z 2024-05-11T02:06:00.812018884Z 2024-05-11T02:06:00.815945317Z [2024-05-11T02:06:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:06:00.815994932Z [2024-05-11T02:06:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:06:00.816263867Z [2024-05-11T02:06:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:06:00.816327462Z [2024-05-11T02:06:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:06:00.816528372Z [2024-05-11T02:06:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:06:00.816572402Z [2024-05-11T02:06:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:06:00.816748088Z [2024-05-11T02:06:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:06:00.816826229Z [2024-05-11T02:06:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:06:01.224006560Z [2024-05-11T02:06:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status queued for try_number 1 2024-05-11T02:06:01.226143585Z [2024-05-11T02:06:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:06:01.226370333Z [2024-05-11T02:06:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:06:01.226574525Z [2024-05-11T02:06:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:06:01.235825104Z [2024-05-11T02:06:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d427ed2-9faf-4766-a363-09a647f57ebe 2024-05-11T02:06:01.236181343Z [2024-05-11T02:06:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf968a26-39bf-43cd-b6fe-3f30799c07fe 2024-05-11T02:06:01.236472569Z [2024-05-11T02:06:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9eb99ac-e8a2-4536-a65b-cbe4f626d141 2024-05-11T02:06:01.236740098Z [2024-05-11T02:06:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59a244d5-9cb2-4d63-a584-ff144cf5f071 2024-05-11T02:06:02.504484348Z [2024-05-11T02:06:02.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:06:02.505115506Z [2024-05-11T02:06:02.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:04:00+00:00, run_id=scheduled__2024-05-11T02:04:00+00:00, run_start_date=2024-05-11 02:06:00.700316+00:00, run_end_date=2024-05-11 02:06:02.504372+00:00, run_duration=1.804056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:04:00+00:00, data_interval_end=2024-05-11 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:06:02.513832783Z [2024-05-11T02:06:02.513+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:06:00+00:00, run_after=2024-05-11T02:08:00+00:00 2024-05-11T02:06:02.526490163Z [2024-05-11T02:06:02.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:06:02.526831672Z [2024-05-11T02:06:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:05:00+00:00, run_id=scheduled__2024-05-11T02:05:00+00:00, run_start_date=2024-05-11 02:06:00.701644+00:00, run_end_date=2024-05-11 02:06:02.526399+00:00, run_duration=1.824755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:05:00+00:00, data_interval_end=2024-05-11 02:06:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:06:02.538739884Z [2024-05-11T02:06:02.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:06:00+00:00, run_after=2024-05-11T02:07:00+00:00 2024-05-11T02:06:02.592862953Z [2024-05-11T02:06:02.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:04:00+00:00 exited with status success for try_number 1 2024-05-11T02:06:02.593373726Z [2024-05-11T02:06:02.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:06:02.609521542Z [2024-05-11T02:06:02.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:04:00+00:00, map_index=-1, run_start_date=2024-05-11 02:06:01.702642+00:00, run_end_date=2024-05-11 02:06:02.195925+00:00, run_duration=0.493283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:06:00.812838+00:00, queued_by_job_id=2, pid=14124 2024-05-11T02:06:02.610278369Z [2024-05-11T02:06:02.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=-1, run_start_date=2024-05-11 02:06:01.829012+00:00, run_end_date=2024-05-11 02:06:02.265878+00:00, run_duration=0.436866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:06:00.812838+00:00, queued_by_job_id=2, pid=14125 2024-05-11T02:06:05.759153629Z [2024-05-11T02:06:05.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:06:05.759453009Z [2024-05-11T02:06:05.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:05:00+00:00, run_id=scheduled__2024-05-11T02:05:00+00:00, run_start_date=2024-05-11 02:06:00.703339+00:00, run_end_date=2024-05-11 02:06:05.759032+00:00, run_duration=5.055693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:05:00+00:00, data_interval_end=2024-05-11 02:06:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:06:05.771248940Z [2024-05-11T02:06:05.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:06:00+00:00, run_after=2024-05-11T02:07:00+00:00 2024-05-11T02:06:05.779682059Z [2024-05-11T02:06:05.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:06:05.781295280Z [2024-05-11T02:06:05.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:05:00+00:00, run_id=scheduled__2024-05-11T02:05:00+00:00, run_start_date=2024-05-11 02:06:00.704515+00:00, run_end_date=2024-05-11 02:06:05.779533+00:00, run_duration=5.075018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:05:00+00:00, data_interval_end=2024-05-11 02:06:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:06:05.803012337Z [2024-05-11T02:06:05.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:06:00+00:00, run_after=2024-05-11T02:07:00+00:00 2024-05-11T02:06:05.856810435Z [2024-05-11T02:06:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:06:05.856876688Z [2024-05-11T02:06:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:06:05.868068022Z [2024-05-11T02:06:05.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=-1, run_start_date=2024-05-11 02:06:03.025495+00:00, run_end_date=2024-05-11 02:06:04.942008+00:00, run_duration=1.916513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:06:00.812838+00:00, queued_by_job_id=2, pid=14148 2024-05-11T02:06:05.868229935Z [2024-05-11T02:06:05.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=-1, run_start_date=2024-05-11 02:06:03.166066+00:00, run_end_date=2024-05-11 02:06:05.595440+00:00, run_duration=2.429374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:06:00.812838+00:00, queued_by_job_id=2, pid=14149 2024-05-11T02:07:00.565172611Z [2024-05-11T02:07:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:07:00+00:00, run_after=2024-05-11T02:08:00+00:00 2024-05-11T02:07:00.572323502Z [2024-05-11T02:07:00.572+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:07:00.583619442Z [2024-05-11T02:07:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:07:00+00:00, run_after=2024-05-11T02:08:00+00:00 2024-05-11T02:07:00.649287080Z [2024-05-11T02:07:00.648+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:07:00.649312811Z 2024-05-11T02:07:00.649316462Z 2024-05-11T02:07:00.649319705Z 2024-05-11T02:07:00.649322804Z [2024-05-11T02:07:00.649+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:07:00.649464934Z [2024-05-11T02:07:00.649+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:07:00.649630626Z [2024-05-11T02:07:00.649+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:07:00.650273733Z [2024-05-11T02:07:00.650+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:07:00.650286948Z 2024-05-11T02:07:00.650290465Z 2024-05-11T02:07:00.650293897Z 2024-05-11T02:07:00.653286128Z [2024-05-11T02:07:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:07:00.653462282Z [2024-05-11T02:07:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:07:00.653766075Z [2024-05-11T02:07:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:07:00.653948688Z [2024-05-11T02:07:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:07:00.654249041Z [2024-05-11T02:07:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:07:00.654388771Z [2024-05-11T02:07:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:07:00.856020820Z [2024-05-11T02:07:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status queued for try_number 1 2024-05-11T02:07:00.856344107Z [2024-05-11T02:07:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status queued for try_number 1 2024-05-11T02:07:00.856561532Z [2024-05-11T02:07:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status queued for try_number 1 2024-05-11T02:07:00.868274251Z [2024-05-11T02:07:00.867+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b2a2862-3eae-4128-a5f0-e809571be3b6 2024-05-11T02:07:00.868575309Z [2024-05-11T02:07:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71bd8198-e456-4817-8e95-430a71c4d788 2024-05-11T02:07:00.868886174Z [2024-05-11T02:07:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e693585-2be2-4609-b0e9-40406e9330eb 2024-05-11T02:07:02.031563071Z [2024-05-11T02:07:02.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:07:02.031805900Z [2024-05-11T02:07:02.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:06:00+00:00, run_id=scheduled__2024-05-11T02:06:00+00:00, run_start_date=2024-05-11 02:07:00.593783+00:00, run_end_date=2024-05-11 02:07:02.031452+00:00, run_duration=1.437669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:06:00+00:00, data_interval_end=2024-05-11 02:07:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:07:02.043067083Z [2024-05-11T02:07:02.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:07:00+00:00, run_after=2024-05-11T02:08:00+00:00 2024-05-11T02:07:02.106649340Z [2024-05-11T02:07:02.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status success for try_number 1 2024-05-11T02:07:02.112781658Z [2024-05-11T02:07:02.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:06:00+00:00, map_index=-1, run_start_date=2024-05-11 02:07:01.465727+00:00, run_end_date=2024-05-11 02:07:01.843787+00:00, run_duration=0.37806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:07:00.650956+00:00, queued_by_job_id=2, pid=14182 2024-05-11T02:07:04.568891388Z [2024-05-11T02:07:04.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:07:04.569456096Z [2024-05-11T02:07:04.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:06:00+00:00, run_id=scheduled__2024-05-11T02:06:00+00:00, run_start_date=2024-05-11 02:07:00.596531+00:00, run_end_date=2024-05-11 02:07:04.568672+00:00, run_duration=3.972141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:06:00+00:00, data_interval_end=2024-05-11 02:07:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:07:04.579787822Z [2024-05-11T02:07:04.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:07:00+00:00, run_after=2024-05-11T02:08:00+00:00 2024-05-11T02:07:04.634808407Z [2024-05-11T02:07:04.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status success for try_number 1 2024-05-11T02:07:04.644194219Z [2024-05-11T02:07:04.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:06:00+00:00, map_index=-1, run_start_date=2024-05-11 02:07:02.439761+00:00, run_end_date=2024-05-11 02:07:04.353938+00:00, run_duration=1.914177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:07:00.650956+00:00, queued_by_job_id=2, pid=14201 2024-05-11T02:07:05.722963669Z [2024-05-11T02:07:05.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:07:05.723449010Z [2024-05-11T02:07:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:06:00+00:00, run_id=scheduled__2024-05-11T02:06:00+00:00, run_start_date=2024-05-11 02:07:00.600844+00:00, run_end_date=2024-05-11 02:07:05.722923+00:00, run_duration=5.122079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:06:00+00:00, data_interval_end=2024-05-11 02:07:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:07:05.739501653Z [2024-05-11T02:07:05.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:07:00+00:00, run_after=2024-05-11T02:08:00+00:00 2024-05-11T02:07:05.788523843Z [2024-05-11T02:07:05.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status success for try_number 1 2024-05-11T02:07:05.795185383Z [2024-05-11T02:07:05.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:06:00+00:00, map_index=-1, run_start_date=2024-05-11 02:07:02.410176+00:00, run_end_date=2024-05-11 02:07:04.765553+00:00, run_duration=2.355377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:07:00.650956+00:00, queued_by_job_id=2, pid=14200 2024-05-11T02:08:00.453040477Z [2024-05-11T02:08:00.452+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:08:00.478782709Z [2024-05-11T02:08:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:08:00+00:00, run_after=2024-05-11T02:09:00+00:00 2024-05-11T02:08:00.489979303Z [2024-05-11T02:08:00.489+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:08:00.514464329Z [2024-05-11T02:08:00.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:08:00+00:00, run_after=2024-05-11T02:09:00+00:00 2024-05-11T02:08:00.623613211Z [2024-05-11T02:08:00.622+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:08:00.623641651Z 2024-05-11T02:08:00.623647103Z 2024-05-11T02:08:00.623651467Z 2024-05-11T02:08:00.623655571Z 2024-05-11T02:08:00.624092282Z [2024-05-11T02:08:00.623+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:08:00.624492523Z [2024-05-11T02:08:00.624+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:08:00.624843543Z [2024-05-11T02:08:00.624+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:08:00.625199073Z [2024-05-11T02:08:00.624+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:08:00.626768860Z [2024-05-11T02:08:00.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:08:00.626805120Z 2024-05-11T02:08:00.626814988Z 2024-05-11T02:08:00.626823719Z 2024-05-11T02:08:00.626832990Z 2024-05-11T02:08:00.634997114Z [2024-05-11T02:08:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:08:00.635035157Z [2024-05-11T02:08:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:08:00.635516466Z [2024-05-11T02:08:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:08:00.636053125Z [2024-05-11T02:08:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:08:00.636417400Z [2024-05-11T02:08:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:08:00.636683742Z [2024-05-11T02:08:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:08:00.637217412Z [2024-05-11T02:08:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:08:00.637385221Z [2024-05-11T02:08:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:08:01.255031451Z [2024-05-11T02:08:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status queued for try_number 1 2024-05-11T02:08:01.255087435Z [2024-05-11T02:08:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:07:00+00:00 exited with status queued for try_number 1 2024-05-11T02:08:01.255222522Z [2024-05-11T02:08:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:07:00+00:00 exited with status queued for try_number 1 2024-05-11T02:08:01.255425427Z [2024-05-11T02:08:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:07:00+00:00 exited with status queued for try_number 1 2024-05-11T02:08:01.276736047Z [2024-05-11T02:08:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to edb3a3e2-e034-4768-9135-0efc2c68b572 2024-05-11T02:08:01.281553686Z [2024-05-11T02:08:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32ecd842-8c00-4042-b075-be37822ce689 2024-05-11T02:08:01.281800430Z [2024-05-11T02:08:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to fab56972-d831-4d6d-b02a-d8b8ee0feec2 2024-05-11T02:08:01.281970085Z [2024-05-11T02:08:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34b1eb6c-f1db-4fe9-9e90-fd530b6fee31 2024-05-11T02:08:02.585943137Z [2024-05-11T02:08:02.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:08:02.586604388Z [2024-05-11T02:08:02.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:06:00+00:00, run_id=scheduled__2024-05-11T02:06:00+00:00, run_start_date=2024-05-11 02:08:00.529181+00:00, run_end_date=2024-05-11 02:08:02.585717+00:00, run_duration=2.056536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:06:00+00:00, data_interval_end=2024-05-11 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:08:02.595425478Z [2024-05-11T02:08:02.595+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:08:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:08:02.602473458Z [2024-05-11T02:08:02.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:08:02.602784126Z [2024-05-11T02:08:02.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:07:00+00:00, run_id=scheduled__2024-05-11T02:07:00+00:00, run_start_date=2024-05-11 02:08:00.530593+00:00, run_end_date=2024-05-11 02:08:02.602343+00:00, run_duration=2.07175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:07:00+00:00, data_interval_end=2024-05-11 02:08:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:08:02.612385355Z [2024-05-11T02:08:02.612+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:08:00+00:00, run_after=2024-05-11T02:09:00+00:00 2024-05-11T02:08:02.665709227Z [2024-05-11T02:08:02.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:06:00+00:00 exited with status success for try_number 1 2024-05-11T02:08:02.666133198Z [2024-05-11T02:08:02.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:07:00+00:00 exited with status success for try_number 1 2024-05-11T02:08:02.680561117Z [2024-05-11T02:08:02.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:06:00+00:00, map_index=-1, run_start_date=2024-05-11 02:08:01.606797+00:00, run_end_date=2024-05-11 02:08:02.018149+00:00, run_duration=0.411352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:08:00.629431+00:00, queued_by_job_id=2, pid=14234 2024-05-11T02:08:02.680830433Z [2024-05-11T02:08:02.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:07:00+00:00, map_index=-1, run_start_date=2024-05-11 02:08:01.840319+00:00, run_end_date=2024-05-11 02:08:02.333274+00:00, run_duration=0.492955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:08:00.629431+00:00, queued_by_job_id=2, pid=14235 2024-05-11T02:08:04.880567039Z [2024-05-11T02:08:04.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:08:04.880850527Z [2024-05-11T02:08:04.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:07:00+00:00, run_id=scheduled__2024-05-11T02:07:00+00:00, run_start_date=2024-05-11 02:08:00.531785+00:00, run_end_date=2024-05-11 02:08:04.880498+00:00, run_duration=4.348713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:07:00+00:00, data_interval_end=2024-05-11 02:08:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:08:04.890553381Z [2024-05-11T02:08:04.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:08:00+00:00, run_after=2024-05-11T02:09:00+00:00 2024-05-11T02:08:04.938643899Z [2024-05-11T02:08:04.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:07:00+00:00 exited with status success for try_number 1 2024-05-11T02:08:04.944990651Z [2024-05-11T02:08:04.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:07:00+00:00, map_index=-1, run_start_date=2024-05-11 02:08:03.292487+00:00, run_end_date=2024-05-11 02:08:04.681013+00:00, run_duration=1.388526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:08:00.629431+00:00, queued_by_job_id=2, pid=14259 2024-05-11T02:08:05.995146740Z [2024-05-11T02:08:05.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:08:05.995626817Z [2024-05-11T02:08:05.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:07:00+00:00, run_id=scheduled__2024-05-11T02:07:00+00:00, run_start_date=2024-05-11 02:08:00.532961+00:00, run_end_date=2024-05-11 02:08:05.995040+00:00, run_duration=5.462079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:07:00+00:00, data_interval_end=2024-05-11 02:08:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:08:06.007502188Z [2024-05-11T02:08:06.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:08:00+00:00, run_after=2024-05-11T02:09:00+00:00 2024-05-11T02:08:06.051339284Z [2024-05-11T02:08:06.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:07:00+00:00 exited with status success for try_number 1 2024-05-11T02:08:06.063593306Z [2024-05-11T02:08:06.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:07:00+00:00, map_index=-1, run_start_date=2024-05-11 02:08:03.111704+00:00, run_end_date=2024-05-11 02:08:05.182060+00:00, run_duration=2.070356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:08:00.629431+00:00, queued_by_job_id=2, pid=14258 2024-05-11T02:09:00.454118572Z [2024-05-11T02:09:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:09:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:09:00.469101021Z [2024-05-11T02:09:00.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:09:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:09:00.475610916Z [2024-05-11T02:09:00.475+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:09:00.561043348Z [2024-05-11T02:09:00.560+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:09:00.561066826Z 2024-05-11T02:09:00.561070564Z 2024-05-11T02:09:00.561099277Z 2024-05-11T02:09:00.561242537Z [2024-05-11T02:09:00.560+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:09:00.561394419Z [2024-05-11T02:09:00.561+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:09:00.561512827Z [2024-05-11T02:09:00.561+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:09:00.563488770Z [2024-05-11T02:09:00.562+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:09:00.563502686Z 2024-05-11T02:09:00.563505944Z 2024-05-11T02:09:00.563509189Z 2024-05-11T02:09:00.567555326Z [2024-05-11T02:09:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:09:00.567567436Z [2024-05-11T02:09:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:09:00.567570924Z [2024-05-11T02:09:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:09:00.567654459Z [2024-05-11T02:09:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:09:00.567950642Z [2024-05-11T02:09:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:09:00.568115251Z [2024-05-11T02:09:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:09:00.790086922Z [2024-05-11T02:09:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status queued for try_number 1 2024-05-11T02:09:00.790142922Z [2024-05-11T02:09:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status queued for try_number 1 2024-05-11T02:09:00.790204474Z [2024-05-11T02:09:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status queued for try_number 1 2024-05-11T02:09:00.798548224Z [2024-05-11T02:09:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4c148fb-25b5-4c59-8270-f1856839874d 2024-05-11T02:09:00.798636690Z [2024-05-11T02:09:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26cc0222-feb5-48fc-a017-04b960f99c5f 2024-05-11T02:09:00.798734300Z [2024-05-11T02:09:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 857ca128-9f35-4c9e-acfa-8754ddae288c 2024-05-11T02:09:02.356073415Z [2024-05-11T02:09:02.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:09:02.356419903Z [2024-05-11T02:09:02.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:08:00+00:00, run_id=scheduled__2024-05-11T02:08:00+00:00, run_start_date=2024-05-11 02:09:00.490806+00:00, run_end_date=2024-05-11 02:09:02.355827+00:00, run_duration=1.865021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:08:00+00:00, data_interval_end=2024-05-11 02:09:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:09:02.370379042Z [2024-05-11T02:09:02.369+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:09:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:09:02.428959309Z [2024-05-11T02:09:02.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status success for try_number 1 2024-05-11T02:09:02.436267142Z [2024-05-11T02:09:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:08:00+00:00, map_index=-1, run_start_date=2024-05-11 02:09:01.518769+00:00, run_end_date=2024-05-11 02:09:01.968547+00:00, run_duration=0.449778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:09:00.563222+00:00, queued_by_job_id=2, pid=14291 2024-05-11T02:09:05.718159192Z [2024-05-11T02:09:05.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:09:05.718616283Z [2024-05-11T02:09:05.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:08:00+00:00, run_id=scheduled__2024-05-11T02:08:00+00:00, run_start_date=2024-05-11 02:09:00.493171+00:00, run_end_date=2024-05-11 02:09:05.718043+00:00, run_duration=5.224872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:08:00+00:00, data_interval_end=2024-05-11 02:09:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:09:05.728654616Z [2024-05-11T02:09:05.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:09:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:09:05.737285465Z [2024-05-11T02:09:05.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:09:05.737876237Z [2024-05-11T02:09:05.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:08:00+00:00, run_id=scheduled__2024-05-11T02:08:00+00:00, run_start_date=2024-05-11 02:09:00.492075+00:00, run_end_date=2024-05-11 02:09:05.737561+00:00, run_duration=5.245486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:08:00+00:00, data_interval_end=2024-05-11 02:09:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:09:05.760768047Z [2024-05-11T02:09:05.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:09:00+00:00, run_after=2024-05-11T02:10:00+00:00 2024-05-11T02:09:05.825451165Z [2024-05-11T02:09:05.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status success for try_number 1 2024-05-11T02:09:05.830593857Z [2024-05-11T02:09:05.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:08:00+00:00, map_index=-1, run_start_date=2024-05-11 02:09:02.699015+00:00, run_end_date=2024-05-11 02:09:04.804167+00:00, run_duration=2.105152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:09:00.563222+00:00, queued_by_job_id=2, pid=14310 2024-05-11T02:09:06.893493197Z [2024-05-11T02:09:06.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status success for try_number 1 2024-05-11T02:09:06.898869254Z [2024-05-11T02:09:06.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:08:00+00:00, map_index=-1, run_start_date=2024-05-11 02:09:02.514261+00:00, run_end_date=2024-05-11 02:09:05.677702+00:00, run_duration=3.163441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:09:00.563222+00:00, queued_by_job_id=2, pid=14309 2024-05-11T02:10:00.856305328Z [2024-05-11T02:10:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:10:00.872175744Z [2024-05-11T02:10:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:10:00.899023163Z [2024-05-11T02:10:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:11:00+00:00 2024-05-11T02:10:00.908636696Z [2024-05-11T02:10:00.908+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:10:00.920301580Z [2024-05-11T02:10:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:11:00+00:00 2024-05-11T02:10:01.040628378Z [2024-05-11T02:10:01.031+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T02:10:01.040647943Z 2024-05-11T02:10:01.040667911Z 2024-05-11T02:10:01.040672117Z 2024-05-11T02:10:01.040675450Z 2024-05-11T02:10:01.040678609Z 2024-05-11T02:10:01.040681731Z [2024-05-11T02:10:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:10:01.040685215Z [2024-05-11T02:10:01.032+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:10:01.040688166Z [2024-05-11T02:10:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:10:01.040691078Z [2024-05-11T02:10:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:10:01.040694063Z [2024-05-11T02:10:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:10:01.040697197Z [2024-05-11T02:10:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:10:01.040700202Z 2024-05-11T02:10:01.040714470Z 2024-05-11T02:10:01.040717712Z 2024-05-11T02:10:01.040720672Z 2024-05-11T02:10:01.040723606Z 2024-05-11T02:10:01.040727638Z [2024-05-11T02:10:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:10:01.040731165Z [2024-05-11T02:10:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:10:01.040734824Z [2024-05-11T02:10:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:10:01.040738494Z [2024-05-11T02:10:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:10:01.040741481Z [2024-05-11T02:10:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:10:01.040744407Z [2024-05-11T02:10:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:10:01.040750294Z [2024-05-11T02:10:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:10:01.040753448Z [2024-05-11T02:10:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:10:01.040756956Z [2024-05-11T02:10:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:10:01.040760176Z [2024-05-11T02:10:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:10:01.625441750Z [2024-05-11T02:10:01.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:01.627547747Z [2024-05-11T02:10:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:01.627568942Z [2024-05-11T02:10:01.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:09:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:01.627573381Z [2024-05-11T02:10:01.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:09:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:01.627577320Z [2024-05-11T02:10:01.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:09:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:01.642398604Z [2024-05-11T02:10:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84d6ad25-c9c6-43a3-8f70-1d1cbdd40625 2024-05-11T02:10:01.642420778Z [2024-05-11T02:10:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 298c2156-4ad7-4eef-b066-772b99bbad57 2024-05-11T02:10:01.643501442Z [2024-05-11T02:10:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d99650b-e0ff-465c-9205-381af4f51ebb 2024-05-11T02:10:01.643519896Z [2024-05-11T02:10:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cd09b60-764f-4fd8-9ff5-b2319ebb444b 2024-05-11T02:10:01.643526602Z [2024-05-11T02:10:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 437b1f25-2446-4431-b512-36f255720e87 2024-05-11T02:10:02.913079236Z [2024-05-11T02:10:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:10:02.913257729Z [2024-05-11T02:10:02.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:08:00+00:00, run_id=scheduled__2024-05-11T02:08:00+00:00, run_start_date=2024-05-11 02:10:00.936900+00:00, run_end_date=2024-05-11 02:10:02.912981+00:00, run_duration=1.976081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:08:00+00:00, data_interval_end=2024-05-11 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:10:02.945827820Z [2024-05-11T02:10:02.945+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:12:00+00:00 2024-05-11T02:10:02.962241157Z [2024-05-11T02:10:02.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:10:02.962507937Z [2024-05-11T02:10:02.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:09:00+00:00, run_id=scheduled__2024-05-11T02:09:00+00:00, run_start_date=2024-05-11 02:10:00.939123+00:00, run_end_date=2024-05-11 02:10:02.962103+00:00, run_duration=2.02298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:09:00+00:00, data_interval_end=2024-05-11 02:10:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:10:02.973898813Z [2024-05-11T02:10:02.973+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:11:00+00:00 2024-05-11T02:10:03.061304165Z [2024-05-11T02:10:03.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:08:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:03.061328506Z [2024-05-11T02:10:03.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:09:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:03.074701616Z [2024-05-11T02:10:03.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:09:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:02.159826+00:00, run_end_date=2024-05-11 02:10:02.582106+00:00, run_duration=0.42228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:01.035167+00:00, queued_by_job_id=2, pid=14344 2024-05-11T02:10:03.074861833Z [2024-05-11T02:10:03.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:08:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:02.212370+00:00, run_end_date=2024-05-11 02:10:02.674896+00:00, run_duration=0.462526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:01.035167+00:00, queued_by_job_id=2, pid=14345 2024-05-11T02:10:04.662039537Z [2024-05-11T02:10:04.661+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:10:04.662096079Z 2024-05-11T02:10:04.662359113Z [2024-05-11T02:10:04.661+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:10:04.663624654Z [2024-05-11T02:10:04.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:10:04.663644185Z 2024-05-11T02:10:04.667153431Z [2024-05-11T02:10:04.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:10:04.667298938Z [2024-05-11T02:10:04.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:10:04.733097132Z [2024-05-11T02:10:04.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:04.733410186Z [2024-05-11T02:10:04.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:04.738897121Z [2024-05-11T02:10:04.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78008cc4-f8d8-4fd1-a15a-9135159cd203 2024-05-11T02:10:04.739311372Z [2024-05-11T02:10:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:03.823107+00:00, run_end_date=2024-05-11 02:10:04.234049+00:00, run_duration=0.410942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:01.035167+00:00, queued_by_job_id=2, pid=14381 2024-05-11T02:10:05.920265013Z [2024-05-11T02:10:05.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:10:05.920821172Z [2024-05-11T02:10:05.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:09:00+00:00, run_id=scheduled__2024-05-11T02:09:00+00:00, run_start_date=2024-05-11 02:10:00.943269+00:00, run_end_date=2024-05-11 02:10:05.920151+00:00, run_duration=4.976882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:09:00+00:00, data_interval_end=2024-05-11 02:10:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:10:05.930139680Z [2024-05-11T02:10:05.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:11:00+00:00 2024-05-11T02:10:05.936218514Z [2024-05-11T02:10:05.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:10:05.936543450Z [2024-05-11T02:10:05.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:09:00+00:00, run_id=scheduled__2024-05-11T02:09:00+00:00, run_start_date=2024-05-11 02:10:00.941124+00:00, run_end_date=2024-05-11 02:10:05.936141+00:00, run_duration=4.995017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:09:00+00:00, data_interval_end=2024-05-11 02:10:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:10:05.947148846Z [2024-05-11T02:10:05.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:11:00+00:00 2024-05-11T02:10:05.989827486Z [2024-05-11T02:10:05.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:09:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:05.989893027Z [2024-05-11T02:10:05.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:09:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:05.998313807Z [2024-05-11T02:10:05.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:09:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:03.686604+00:00, run_end_date=2024-05-11 02:10:05.059486+00:00, run_duration=1.372882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:01.035167+00:00, queued_by_job_id=2, pid=14375 2024-05-11T02:10:05.998488087Z [2024-05-11T02:10:05.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:09:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:03.559013+00:00, run_end_date=2024-05-11 02:10:05.173600+00:00, run_duration=1.614587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:01.035167+00:00, queued_by_job_id=2, pid=14369 2024-05-11T02:10:07.101042366Z [2024-05-11T02:10:07.099+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:10:07.101067534Z 2024-05-11T02:10:07.101590887Z [2024-05-11T02:10:07.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:10:07.106494446Z [2024-05-11T02:10:07.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:10:07.106516346Z 2024-05-11T02:10:07.120066747Z [2024-05-11T02:10:07.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:10:07.120277398Z [2024-05-11T02:10:07.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:10:07.171647003Z [2024-05-11T02:10:07.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:07.171841203Z [2024-05-11T02:10:07.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:07.179871353Z [2024-05-11T02:10:07.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d9cae0b-c46c-46be-80f5-17791d5550a2 2024-05-11T02:10:07.180156104Z [2024-05-11T02:10:07.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:06.355845+00:00, run_end_date=2024-05-11 02:10:06.748841+00:00, run_duration=0.392996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:04.664051+00:00, queued_by_job_id=2, pid=14408 2024-05-11T02:10:11.008650344Z [2024-05-11T02:10:11.008+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:10:11.008690899Z 2024-05-11T02:10:11.008714651Z [2024-05-11T02:10:11.008+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:10:11.009445978Z [2024-05-11T02:10:11.009+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:10:11.009460928Z 2024-05-11T02:10:11.016127206Z [2024-05-11T02:10:11.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:10:11.016318731Z [2024-05-11T02:10:11.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:10:11.176730414Z [2024-05-11T02:10:11.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status queued for try_number 1 2024-05-11T02:10:11.179019822Z [2024-05-11T02:10:11.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:11.198318472Z [2024-05-11T02:10:11.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e791ff9-a609-44c4-bec2-1b76ff57e21a 2024-05-11T02:10:11.198871292Z [2024-05-11T02:10:11.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=0, run_start_date=2024-05-11 02:10:08.902269+00:00, run_end_date=2024-05-11 02:10:10.260808+00:00, run_duration=1.358539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:07.108976+00:00, queued_by_job_id=2, pid=14419 2024-05-11T02:10:13.474052533Z [2024-05-11T02:10:13.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:10:13.474698376Z [2024-05-11T02:10:13.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:05:00+00:00, run_id=scheduled__2024-05-11T02:05:00+00:00, run_start_date=2024-05-11 02:10:00.934662+00:00, run_end_date=2024-05-11 02:10:13.473948+00:00, run_duration=12.539286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:05:00+00:00, data_interval_end=2024-05-11 02:10:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:10:13.489524129Z [2024-05-11T02:10:13.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:10:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:10:13.543151641Z [2024-05-11T02:10:13.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:05:00+00:00 exited with status success for try_number 1 2024-05-11T02:10:13.552751413Z [2024-05-11T02:10:13.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:05:00+00:00, map_index=-1, run_start_date=2024-05-11 02:10:12.736592+00:00, run_end_date=2024-05-11 02:10:13.113738+00:00, run_duration=0.377146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:10:11.010253+00:00, queued_by_job_id=2, pid=14432 2024-05-11T02:10:36.213778027Z [2024-05-11T02:10:36.213+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:11:00.152143058Z [2024-05-11T02:11:00.151+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:11:00.165588131Z [2024-05-11T02:11:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:11:00+00:00, run_after=2024-05-11T02:12:00+00:00 2024-05-11T02:11:00.179500108Z [2024-05-11T02:11:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:11:00+00:00, run_after=2024-05-11T02:12:00+00:00 2024-05-11T02:11:00.242326741Z [2024-05-11T02:11:00.241+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:11:00.242371572Z 2024-05-11T02:11:00.242381587Z 2024-05-11T02:11:00.242389049Z 2024-05-11T02:11:00.242501798Z [2024-05-11T02:11:00.242+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:11:00.242512473Z [2024-05-11T02:11:00.242+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:11:00.242643562Z [2024-05-11T02:11:00.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:11:00.243233100Z [2024-05-11T02:11:00.243+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:11:00.243247636Z 2024-05-11T02:11:00.243295241Z 2024-05-11T02:11:00.243302907Z 2024-05-11T02:11:00.246026402Z [2024-05-11T02:11:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:11:00.246912761Z [2024-05-11T02:11:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:11:00.247304298Z [2024-05-11T02:11:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:11:00.247444043Z [2024-05-11T02:11:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:11:00.247830066Z [2024-05-11T02:11:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:11:00.247847175Z [2024-05-11T02:11:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:11:00.529028438Z [2024-05-11T02:11:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:11:00.529202714Z [2024-05-11T02:11:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:11:00.529368356Z [2024-05-11T02:11:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:11:00.539621138Z [2024-05-11T02:11:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 011cd720-f08f-4d9a-b655-52b64969cf91 2024-05-11T02:11:00.539812595Z [2024-05-11T02:11:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2355baf-7194-48ec-bc56-67aa9978e157 2024-05-11T02:11:00.540008019Z [2024-05-11T02:11:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d32df14-76b9-457d-9dfa-e8e4615c75a4 2024-05-11T02:11:01.798620181Z [2024-05-11T02:11:01.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:11:01.799420060Z [2024-05-11T02:11:01.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:10:00+00:00, run_id=scheduled__2024-05-11T02:10:00+00:00, run_start_date=2024-05-11 02:11:00.190011+00:00, run_end_date=2024-05-11 02:11:01.798567+00:00, run_duration=1.608556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:10:00+00:00, data_interval_end=2024-05-11 02:11:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:11:01.818821815Z [2024-05-11T02:11:01.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:11:00+00:00, run_after=2024-05-11T02:12:00+00:00 2024-05-11T02:11:01.878164768Z [2024-05-11T02:11:01.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:11:01.886130013Z [2024-05-11T02:11:01.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:11:01.216267+00:00, run_end_date=2024-05-11 02:11:01.608221+00:00, run_duration=0.391954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:11:00.243856+00:00, queued_by_job_id=2, pid=14441 2024-05-11T02:11:04.077953424Z [2024-05-11T02:11:04.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:11:04.077980798Z [2024-05-11T02:11:04.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:10:00+00:00, run_id=scheduled__2024-05-11T02:10:00+00:00, run_start_date=2024-05-11 02:11:00.191072+00:00, run_end_date=2024-05-11 02:11:04.073690+00:00, run_duration=3.882618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:10:00+00:00, data_interval_end=2024-05-11 02:11:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:11:04.086788047Z [2024-05-11T02:11:04.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:11:00+00:00, run_after=2024-05-11T02:12:00+00:00 2024-05-11T02:11:04.099048402Z [2024-05-11T02:11:04.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:11:04.099341897Z [2024-05-11T02:11:04.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:10:00+00:00, run_id=scheduled__2024-05-11T02:10:00+00:00, run_start_date=2024-05-11 02:11:00.192017+00:00, run_end_date=2024-05-11 02:11:04.098853+00:00, run_duration=3.906836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:10:00+00:00, data_interval_end=2024-05-11 02:11:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:11:04.111210707Z [2024-05-11T02:11:04.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:11:00+00:00, run_after=2024-05-11T02:12:00+00:00 2024-05-11T02:11:04.140096626Z [2024-05-11T02:11:04.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:11:04.140123015Z [2024-05-11T02:11:04.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:11:04.146619232Z [2024-05-11T02:11:04.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:11:02.081828+00:00, run_end_date=2024-05-11 02:11:03.328365+00:00, run_duration=1.246537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:11:00.243856+00:00, queued_by_job_id=2, pid=14460 2024-05-11T02:11:04.146987053Z [2024-05-11T02:11:04.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:11:02.061974+00:00, run_end_date=2024-05-11 02:11:03.578260+00:00, run_duration=1.516286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:11:00.243856+00:00, queued_by_job_id=2, pid=14459 2024-05-11T02:12:00.353081209Z [2024-05-11T02:12:00.352+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:12:00.369612589Z [2024-05-11T02:12:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:12:00+00:00, run_after=2024-05-11T02:13:00+00:00 2024-05-11T02:12:00.380588300Z [2024-05-11T02:12:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:12:00+00:00, run_after=2024-05-11T02:13:00+00:00 2024-05-11T02:12:00.387053858Z [2024-05-11T02:12:00.386+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:12:00.469299640Z [2024-05-11T02:12:00.468+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:12:00.469346567Z 2024-05-11T02:12:00.469358252Z 2024-05-11T02:12:00.469366994Z 2024-05-11T02:12:00.469375398Z 2024-05-11T02:12:00.469410751Z [2024-05-11T02:12:00.469+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:12:00.469451996Z [2024-05-11T02:12:00.469+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:12:00.469470810Z [2024-05-11T02:12:00.469+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:12:00.469488255Z [2024-05-11T02:12:00.469+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:12:00.470187954Z [2024-05-11T02:12:00.469+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:12:00.470231455Z 2024-05-11T02:12:00.470238439Z 2024-05-11T02:12:00.470245062Z 2024-05-11T02:12:00.470250325Z 2024-05-11T02:12:00.474464618Z [2024-05-11T02:12:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:12:00.474507075Z [2024-05-11T02:12:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:12:00.474636859Z [2024-05-11T02:12:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:12:00.474755237Z [2024-05-11T02:12:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:12:00.474919466Z [2024-05-11T02:12:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:12:00.475048008Z [2024-05-11T02:12:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:12:00.475242802Z [2024-05-11T02:12:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:12:00.475321204Z [2024-05-11T02:12:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:12:00.721000867Z [2024-05-11T02:12:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:12:00.723836341Z [2024-05-11T02:12:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:11:00+00:00 exited with status queued for try_number 1 2024-05-11T02:12:00.724152688Z [2024-05-11T02:12:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:11:00+00:00 exited with status queued for try_number 1 2024-05-11T02:12:00.724402923Z [2024-05-11T02:12:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:11:00+00:00 exited with status queued for try_number 1 2024-05-11T02:12:00.734870407Z [2024-05-11T02:12:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4bd1555-f268-402e-b2bf-f8718d172db2 2024-05-11T02:12:00.735250400Z [2024-05-11T02:12:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3941a6dc-68a2-4505-909b-df51186fda5b 2024-05-11T02:12:00.735572639Z [2024-05-11T02:12:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8397e747-6c82-497d-8ae8-36a5329775e6 2024-05-11T02:12:00.735945100Z [2024-05-11T02:12:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c64ee42-cb20-43d0-bee5-ce8d74a28bac 2024-05-11T02:12:02.280838277Z [2024-05-11T02:12:02.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:12:02.281542990Z [2024-05-11T02:12:02.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:10:00+00:00, run_id=scheduled__2024-05-11T02:10:00+00:00, run_start_date=2024-05-11 02:12:00.395467+00:00, run_end_date=2024-05-11 02:12:02.281164+00:00, run_duration=1.885697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:10:00+00:00, data_interval_end=2024-05-11 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:12:02.289307261Z [2024-05-11T02:12:02.288+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:12:00+00:00, run_after=2024-05-11T02:14:00+00:00 2024-05-11T02:12:02.297270888Z [2024-05-11T02:12:02.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:12:02.299586440Z [2024-05-11T02:12:02.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:11:00+00:00, run_id=scheduled__2024-05-11T02:11:00+00:00, run_start_date=2024-05-11 02:12:00.396521+00:00, run_end_date=2024-05-11 02:12:02.298737+00:00, run_duration=1.902216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:11:00+00:00, data_interval_end=2024-05-11 02:12:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:12:02.329552643Z [2024-05-11T02:12:02.329+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:12:00+00:00, run_after=2024-05-11T02:13:00+00:00 2024-05-11T02:12:02.406172295Z [2024-05-11T02:12:02.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:12:02.407000861Z [2024-05-11T02:12:02.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:11:00+00:00 exited with status success for try_number 1 2024-05-11T02:12:02.419664192Z [2024-05-11T02:12:02.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:12:01.281734+00:00, run_end_date=2024-05-11 02:12:01.671979+00:00, run_duration=0.390245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:12:00.471315+00:00, queued_by_job_id=2, pid=14494 2024-05-11T02:12:02.420411708Z [2024-05-11T02:12:02.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:11:00+00:00, map_index=-1, run_start_date=2024-05-11 02:12:01.532136+00:00, run_end_date=2024-05-11 02:12:01.963016+00:00, run_duration=0.43088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:12:00.471315+00:00, queued_by_job_id=2, pid=14498 2024-05-11T02:12:05.724743919Z [2024-05-11T02:12:05.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:12:05.725119784Z [2024-05-11T02:12:05.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:11:00+00:00, run_id=scheduled__2024-05-11T02:11:00+00:00, run_start_date=2024-05-11 02:12:00.397440+00:00, run_end_date=2024-05-11 02:12:05.724655+00:00, run_duration=5.327215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:11:00+00:00, data_interval_end=2024-05-11 02:12:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:12:05.733823805Z [2024-05-11T02:12:05.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:12:00+00:00, run_after=2024-05-11T02:13:00+00:00 2024-05-11T02:12:05.788139790Z [2024-05-11T02:12:05.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:11:00+00:00 exited with status success for try_number 1 2024-05-11T02:12:05.795882367Z [2024-05-11T02:12:05.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:11:00+00:00, map_index=-1, run_start_date=2024-05-11 02:12:02.589638+00:00, run_end_date=2024-05-11 02:12:04.713480+00:00, run_duration=2.123842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:12:00.471315+00:00, queued_by_job_id=2, pid=14518 2024-05-11T02:12:06.857314732Z [2024-05-11T02:12:06.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:12:06.857675185Z [2024-05-11T02:12:06.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:11:00+00:00, run_id=scheduled__2024-05-11T02:11:00+00:00, run_start_date=2024-05-11 02:12:00.398348+00:00, run_end_date=2024-05-11 02:12:06.857395+00:00, run_duration=6.459047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:11:00+00:00, data_interval_end=2024-05-11 02:12:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:12:06.867124401Z [2024-05-11T02:12:06.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:12:00+00:00, run_after=2024-05-11T02:13:00+00:00 2024-05-11T02:12:06.913165981Z [2024-05-11T02:12:06.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:11:00+00:00 exited with status success for try_number 1 2024-05-11T02:12:06.921908892Z [2024-05-11T02:12:06.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:11:00+00:00, map_index=-1, run_start_date=2024-05-11 02:12:02.739416+00:00, run_end_date=2024-05-11 02:12:06.501335+00:00, run_duration=3.761919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:12:00.471315+00:00, queued_by_job_id=2, pid=14519 2024-05-11T02:13:00.855690931Z [2024-05-11T02:13:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:13:00.876561287Z [2024-05-11T02:13:00.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:13:00+00:00, run_after=2024-05-11T02:14:00+00:00 2024-05-11T02:13:00.900104925Z [2024-05-11T02:13:00.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:13:00+00:00, run_after=2024-05-11T02:14:00+00:00 2024-05-11T02:13:00.988831718Z [2024-05-11T02:13:00.988+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:13:00.988866692Z 2024-05-11T02:13:00.988870574Z 2024-05-11T02:13:00.988874206Z 2024-05-11T02:13:00.989036568Z [2024-05-11T02:13:00.988+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:13:00.989203668Z [2024-05-11T02:13:00.988+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:13:00.989382366Z [2024-05-11T02:13:00.989+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:13:00.990349290Z [2024-05-11T02:13:00.990+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:13:00.990358724Z 2024-05-11T02:13:00.990362265Z 2024-05-11T02:13:00.990365422Z 2024-05-11T02:13:00.995041196Z [2024-05-11T02:13:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:13:00.995168226Z [2024-05-11T02:13:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:13:00.995745318Z [2024-05-11T02:13:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:13:00.995991077Z [2024-05-11T02:13:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:13:00.996231605Z [2024-05-11T02:13:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:13:00.996391863Z [2024-05-11T02:13:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:13:01.363426560Z [2024-05-11T02:13:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status queued for try_number 1 2024-05-11T02:13:01.363574057Z [2024-05-11T02:13:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status queued for try_number 1 2024-05-11T02:13:01.363701282Z [2024-05-11T02:13:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status queued for try_number 1 2024-05-11T02:13:01.375482738Z [2024-05-11T02:13:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5de42ae8-4672-41f9-b6e4-1f91e98a9b65 2024-05-11T02:13:01.375620932Z [2024-05-11T02:13:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8b9276a-cba3-412d-86ce-83091f0bca67 2024-05-11T02:13:01.375850626Z [2024-05-11T02:13:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 935fd806-ff20-4062-b8b0-5b14be768124 2024-05-11T02:13:02.805079354Z [2024-05-11T02:13:02.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:13:02.805382966Z [2024-05-11T02:13:02.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:12:00+00:00, run_id=scheduled__2024-05-11T02:12:00+00:00, run_start_date=2024-05-11 02:13:00.917844+00:00, run_end_date=2024-05-11 02:13:02.805041+00:00, run_duration=1.887197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:12:00+00:00, data_interval_end=2024-05-11 02:13:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:13:02.817571616Z [2024-05-11T02:13:02.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:13:00+00:00, run_after=2024-05-11T02:14:00+00:00 2024-05-11T02:13:02.874675219Z [2024-05-11T02:13:02.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status success for try_number 1 2024-05-11T02:13:02.880455056Z [2024-05-11T02:13:02.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:12:00+00:00, map_index=-1, run_start_date=2024-05-11 02:13:01.884413+00:00, run_end_date=2024-05-11 02:13:02.312748+00:00, run_duration=0.428335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:13:00.992251+00:00, queued_by_job_id=2, pid=14551 2024-05-11T02:13:06.141922728Z [2024-05-11T02:13:06.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:13:06.142303024Z [2024-05-11T02:13:06.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:12:00+00:00, run_id=scheduled__2024-05-11T02:12:00+00:00, run_start_date=2024-05-11 02:13:00.919583+00:00, run_end_date=2024-05-11 02:13:06.141842+00:00, run_duration=5.222259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:12:00+00:00, data_interval_end=2024-05-11 02:13:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:13:06.151592981Z [2024-05-11T02:13:06.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:13:00+00:00, run_after=2024-05-11T02:14:00+00:00 2024-05-11T02:13:06.158182636Z [2024-05-11T02:13:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:13:06.158592023Z [2024-05-11T02:13:06.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:12:00+00:00, run_id=scheduled__2024-05-11T02:12:00+00:00, run_start_date=2024-05-11 02:13:00.921110+00:00, run_end_date=2024-05-11 02:13:06.158249+00:00, run_duration=5.237139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:12:00+00:00, data_interval_end=2024-05-11 02:13:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:13:06.169097966Z [2024-05-11T02:13:06.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:13:00+00:00, run_after=2024-05-11T02:14:00+00:00 2024-05-11T02:13:06.207008785Z [2024-05-11T02:13:06.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status success for try_number 1 2024-05-11T02:13:06.216027787Z [2024-05-11T02:13:06.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:12:00+00:00, map_index=-1, run_start_date=2024-05-11 02:13:03.278204+00:00, run_end_date=2024-05-11 02:13:05.980438+00:00, run_duration=2.702234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:13:00.992251+00:00, queued_by_job_id=2, pid=14570 2024-05-11T02:13:06.864428562Z [2024-05-11T02:13:06.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status success for try_number 1 2024-05-11T02:13:06.868954238Z [2024-05-11T02:13:06.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:12:00+00:00, map_index=-1, run_start_date=2024-05-11 02:13:02.989036+00:00, run_end_date=2024-05-11 02:13:06.091232+00:00, run_duration=3.102196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:13:00.992251+00:00, queued_by_job_id=2, pid=14566 2024-05-11T02:14:00.832683716Z [2024-05-11T02:14:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:14:00.852764369Z [2024-05-11T02:14:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:14:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:14:00.864041322Z [2024-05-11T02:14:00.863+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:14:00.878969629Z [2024-05-11T02:14:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:14:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:14:00.982498930Z [2024-05-11T02:14:00.981+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:14:00.982568822Z 2024-05-11T02:14:00.982577271Z 2024-05-11T02:14:00.982583454Z 2024-05-11T02:14:00.982589718Z 2024-05-11T02:14:00.982950032Z [2024-05-11T02:14:00.982+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:14:00.983320326Z [2024-05-11T02:14:00.983+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:14:00.983681217Z [2024-05-11T02:14:00.983+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:14:00.984088692Z [2024-05-11T02:14:00.983+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:14:00.985299714Z [2024-05-11T02:14:00.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:14:00.985365603Z 2024-05-11T02:14:00.985373338Z 2024-05-11T02:14:00.985379525Z 2024-05-11T02:14:00.985385880Z 2024-05-11T02:14:00.992289792Z [2024-05-11T02:14:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:14:00.992638015Z [2024-05-11T02:14:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:14:00.993009939Z [2024-05-11T02:14:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:14:00.993337808Z [2024-05-11T02:14:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:14:00.993741109Z [2024-05-11T02:14:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:14:00.994087913Z [2024-05-11T02:14:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:14:00.994556965Z [2024-05-11T02:14:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:14:00.994940636Z [2024-05-11T02:14:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:14:01.356866978Z [2024-05-11T02:14:01.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status queued for try_number 1 2024-05-11T02:14:01.357225649Z [2024-05-11T02:14:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:13:00+00:00 exited with status queued for try_number 1 2024-05-11T02:14:01.357427038Z [2024-05-11T02:14:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:13:00+00:00 exited with status queued for try_number 1 2024-05-11T02:14:01.357600640Z [2024-05-11T02:14:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:13:00+00:00 exited with status queued for try_number 1 2024-05-11T02:14:01.367458128Z [2024-05-11T02:14:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to b00e7b1e-b0d8-4d8f-b5fb-05db1a1fa14d 2024-05-11T02:14:01.367794633Z [2024-05-11T02:14:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0efa757c-7d78-4caa-aa3a-0f1dfd082b3b 2024-05-11T02:14:01.368052506Z [2024-05-11T02:14:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dc90013-ba4a-4ab6-a9a6-81090d07b479 2024-05-11T02:14:01.368276354Z [2024-05-11T02:14:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 604ec30d-d370-48dd-8073-bfaf44f05c60 2024-05-11T02:14:02.741451694Z [2024-05-11T02:14:02.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:14:02.742011245Z [2024-05-11T02:14:02.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:13:00+00:00, run_id=scheduled__2024-05-11T02:13:00+00:00, run_start_date=2024-05-11 02:14:00.893892+00:00, run_end_date=2024-05-11 02:14:02.741397+00:00, run_duration=1.847505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:13:00+00:00, data_interval_end=2024-05-11 02:14:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:14:02.750898799Z [2024-05-11T02:14:02.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:14:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:14:02.758763097Z [2024-05-11T02:14:02.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:14:02.758914204Z [2024-05-11T02:14:02.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:12:00+00:00, run_id=scheduled__2024-05-11T02:12:00+00:00, run_start_date=2024-05-11 02:14:00.892408+00:00, run_end_date=2024-05-11 02:14:02.758665+00:00, run_duration=1.866257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:12:00+00:00, data_interval_end=2024-05-11 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:14:02.767281800Z [2024-05-11T02:14:02.766+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:14:00+00:00, run_after=2024-05-11T02:16:00+00:00 2024-05-11T02:14:02.827088264Z [2024-05-11T02:14:02.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:12:00+00:00 exited with status success for try_number 1 2024-05-11T02:14:02.827118031Z [2024-05-11T02:14:02.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:13:00+00:00 exited with status success for try_number 1 2024-05-11T02:14:02.833904895Z [2024-05-11T02:14:02.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:12:00+00:00, map_index=-1, run_start_date=2024-05-11 02:14:01.807793+00:00, run_end_date=2024-05-11 02:14:02.204168+00:00, run_duration=0.396375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:14:00.987068+00:00, queued_by_job_id=2, pid=14603 2024-05-11T02:14:02.834155369Z [2024-05-11T02:14:02.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:13:00+00:00, map_index=-1, run_start_date=2024-05-11 02:14:01.871696+00:00, run_end_date=2024-05-11 02:14:02.298547+00:00, run_duration=0.426851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:14:00.987068+00:00, queued_by_job_id=2, pid=14604 2024-05-11T02:14:05.004839191Z [2024-05-11T02:14:05.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:14:05.005077428Z [2024-05-11T02:14:05.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:13:00+00:00, run_id=scheduled__2024-05-11T02:13:00+00:00, run_start_date=2024-05-11 02:14:00.895113+00:00, run_end_date=2024-05-11 02:14:05.004687+00:00, run_duration=4.109574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:13:00+00:00, data_interval_end=2024-05-11 02:14:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:14:05.019355295Z [2024-05-11T02:14:05.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:14:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:14:06.133927115Z [2024-05-11T02:14:06.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:14:06.134340600Z [2024-05-11T02:14:06.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:13:00+00:00, run_id=scheduled__2024-05-11T02:13:00+00:00, run_start_date=2024-05-11 02:14:00.896742+00:00, run_end_date=2024-05-11 02:14:06.133954+00:00, run_duration=5.237212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:13:00+00:00, data_interval_end=2024-05-11 02:14:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:14:06.142567190Z [2024-05-11T02:14:06.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:14:00+00:00, run_after=2024-05-11T02:15:00+00:00 2024-05-11T02:14:06.185195274Z [2024-05-11T02:14:06.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:13:00+00:00 exited with status success for try_number 1 2024-05-11T02:14:06.186406629Z [2024-05-11T02:14:06.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:13:00+00:00 exited with status success for try_number 1 2024-05-11T02:14:06.203060977Z [2024-05-11T02:14:06.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:13:00+00:00, map_index=-1, run_start_date=2024-05-11 02:14:03.009238+00:00, run_end_date=2024-05-11 02:14:04.946337+00:00, run_duration=1.937099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:14:00.987068+00:00, queued_by_job_id=2, pid=14627 2024-05-11T02:14:06.203463428Z [2024-05-11T02:14:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:13:00+00:00, map_index=-1, run_start_date=2024-05-11 02:14:03.141767+00:00, run_end_date=2024-05-11 02:14:05.634986+00:00, run_duration=2.493219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:14:00.987068+00:00, queued_by_job_id=2, pid=14628 2024-05-11T02:15:00.877049983Z [2024-05-11T02:15:00.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:15:00.893942657Z [2024-05-11T02:15:00.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:16:00+00:00 2024-05-11T02:15:00.909200706Z [2024-05-11T02:15:00.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:16:00+00:00 2024-05-11T02:15:00.917997296Z [2024-05-11T02:15:00.917+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:15:01.034032093Z [2024-05-11T02:15:01.031+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:15:01.034066447Z 2024-05-11T02:15:01.034070443Z 2024-05-11T02:15:01.034073618Z 2024-05-11T02:15:01.034076549Z 2024-05-11T02:15:01.034079594Z [2024-05-11T02:15:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:15:01.034082748Z [2024-05-11T02:15:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:15:01.034086008Z [2024-05-11T02:15:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:15:01.034088896Z [2024-05-11T02:15:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:15:01.034092626Z [2024-05-11T02:15:01.032+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:15:01.034095553Z 2024-05-11T02:15:01.034098503Z 2024-05-11T02:15:01.034101573Z 2024-05-11T02:15:01.034104513Z 2024-05-11T02:15:01.038010815Z [2024-05-11T02:15:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:15:01.038033393Z [2024-05-11T02:15:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:15:01.038037459Z [2024-05-11T02:15:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:15:01.038041031Z [2024-05-11T02:15:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:15:01.038044207Z [2024-05-11T02:15:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:15:01.038057302Z [2024-05-11T02:15:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:15:01.038751116Z [2024-05-11T02:15:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:15:01.038770282Z [2024-05-11T02:15:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:15:01.591288343Z [2024-05-11T02:15:01.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:01.591529030Z [2024-05-11T02:15:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:01.591777130Z [2024-05-11T02:15:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:01.592060685Z [2024-05-11T02:15:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:01.603955502Z [2024-05-11T02:15:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebe471a3-8e71-4367-94fb-eb7c131d7eee 2024-05-11T02:15:01.604450245Z [2024-05-11T02:15:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 889a9d11-526e-4d42-9f3a-658335f55992 2024-05-11T02:15:01.604853178Z [2024-05-11T02:15:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20b25e6b-a5c4-4212-86ff-fb94641aff48 2024-05-11T02:15:01.605099131Z [2024-05-11T02:15:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e5d2014-e854-4df5-a418-8a029632b15a 2024-05-11T02:15:02.669611050Z [2024-05-11T02:15:02.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:15:02.670229542Z [2024-05-11T02:15:02.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:14:00+00:00, run_id=scheduled__2024-05-11T02:14:00+00:00, run_start_date=2024-05-11 02:15:00.931504+00:00, run_end_date=2024-05-11 02:15:02.669761+00:00, run_duration=1.738257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:14:00+00:00, data_interval_end=2024-05-11 02:15:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:15:02.682326688Z [2024-05-11T02:15:02.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:16:00+00:00 2024-05-11T02:15:03.897305020Z [2024-05-11T02:15:03.896+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:15:03.897329717Z 2024-05-11T02:15:03.897583365Z [2024-05-11T02:15:03.897+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:15:03.898556740Z [2024-05-11T02:15:03.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:15:03.898568136Z 2024-05-11T02:15:03.902124242Z [2024-05-11T02:15:03.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:15:03.902661179Z [2024-05-11T02:15:03.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:15:03.971148353Z [2024-05-11T02:15:03.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:03.972439727Z [2024-05-11T02:15:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:03.972829341Z [2024-05-11T02:15:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:03.991434182Z [2024-05-11T02:15:03.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:15:03.287460+00:00, run_end_date=2024-05-11 02:15:03.718451+00:00, run_duration=0.430991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:01.033602+00:00, queued_by_job_id=2, pid=14687 2024-05-11T02:15:03.991655871Z [2024-05-11T02:15:03.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:14:00+00:00, map_index=-1, run_start_date=2024-05-11 02:15:02.177265+00:00, run_end_date=2024-05-11 02:15:02.629289+00:00, run_duration=0.452024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:01.033602+00:00, queued_by_job_id=2, pid=14661 2024-05-11T02:15:03.991896655Z [2024-05-11T02:15:03.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d8374a5-586e-4739-bed9-a4fd8c740b87 2024-05-11T02:15:05.209441467Z [2024-05-11T02:15:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:15:05.209766574Z [2024-05-11T02:15:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:14:00+00:00, run_id=scheduled__2024-05-11T02:14:00+00:00, run_start_date=2024-05-11 02:15:00.932684+00:00, run_end_date=2024-05-11 02:15:05.209473+00:00, run_duration=4.276789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:14:00+00:00, data_interval_end=2024-05-11 02:15:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:15:05.219236299Z [2024-05-11T02:15:05.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:16:00+00:00 2024-05-11T02:15:05.276795041Z [2024-05-11T02:15:05.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:05.284086353Z [2024-05-11T02:15:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:14:00+00:00, map_index=-1, run_start_date=2024-05-11 02:15:03.239968+00:00, run_end_date=2024-05-11 02:15:04.678879+00:00, run_duration=1.438911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:01.033602+00:00, queued_by_job_id=2, pid=14686 2024-05-11T02:15:06.338052466Z [2024-05-11T02:15:06.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:15:06.338400028Z [2024-05-11T02:15:06.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:14:00+00:00, run_id=scheduled__2024-05-11T02:14:00+00:00, run_start_date=2024-05-11 02:15:00.933850+00:00, run_end_date=2024-05-11 02:15:06.338024+00:00, run_duration=5.404174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:14:00+00:00, data_interval_end=2024-05-11 02:15:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:15:06.347340234Z [2024-05-11T02:15:06.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:16:00+00:00 2024-05-11T02:15:06.382190354Z [2024-05-11T02:15:06.381+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:15:06.382220741Z 2024-05-11T02:15:06.382423906Z [2024-05-11T02:15:06.382+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:15:06.383283531Z [2024-05-11T02:15:06.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:15:06.383298671Z 2024-05-11T02:15:06.385850657Z [2024-05-11T02:15:06.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:15:06.386129299Z [2024-05-11T02:15:06.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:15:06.443651930Z [2024-05-11T02:15:06.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:06.444049061Z [2024-05-11T02:15:06.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:06.444265910Z [2024-05-11T02:15:06.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:06.454317287Z [2024-05-11T02:15:06.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:14:00+00:00, map_index=-1, run_start_date=2024-05-11 02:15:03.249866+00:00, run_end_date=2024-05-11 02:15:05.573233+00:00, run_duration=2.323367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:01.033602+00:00, queued_by_job_id=2, pid=14685 2024-05-11T02:15:06.454715623Z [2024-05-11T02:15:06.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 853c1d7a-a47b-4572-af92-27d1e6cd5990 2024-05-11T02:15:06.455073203Z [2024-05-11T02:15:06.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:15:05.468973+00:00, run_end_date=2024-05-11 02:15:05.793305+00:00, run_duration=0.324332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:03.899138+00:00, queued_by_job_id=2, pid=14720 2024-05-11T02:15:09.821636501Z [2024-05-11T02:15:09.821+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:15:09.821674447Z 2024-05-11T02:15:09.821679890Z [2024-05-11T02:15:09.821+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:15:09.822414276Z [2024-05-11T02:15:09.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:15:09.822430523Z 2024-05-11T02:15:09.825225653Z [2024-05-11T02:15:09.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:15:09.825411522Z [2024-05-11T02:15:09.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:15:09.911422363Z [2024-05-11T02:15:09.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status queued for try_number 1 2024-05-11T02:15:09.912107711Z [2024-05-11T02:15:09.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:09.927864614Z [2024-05-11T02:15:09.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5b4901d-aff7-4341-a044-b7405bd4e70e 2024-05-11T02:15:09.928268067Z [2024-05-11T02:15:09.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=0, run_start_date=2024-05-11 02:15:08.084623+00:00, run_end_date=2024-05-11 02:15:09.378682+00:00, run_duration=1.294059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:06.383734+00:00, queued_by_job_id=2, pid=14731 2024-05-11T02:15:12.236793886Z [2024-05-11T02:15:12.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:15:12.237152063Z [2024-05-11T02:15:12.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:10:00+00:00, run_id=scheduled__2024-05-11T02:10:00+00:00, run_start_date=2024-05-11 02:15:00.930135+00:00, run_end_date=2024-05-11 02:15:12.236665+00:00, run_duration=11.30653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:10:00+00:00, data_interval_end=2024-05-11 02:15:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:15:12.245264315Z [2024-05-11T02:15:12.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:15:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:15:12.281970037Z [2024-05-11T02:15:12.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:10:00+00:00 exited with status success for try_number 1 2024-05-11T02:15:12.288749809Z [2024-05-11T02:15:12.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:10:00+00:00, map_index=-1, run_start_date=2024-05-11 02:15:11.557564+00:00, run_end_date=2024-05-11 02:15:11.952617+00:00, run_duration=0.395053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:15:09.822843+00:00, queued_by_job_id=2, pid=14744 2024-05-11T02:15:36.269256965Z [2024-05-11T02:15:36.268+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:16:00.968853101Z [2024-05-11T02:16:00.968+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:16:00.980780144Z [2024-05-11T02:16:00.980+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:16:00+00:00, run_after=2024-05-11T02:17:00+00:00 2024-05-11T02:16:00.987543199Z [2024-05-11T02:16:00.987+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:16:00.999285223Z [2024-05-11T02:16:00.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:16:00+00:00, run_after=2024-05-11T02:17:00+00:00 2024-05-11T02:16:01.134724854Z [2024-05-11T02:16:01.134+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:16:01.134750135Z 2024-05-11T02:16:01.134754167Z 2024-05-11T02:16:01.134757418Z 2024-05-11T02:16:01.134760593Z 2024-05-11T02:16:01.134930027Z [2024-05-11T02:16:01.134+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:16:01.135103926Z [2024-05-11T02:16:01.134+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:16:01.135244709Z [2024-05-11T02:16:01.135+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:16:01.135350448Z [2024-05-11T02:16:01.135+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:16:01.135912748Z [2024-05-11T02:16:01.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:16:01.135921062Z 2024-05-11T02:16:01.135925044Z 2024-05-11T02:16:01.135928803Z 2024-05-11T02:16:01.135932214Z 2024-05-11T02:16:01.139468975Z [2024-05-11T02:16:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:16:01.139795341Z [2024-05-11T02:16:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:16:01.140090985Z [2024-05-11T02:16:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:16:01.140258788Z [2024-05-11T02:16:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:16:01.140557863Z [2024-05-11T02:16:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:16:01.140700989Z [2024-05-11T02:16:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:16:01.140871856Z [2024-05-11T02:16:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:16:01.140983031Z [2024-05-11T02:16:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:16:01.679004180Z [2024-05-11T02:16:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status queued for try_number 1 2024-05-11T02:16:01.679281132Z [2024-05-11T02:16:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:16:01.679423876Z [2024-05-11T02:16:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:16:01.679567059Z [2024-05-11T02:16:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:16:01.700702207Z [2024-05-11T02:16:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44b5310e-2f7e-4773-90a3-30e113d2a1e4 2024-05-11T02:16:01.701005799Z [2024-05-11T02:16:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeffa9c4-d2f4-423c-9eeb-652fcd4df660 2024-05-11T02:16:01.701457777Z [2024-05-11T02:16:01.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e92f507-f82d-4db7-9786-3154e2213ed2 2024-05-11T02:16:01.701692873Z [2024-05-11T02:16:01.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 497cfc8c-c11c-4694-9858-674de7fb81b3 2024-05-11T02:16:02.939265803Z [2024-05-11T02:16:02.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:16:02.939832882Z [2024-05-11T02:16:02.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:14:00+00:00, run_id=scheduled__2024-05-11T02:14:00+00:00, run_start_date=2024-05-11 02:16:01.020258+00:00, run_end_date=2024-05-11 02:16:02.939361+00:00, run_duration=1.919103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:14:00+00:00, data_interval_end=2024-05-11 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:16:02.957522780Z [2024-05-11T02:16:02.956+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:16:00+00:00, run_after=2024-05-11T02:18:00+00:00 2024-05-11T02:16:02.972112343Z [2024-05-11T02:16:02.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:16:02.972257191Z [2024-05-11T02:16:02.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:15:00+00:00, run_id=scheduled__2024-05-11T02:15:00+00:00, run_start_date=2024-05-11 02:16:01.022100+00:00, run_end_date=2024-05-11 02:16:02.972020+00:00, run_duration=1.94992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:15:00+00:00, data_interval_end=2024-05-11 02:16:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:16:02.983107769Z [2024-05-11T02:16:02.982+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:16:00+00:00, run_after=2024-05-11T02:17:00+00:00 2024-05-11T02:16:03.073709183Z [2024-05-11T02:16:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:14:00+00:00 exited with status success for try_number 1 2024-05-11T02:16:03.073742781Z [2024-05-11T02:16:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:16:03.080630436Z [2024-05-11T02:16:03.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:14:00+00:00, map_index=-1, run_start_date=2024-05-11 02:16:02.018361+00:00, run_end_date=2024-05-11 02:16:02.475632+00:00, run_duration=0.457271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:16:01.136810+00:00, queued_by_job_id=2, pid=14755 2024-05-11T02:16:03.080760194Z [2024-05-11T02:16:03.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=-1, run_start_date=2024-05-11 02:16:01.933517+00:00, run_end_date=2024-05-11 02:16:02.378329+00:00, run_duration=0.444812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:16:01.136810+00:00, queued_by_job_id=2, pid=14754 2024-05-11T02:16:04.984372043Z [2024-05-11T02:16:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:16:04.984421186Z [2024-05-11T02:16:04.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:15:00+00:00, run_id=scheduled__2024-05-11T02:15:00+00:00, run_start_date=2024-05-11 02:16:01.024423+00:00, run_end_date=2024-05-11 02:16:04.984151+00:00, run_duration=3.959728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:15:00+00:00, data_interval_end=2024-05-11 02:16:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:16:04.992826605Z [2024-05-11T02:16:04.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:16:00+00:00, run_after=2024-05-11T02:17:00+00:00 2024-05-11T02:16:04.998640856Z [2024-05-11T02:16:04.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:16:04.998708962Z [2024-05-11T02:16:04.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:15:00+00:00, run_id=scheduled__2024-05-11T02:15:00+00:00, run_start_date=2024-05-11 02:16:01.026318+00:00, run_end_date=2024-05-11 02:16:04.998451+00:00, run_duration=3.972133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:15:00+00:00, data_interval_end=2024-05-11 02:16:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:16:05.007954340Z [2024-05-11T02:16:05.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:16:00+00:00, run_after=2024-05-11T02:17:00+00:00 2024-05-11T02:16:05.051394798Z [2024-05-11T02:16:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:16:05.051735653Z [2024-05-11T02:16:05.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:16:05.062085400Z [2024-05-11T02:16:05.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=-1, run_start_date=2024-05-11 02:16:03.054794+00:00, run_end_date=2024-05-11 02:16:04.822410+00:00, run_duration=1.767616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:16:01.136810+00:00, queued_by_job_id=2, pid=14779 2024-05-11T02:16:05.062543916Z [2024-05-11T02:16:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=-1, run_start_date=2024-05-11 02:16:03.058119+00:00, run_end_date=2024-05-11 02:16:04.397252+00:00, run_duration=1.339133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:16:01.136810+00:00, queued_by_job_id=2, pid=14778 2024-05-11T02:17:00.803547343Z [2024-05-11T02:17:00.802+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:17:00+00:00, run_after=2024-05-11T02:18:00+00:00 2024-05-11T02:17:00.814645790Z [2024-05-11T02:17:00.814+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:17:00.837793074Z [2024-05-11T02:17:00.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:17:00+00:00, run_after=2024-05-11T02:18:00+00:00 2024-05-11T02:17:00.907248156Z [2024-05-11T02:17:00.906+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:17:00.907276666Z 2024-05-11T02:17:00.907281884Z 2024-05-11T02:17:00.907286163Z 2024-05-11T02:17:00.907612214Z [2024-05-11T02:17:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:17:00.907911253Z [2024-05-11T02:17:00.907+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:17:00.908240192Z [2024-05-11T02:17:00.908+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:17:00.909094124Z [2024-05-11T02:17:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:17:00.909108311Z 2024-05-11T02:17:00.909112718Z 2024-05-11T02:17:00.909116941Z 2024-05-11T02:17:00.913333571Z [2024-05-11T02:17:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:17:00.913624927Z [2024-05-11T02:17:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:17:00.914026654Z [2024-05-11T02:17:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:17:00.914234511Z [2024-05-11T02:17:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:17:00.914524681Z [2024-05-11T02:17:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:17:00.914722506Z [2024-05-11T02:17:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:17:01.236360967Z [2024-05-11T02:17:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status queued for try_number 1 2024-05-11T02:17:01.236582972Z [2024-05-11T02:17:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status queued for try_number 1 2024-05-11T02:17:01.236729186Z [2024-05-11T02:17:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status queued for try_number 1 2024-05-11T02:17:01.243999529Z [2024-05-11T02:17:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19585b8e-0182-41ed-bce0-54ffa26e9bef 2024-05-11T02:17:01.244126880Z [2024-05-11T02:17:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to c61de055-1622-49bf-b1c8-591d74c9b426 2024-05-11T02:17:01.244286988Z [2024-05-11T02:17:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58b708ac-23dc-4803-9b8e-47f9780b4928 2024-05-11T02:17:02.387781065Z [2024-05-11T02:17:02.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:17:02.388343656Z [2024-05-11T02:17:02.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:16:00+00:00, run_id=scheduled__2024-05-11T02:16:00+00:00, run_start_date=2024-05-11 02:17:00.853625+00:00, run_end_date=2024-05-11 02:17:02.387878+00:00, run_duration=1.534253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:16:00+00:00, data_interval_end=2024-05-11 02:17:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:17:02.405631634Z [2024-05-11T02:17:02.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:17:00+00:00, run_after=2024-05-11T02:18:00+00:00 2024-05-11T02:17:02.494719991Z [2024-05-11T02:17:02.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status success for try_number 1 2024-05-11T02:17:02.501328408Z [2024-05-11T02:17:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:16:00+00:00, map_index=-1, run_start_date=2024-05-11 02:17:01.695193+00:00, run_end_date=2024-05-11 02:17:02.028022+00:00, run_duration=0.332829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:17:00.910366+00:00, queued_by_job_id=2, pid=14811 2024-05-11T02:17:04.644334439Z [2024-05-11T02:17:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:17:04.644857275Z [2024-05-11T02:17:04.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:16:00+00:00, run_id=scheduled__2024-05-11T02:16:00+00:00, run_start_date=2024-05-11 02:17:00.854937+00:00, run_end_date=2024-05-11 02:17:04.644172+00:00, run_duration=3.789235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:16:00+00:00, data_interval_end=2024-05-11 02:17:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:17:04.654453629Z [2024-05-11T02:17:04.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:17:00+00:00, run_after=2024-05-11T02:18:00+00:00 2024-05-11T02:17:04.697606654Z [2024-05-11T02:17:04.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status success for try_number 1 2024-05-11T02:17:04.703904312Z [2024-05-11T02:17:04.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:16:00+00:00, map_index=-1, run_start_date=2024-05-11 02:17:02.684214+00:00, run_end_date=2024-05-11 02:17:04.080567+00:00, run_duration=1.396353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:17:00.910366+00:00, queued_by_job_id=2, pid=14829 2024-05-11T02:17:05.739084485Z [2024-05-11T02:17:05.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:17:05.739299999Z [2024-05-11T02:17:05.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:16:00+00:00, run_id=scheduled__2024-05-11T02:16:00+00:00, run_start_date=2024-05-11 02:17:00.855989+00:00, run_end_date=2024-05-11 02:17:05.738809+00:00, run_duration=4.88282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:16:00+00:00, data_interval_end=2024-05-11 02:17:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:17:05.747448122Z [2024-05-11T02:17:05.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:17:00+00:00, run_after=2024-05-11T02:18:00+00:00 2024-05-11T02:17:05.777495765Z [2024-05-11T02:17:05.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status success for try_number 1 2024-05-11T02:17:05.781665913Z [2024-05-11T02:17:05.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:16:00+00:00, map_index=-1, run_start_date=2024-05-11 02:17:02.741202+00:00, run_end_date=2024-05-11 02:17:04.802363+00:00, run_duration=2.061161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:17:00.910366+00:00, queued_by_job_id=2, pid=14830 2024-05-11T02:18:00.236874471Z [2024-05-11T02:18:00.236+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:18:00.249472094Z [2024-05-11T02:18:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:18:00+00:00, run_after=2024-05-11T02:19:00+00:00 2024-05-11T02:18:00.261347152Z [2024-05-11T02:18:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:18:00+00:00, run_after=2024-05-11T02:19:00+00:00 2024-05-11T02:18:00.269139626Z [2024-05-11T02:18:00.268+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:18:00.354781353Z [2024-05-11T02:18:00.354+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:18:00.354822915Z 2024-05-11T02:18:00.354827214Z 2024-05-11T02:18:00.354830476Z 2024-05-11T02:18:00.354833656Z 2024-05-11T02:18:00.354843485Z [2024-05-11T02:18:00.354+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:18:00.355041650Z [2024-05-11T02:18:00.354+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:18:00.355046700Z [2024-05-11T02:18:00.354+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:18:00.355053048Z [2024-05-11T02:18:00.354+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:18:00.355752602Z [2024-05-11T02:18:00.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:18:00.355763361Z 2024-05-11T02:18:00.355766862Z 2024-05-11T02:18:00.355783427Z 2024-05-11T02:18:00.355786969Z 2024-05-11T02:18:00.361571902Z [2024-05-11T02:18:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:18:00.361806946Z [2024-05-11T02:18:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:18:00.362012614Z [2024-05-11T02:18:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:18:00.362045237Z [2024-05-11T02:18:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:18:00.362292660Z [2024-05-11T02:18:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:18:00.362316784Z [2024-05-11T02:18:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:18:00.362511636Z [2024-05-11T02:18:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:18:00.362535030Z [2024-05-11T02:18:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:18:00.786390646Z [2024-05-11T02:18:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status queued for try_number 1 2024-05-11T02:18:00.786555910Z [2024-05-11T02:18:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:17:00+00:00 exited with status queued for try_number 1 2024-05-11T02:18:00.786723612Z [2024-05-11T02:18:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:17:00+00:00 exited with status queued for try_number 1 2024-05-11T02:18:00.786897251Z [2024-05-11T02:18:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:17:00+00:00 exited with status queued for try_number 1 2024-05-11T02:18:00.795906924Z [2024-05-11T02:18:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e54bcf6-ff2e-4a37-9c06-321f13a3a14f 2024-05-11T02:18:00.797327884Z [2024-05-11T02:18:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to a688ad15-0b5a-497d-b2e5-33bed41155c6 2024-05-11T02:18:00.797529957Z [2024-05-11T02:18:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1e4f31c-1583-49a4-8d1f-a20d746172d9 2024-05-11T02:18:00.797716661Z [2024-05-11T02:18:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6f602be-1e00-40d2-b51f-1b82b95c62bb 2024-05-11T02:18:02.140332424Z [2024-05-11T02:18:02.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:18:02.141174382Z [2024-05-11T02:18:02.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:17:00+00:00, run_id=scheduled__2024-05-11T02:17:00+00:00, run_start_date=2024-05-11 02:18:00.284711+00:00, run_end_date=2024-05-11 02:18:02.140213+00:00, run_duration=1.855502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:17:00+00:00, data_interval_end=2024-05-11 02:18:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:18:02.149814574Z [2024-05-11T02:18:02.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:18:00+00:00, run_after=2024-05-11T02:19:00+00:00 2024-05-11T02:18:02.157318119Z [2024-05-11T02:18:02.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:18:02.157660145Z [2024-05-11T02:18:02.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:16:00+00:00, run_id=scheduled__2024-05-11T02:16:00+00:00, run_start_date=2024-05-11 02:18:00.283486+00:00, run_end_date=2024-05-11 02:18:02.157215+00:00, run_duration=1.873729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:16:00+00:00, data_interval_end=2024-05-11 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:18:02.165360364Z [2024-05-11T02:18:02.165+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:18:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:18:02.212929573Z [2024-05-11T02:18:02.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:16:00+00:00 exited with status success for try_number 1 2024-05-11T02:18:02.213333597Z [2024-05-11T02:18:02.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:17:00+00:00 exited with status success for try_number 1 2024-05-11T02:18:02.223892465Z [2024-05-11T02:18:02.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:17:00+00:00, map_index=-1, run_start_date=2024-05-11 02:18:01.214596+00:00, run_end_date=2024-05-11 02:18:01.564859+00:00, run_duration=0.350263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:18:00.357352+00:00, queued_by_job_id=2, pid=14864 2024-05-11T02:18:02.224968317Z [2024-05-11T02:18:02.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:16:00+00:00, map_index=-1, run_start_date=2024-05-11 02:18:01.522273+00:00, run_end_date=2024-05-11 02:18:01.931891+00:00, run_duration=0.409618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:18:00.357352+00:00, queued_by_job_id=2, pid=14870 2024-05-11T02:18:03.932829905Z [2024-05-11T02:18:03.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:18:03.933169412Z [2024-05-11T02:18:03.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:17:00+00:00, run_id=scheduled__2024-05-11T02:17:00+00:00, run_start_date=2024-05-11 02:18:00.285675+00:00, run_end_date=2024-05-11 02:18:03.932698+00:00, run_duration=3.647023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:17:00+00:00, data_interval_end=2024-05-11 02:18:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:18:03.942525843Z [2024-05-11T02:18:03.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:18:00+00:00, run_after=2024-05-11T02:19:00+00:00 2024-05-11T02:18:04.011910454Z [2024-05-11T02:18:04.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:17:00+00:00 exited with status success for try_number 1 2024-05-11T02:18:04.020885778Z [2024-05-11T02:18:04.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:17:00+00:00, map_index=-1, run_start_date=2024-05-11 02:18:02.522096+00:00, run_end_date=2024-05-11 02:18:03.671287+00:00, run_duration=1.149191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:18:00.357352+00:00, queued_by_job_id=2, pid=14889 2024-05-11T02:18:05.126525129Z [2024-05-11T02:18:05.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:18:05.126904946Z [2024-05-11T02:18:05.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:17:00+00:00, run_id=scheduled__2024-05-11T02:17:00+00:00, run_start_date=2024-05-11 02:18:00.286636+00:00, run_end_date=2024-05-11 02:18:05.126401+00:00, run_duration=4.839765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:17:00+00:00, data_interval_end=2024-05-11 02:18:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:18:05.140326804Z [2024-05-11T02:18:05.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:18:00+00:00, run_after=2024-05-11T02:19:00+00:00 2024-05-11T02:18:05.213354962Z [2024-05-11T02:18:05.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:17:00+00:00 exited with status success for try_number 1 2024-05-11T02:18:05.217997438Z [2024-05-11T02:18:05.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:17:00+00:00, map_index=-1, run_start_date=2024-05-11 02:18:02.372635+00:00, run_end_date=2024-05-11 02:18:03.932005+00:00, run_duration=1.55937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:18:00.357352+00:00, queued_by_job_id=2, pid=14888 2024-05-11T02:19:00.225141395Z [2024-05-11T02:19:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:19:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:19:00.237956667Z [2024-05-11T02:19:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:19:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:19:00.245742179Z [2024-05-11T02:19:00.245+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:19:00.342482532Z [2024-05-11T02:19:00.338+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:19:00.342510522Z 2024-05-11T02:19:00.342514384Z 2024-05-11T02:19:00.342517409Z 2024-05-11T02:19:00.342520765Z [2024-05-11T02:19:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:19:00.342523851Z [2024-05-11T02:19:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:19:00.342526819Z [2024-05-11T02:19:00.339+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:19:00.342530182Z [2024-05-11T02:19:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:19:00.342533139Z 2024-05-11T02:19:00.342536138Z 2024-05-11T02:19:00.342538997Z 2024-05-11T02:19:00.343614828Z [2024-05-11T02:19:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:19:00.345742138Z [2024-05-11T02:19:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:19:00.345752811Z [2024-05-11T02:19:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:19:00.345756716Z [2024-05-11T02:19:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:19:00.345760303Z [2024-05-11T02:19:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:19:00.345766962Z [2024-05-11T02:19:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:19:00.555316965Z [2024-05-11T02:19:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status queued for try_number 1 2024-05-11T02:19:00.555523196Z [2024-05-11T02:19:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status queued for try_number 1 2024-05-11T02:19:00.555787247Z [2024-05-11T02:19:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status queued for try_number 1 2024-05-11T02:19:00.565144324Z [2024-05-11T02:19:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b0e2ca2-d4d9-43a1-a10b-aa3e8794f089 2024-05-11T02:19:00.565291765Z [2024-05-11T02:19:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f1fc2cd-631e-4db1-9514-5db7a3897e1c 2024-05-11T02:19:00.565448431Z [2024-05-11T02:19:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94ea0bbd-581c-475a-a2e8-67c551c7ccef 2024-05-11T02:19:01.750970340Z [2024-05-11T02:19:01.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:19:01.751270410Z [2024-05-11T02:19:01.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:18:00+00:00, run_id=scheduled__2024-05-11T02:18:00+00:00, run_start_date=2024-05-11 02:19:00.256221+00:00, run_end_date=2024-05-11 02:19:01.750889+00:00, run_duration=1.494668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:18:00+00:00, data_interval_end=2024-05-11 02:19:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:19:01.761462303Z [2024-05-11T02:19:01.761+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:19:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:19:01.828706252Z [2024-05-11T02:19:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status success for try_number 1 2024-05-11T02:19:01.839723623Z [2024-05-11T02:19:01.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:18:00+00:00, map_index=-1, run_start_date=2024-05-11 02:19:01.266093+00:00, run_end_date=2024-05-11 02:19:01.645708+00:00, run_duration=0.379615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:19:00.340712+00:00, queued_by_job_id=2, pid=14921 2024-05-11T02:19:04.297465529Z [2024-05-11T02:19:04.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:19:04.297946102Z [2024-05-11T02:19:04.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:18:00+00:00, run_id=scheduled__2024-05-11T02:18:00+00:00, run_start_date=2024-05-11 02:19:00.257589+00:00, run_end_date=2024-05-11 02:19:04.297431+00:00, run_duration=4.039842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:18:00+00:00, data_interval_end=2024-05-11 02:19:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:19:04.312112638Z [2024-05-11T02:19:04.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:19:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:19:04.322960764Z [2024-05-11T02:19:04.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:19:04.323431192Z [2024-05-11T02:19:04.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:18:00+00:00, run_id=scheduled__2024-05-11T02:18:00+00:00, run_start_date=2024-05-11 02:19:00.258806+00:00, run_end_date=2024-05-11 02:19:04.322910+00:00, run_duration=4.064104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:18:00+00:00, data_interval_end=2024-05-11 02:19:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:19:04.339856710Z [2024-05-11T02:19:04.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:19:00+00:00, run_after=2024-05-11T02:20:00+00:00 2024-05-11T02:19:04.384264852Z [2024-05-11T02:19:04.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status success for try_number 1 2024-05-11T02:19:04.384371839Z [2024-05-11T02:19:04.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status success for try_number 1 2024-05-11T02:19:04.394768961Z [2024-05-11T02:19:04.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:18:00+00:00, map_index=-1, run_start_date=2024-05-11 02:19:02.242229+00:00, run_end_date=2024-05-11 02:19:03.632981+00:00, run_duration=1.390752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:19:00.340712+00:00, queued_by_job_id=2, pid=14939 2024-05-11T02:19:04.394977046Z [2024-05-11T02:19:04.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:18:00+00:00, map_index=-1, run_start_date=2024-05-11 02:19:02.258843+00:00, run_end_date=2024-05-11 02:19:03.939266+00:00, run_duration=1.680423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:19:00.340712+00:00, queued_by_job_id=2, pid=14940 2024-05-11T02:20:00.073266964Z [2024-05-11T02:20:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:21:00+00:00 2024-05-11T02:20:00.085355692Z [2024-05-11T02:20:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:21:00+00:00 2024-05-11T02:20:00.100624044Z [2024-05-11T02:20:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:20:00.107294544Z [2024-05-11T02:20:00.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:20:00.113249780Z [2024-05-11T02:20:00.112+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:20:00.209955024Z [2024-05-11T02:20:00.209+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T02:20:00.209999497Z 2024-05-11T02:20:00.210004134Z 2024-05-11T02:20:00.210011322Z 2024-05-11T02:20:00.210014668Z 2024-05-11T02:20:00.210017999Z 2024-05-11T02:20:00.210201423Z [2024-05-11T02:20:00.209+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:20:00.210283803Z [2024-05-11T02:20:00.209+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:20:00.210362008Z [2024-05-11T02:20:00.210+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:20:00.210383632Z [2024-05-11T02:20:00.210+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:20:00.210392764Z [2024-05-11T02:20:00.210+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:20:00.210893758Z [2024-05-11T02:20:00.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:20:00.210917881Z 2024-05-11T02:20:00.210928733Z 2024-05-11T02:20:00.210937653Z 2024-05-11T02:20:00.210946338Z 2024-05-11T02:20:00.210954849Z 2024-05-11T02:20:00.216896674Z [2024-05-11T02:20:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:20:00.216946877Z [2024-05-11T02:20:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:20:00.217122665Z [2024-05-11T02:20:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:20:00.217143744Z [2024-05-11T02:20:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:20:00.217335727Z [2024-05-11T02:20:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:20:00.217370829Z [2024-05-11T02:20:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:20:00.217566031Z [2024-05-11T02:20:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:20:00.217686732Z [2024-05-11T02:20:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:20:00.217969932Z [2024-05-11T02:20:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:20:00.221984375Z [2024-05-11T02:20:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:20:00.818964668Z [2024-05-11T02:20:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:00.820367897Z [2024-05-11T02:20:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:00.820621940Z [2024-05-11T02:20:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:19:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:00.820814604Z [2024-05-11T02:20:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:19:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:00.821018013Z [2024-05-11T02:20:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:19:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:00.841428220Z [2024-05-11T02:20:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c1cae79-16cd-4d9d-9c3b-841e1672ebf1 2024-05-11T02:20:00.841753497Z [2024-05-11T02:20:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d0c0119-e0fc-4a6d-b957-3e21abd1ff25 2024-05-11T02:20:00.842062122Z [2024-05-11T02:20:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1b3deaa-0c75-4c89-b320-af2e0ad4284e 2024-05-11T02:20:00.842352580Z [2024-05-11T02:20:00.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd126a82-f14c-44c3-9e79-ac1fecd4c182 2024-05-11T02:20:00.842588399Z [2024-05-11T02:20:00.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to aef56105-9780-4a37-a97f-97c541f1bc2d 2024-05-11T02:20:02.231573058Z [2024-05-11T02:20:02.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:20:02.231896318Z [2024-05-11T02:20:02.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:18:00+00:00, run_id=scheduled__2024-05-11T02:18:00+00:00, run_start_date=2024-05-11 02:20:00.124386+00:00, run_end_date=2024-05-11 02:20:02.231498+00:00, run_duration=2.107112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:18:00+00:00, data_interval_end=2024-05-11 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:20:02.243418396Z [2024-05-11T02:20:02.243+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:22:00+00:00 2024-05-11T02:20:03.353148642Z [2024-05-11T02:20:03.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:20:03.353421879Z [2024-05-11T02:20:03.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:19:00+00:00, run_id=scheduled__2024-05-11T02:19:00+00:00, run_start_date=2024-05-11 02:20:00.125359+00:00, run_end_date=2024-05-11 02:20:03.353040+00:00, run_duration=3.227681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:19:00+00:00, data_interval_end=2024-05-11 02:20:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:20:03.363515730Z [2024-05-11T02:20:03.363+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:21:00+00:00 2024-05-11T02:20:03.406323788Z [2024-05-11T02:20:03.405+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:20:03.406349122Z 2024-05-11T02:20:03.406541253Z [2024-05-11T02:20:03.406+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:20:03.407202408Z [2024-05-11T02:20:03.407+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:20:03.407212485Z 2024-05-11T02:20:03.409954892Z [2024-05-11T02:20:03.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:20:03.410174245Z [2024-05-11T02:20:03.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:20:03.560569401Z [2024-05-11T02:20:03.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:03.560597915Z [2024-05-11T02:20:03.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:03.560750129Z [2024-05-11T02:20:03.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:18:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:03.560819155Z [2024-05-11T02:20:03.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:19:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:03.572768814Z [2024-05-11T02:20:03.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5c9ae87-3ae3-464d-996d-dc9090c429d0 2024-05-11T02:20:03.573134135Z [2024-05-11T02:20:03.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:19:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:02.256349+00:00, run_end_date=2024-05-11 02:20:02.721470+00:00, run_duration=0.465121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:00.211686+00:00, queued_by_job_id=2, pid=14982 2024-05-11T02:20:03.574445089Z [2024-05-11T02:20:03.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:02.689492+00:00, run_end_date=2024-05-11 02:20:03.109185+00:00, run_duration=0.419693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:00.211686+00:00, queued_by_job_id=2, pid=14995 2024-05-11T02:20:03.575339876Z [2024-05-11T02:20:03.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:18:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:01.612718+00:00, run_end_date=2024-05-11 02:20:02.137544+00:00, run_duration=0.524826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:00.211686+00:00, queued_by_job_id=2, pid=14971 2024-05-11T02:20:05.982959581Z [2024-05-11T02:20:05.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:20:05.983393302Z [2024-05-11T02:20:05.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:19:00+00:00, run_id=scheduled__2024-05-11T02:19:00+00:00, run_start_date=2024-05-11 02:20:00.126325+00:00, run_end_date=2024-05-11 02:20:05.982824+00:00, run_duration=5.856499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:19:00+00:00, data_interval_end=2024-05-11 02:20:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:20:05.994442372Z [2024-05-11T02:20:05.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:21:00+00:00 2024-05-11T02:20:06.001345633Z [2024-05-11T02:20:06.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:20:06.001700474Z [2024-05-11T02:20:06.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:19:00+00:00, run_id=scheduled__2024-05-11T02:19:00+00:00, run_start_date=2024-05-11 02:20:00.127264+00:00, run_end_date=2024-05-11 02:20:06.001217+00:00, run_duration=5.873953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:19:00+00:00, data_interval_end=2024-05-11 02:20:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:20:06.010970861Z [2024-05-11T02:20:06.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:21:00+00:00 2024-05-11T02:20:06.039403219Z [2024-05-11T02:20:06.039+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:20:06.039427155Z 2024-05-11T02:20:06.039615685Z [2024-05-11T02:20:06.039+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:20:06.040341933Z [2024-05-11T02:20:06.040+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:20:06.040347398Z 2024-05-11T02:20:06.042848499Z [2024-05-11T02:20:06.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:20:06.043041963Z [2024-05-11T02:20:06.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:20:06.110603228Z [2024-05-11T02:20:06.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:06.111076979Z [2024-05-11T02:20:06.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:19:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:06.111600773Z [2024-05-11T02:20:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:19:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:06.111894844Z [2024-05-11T02:20:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:06.128547786Z [2024-05-11T02:20:06.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:19:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:03.502630+00:00, run_end_date=2024-05-11 02:20:05.051116+00:00, run_duration=1.548486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:00.211686+00:00, queued_by_job_id=2, pid=15012 2024-05-11T02:20:06.129070048Z [2024-05-11T02:20:06.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:05.113474+00:00, run_end_date=2024-05-11 02:20:05.445573+00:00, run_duration=0.332099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:03.407645+00:00, queued_by_job_id=2, pid=15030 2024-05-11T02:20:06.129501339Z [2024-05-11T02:20:06.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2dfec67-d87b-4244-9bd5-735bec86d65e 2024-05-11T02:20:06.129883604Z [2024-05-11T02:20:06.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:19:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:03.654867+00:00, run_end_date=2024-05-11 02:20:05.590158+00:00, run_duration=1.935291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:00.211686+00:00, queued_by_job_id=2, pid=15013 2024-05-11T02:20:09.213335487Z [2024-05-11T02:20:09.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:20:09.213368460Z 2024-05-11T02:20:09.213681450Z [2024-05-11T02:20:09.213+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:20:09.214437849Z [2024-05-11T02:20:09.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:20:09.214454723Z 2024-05-11T02:20:09.217206147Z [2024-05-11T02:20:09.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:20:09.217359298Z [2024-05-11T02:20:09.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:20:09.275646623Z [2024-05-11T02:20:09.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status queued for try_number 1 2024-05-11T02:20:09.275727825Z [2024-05-11T02:20:09.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:09.283161061Z [2024-05-11T02:20:09.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49e3b94a-763c-489e-9b84-4438867efcf5 2024-05-11T02:20:09.283454751Z [2024-05-11T02:20:09.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=0, run_start_date=2024-05-11 02:20:07.762322+00:00, run_end_date=2024-05-11 02:20:09.007754+00:00, run_duration=1.245432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:06.040786+00:00, queued_by_job_id=2, pid=15051 2024-05-11T02:20:12.332982541Z [2024-05-11T02:20:12.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:20:12.333209607Z [2024-05-11T02:20:12.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:15:00+00:00, run_id=scheduled__2024-05-11T02:15:00+00:00, run_start_date=2024-05-11 02:20:00.123079+00:00, run_end_date=2024-05-11 02:20:12.332848+00:00, run_duration=12.209769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:15:00+00:00, data_interval_end=2024-05-11 02:20:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:20:12.340372880Z [2024-05-11T02:20:12.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:20:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:20:12.373100781Z [2024-05-11T02:20:12.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:15:00+00:00 exited with status success for try_number 1 2024-05-11T02:20:12.378658776Z [2024-05-11T02:20:12.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:15:00+00:00, map_index=-1, run_start_date=2024-05-11 02:20:10.815246+00:00, run_end_date=2024-05-11 02:20:11.242530+00:00, run_duration=0.427284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:20:09.214839+00:00, queued_by_job_id=2, pid=15064 2024-05-11T02:20:36.344582100Z [2024-05-11T02:20:36.344+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:21:00.949504343Z [2024-05-11T02:21:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:21:00+00:00, run_after=2024-05-11T02:22:00+00:00 2024-05-11T02:21:00.961653211Z [2024-05-11T02:21:00.961+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:21:00.974155552Z [2024-05-11T02:21:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:21:00+00:00, run_after=2024-05-11T02:22:00+00:00 2024-05-11T02:21:01.056527113Z [2024-05-11T02:21:01.055+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:21:01.056560360Z 2024-05-11T02:21:01.056564228Z 2024-05-11T02:21:01.056587680Z 2024-05-11T02:21:01.056591163Z [2024-05-11T02:21:01.055+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:21:01.056594232Z [2024-05-11T02:21:01.056+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:21:01.056597356Z [2024-05-11T02:21:01.056+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:21:01.057616427Z [2024-05-11T02:21:01.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:21:01.057626917Z 2024-05-11T02:21:01.057630593Z 2024-05-11T02:21:01.057633766Z 2024-05-11T02:21:01.072288082Z [2024-05-11T02:21:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:21:01.072309029Z [2024-05-11T02:21:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:21:01.072312891Z [2024-05-11T02:21:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:21:01.072316154Z [2024-05-11T02:21:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:21:01.072658109Z [2024-05-11T02:21:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:21:01.072789320Z [2024-05-11T02:21:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:21:01.374415228Z [2024-05-11T02:21:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:21:01.374690485Z [2024-05-11T02:21:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:21:01.374926314Z [2024-05-11T02:21:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:21:01.384687496Z [2024-05-11T02:21:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42acf31c-b079-439d-bf66-c21b7a0539fa 2024-05-11T02:21:01.385062313Z [2024-05-11T02:21:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1565cfb-94e0-454c-b978-4f217f3b2759 2024-05-11T02:21:01.385405666Z [2024-05-11T02:21:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8734c90-8a93-4f48-8908-3e0d1df12fd6 2024-05-11T02:21:02.534307688Z [2024-05-11T02:21:02.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:21:02.535629594Z [2024-05-11T02:21:02.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:20:00+00:00, run_id=scheduled__2024-05-11T02:20:00+00:00, run_start_date=2024-05-11 02:21:00.987753+00:00, run_end_date=2024-05-11 02:21:02.534169+00:00, run_duration=1.546416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:20:00+00:00, data_interval_end=2024-05-11 02:21:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:21:02.575864742Z [2024-05-11T02:21:02.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:21:00+00:00, run_after=2024-05-11T02:22:00+00:00 2024-05-11T02:21:02.689984527Z [2024-05-11T02:21:02.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:21:02.695590065Z [2024-05-11T02:21:02.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:21:01.866560+00:00, run_end_date=2024-05-11 02:21:02.259899+00:00, run_duration=0.393339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:21:01.067491+00:00, queued_by_job_id=2, pid=15073 2024-05-11T02:21:05.345169124Z [2024-05-11T02:21:05.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:21:05.345470136Z [2024-05-11T02:21:05.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:20:00+00:00, run_id=scheduled__2024-05-11T02:20:00+00:00, run_start_date=2024-05-11 02:21:00.989142+00:00, run_end_date=2024-05-11 02:21:05.345061+00:00, run_duration=4.355919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:20:00+00:00, data_interval_end=2024-05-11 02:21:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:21:05.354750287Z [2024-05-11T02:21:05.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:21:00+00:00, run_after=2024-05-11T02:22:00+00:00 2024-05-11T02:21:05.410849167Z [2024-05-11T02:21:05.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:21:05.419831063Z [2024-05-11T02:21:05.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:21:02.908165+00:00, run_end_date=2024-05-11 02:21:05.108598+00:00, run_duration=2.200433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:21:01.067491+00:00, queued_by_job_id=2, pid=15091 2024-05-11T02:21:06.483512299Z [2024-05-11T02:21:06.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:21:06.484246000Z [2024-05-11T02:21:06.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:20:00+00:00, run_id=scheduled__2024-05-11T02:20:00+00:00, run_start_date=2024-05-11 02:21:00.990321+00:00, run_end_date=2024-05-11 02:21:06.483399+00:00, run_duration=5.493078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:20:00+00:00, data_interval_end=2024-05-11 02:21:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:21:06.500483104Z [2024-05-11T02:21:06.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:21:00+00:00, run_after=2024-05-11T02:22:00+00:00 2024-05-11T02:21:06.561041501Z [2024-05-11T02:21:06.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:21:06.567207708Z [2024-05-11T02:21:06.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:21:02.915690+00:00, run_end_date=2024-05-11 02:21:05.703475+00:00, run_duration=2.787785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:21:01.067491+00:00, queued_by_job_id=2, pid=15092 2024-05-11T02:21:34.504461349Z [2024-05-11T02:21:34.504+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:21:34.504741381Z 2024-05-11T02:21:34.505134329Z [2024-05-11T02:21:34.504+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-11T02:21:34.505838898Z [2024-05-11T02:21:34.505+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:21:34.505936074Z 2024-05-11T02:21:34.508433953Z [2024-05-11T02:21:34.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240511022133_089505', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:21:34.508742027Z [2024-05-11T02:21:34.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240511022133_089505', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-11T02:21:34.551338040Z [2024-05-11T02:21:34.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240511022133_089505 exited with status queued for try_number 1 2024-05-11T02:21:34.559487738Z [2024-05-11T02:21:34.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40d8f8cf-575f-478b-ad3b-4f9696cc289e 2024-05-11T02:21:36.711740260Z [2024-05-11T02:21:36.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:21:36.711890019Z [2024-05-11T02:21:36.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-11 02:21:33.488263+00:00, run_id=scaleout_vdu_20240511022133_089505, run_start_date=2024-05-11 02:21:34.472196+00:00, run_end_date=2024-05-11 02:21:36.711577+00:00, run_duration=2.239381, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 02:21:33.488263+00:00, data_interval_end=2024-05-11 02:21:33.488263+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-11T02:21:36.714939770Z [2024-05-11T02:21:36.714+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-11T02:21:36.750368008Z [2024-05-11T02:21:36.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240511022133_089505 exited with status success for try_number 1 2024-05-11T02:21:36.775782375Z [2024-05-11T02:21:36.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240511022133_089505, map_index=-1, run_start_date=2024-05-11 02:21:35.227407+00:00, run_end_date=2024-05-11 02:21:35.630038+00:00, run_duration=0.402631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:21:34.506275+00:00, queued_by_job_id=2, pid=15117 2024-05-11T02:22:00.681675205Z [2024-05-11T02:22:00.681+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:22:00.701907792Z [2024-05-11T02:22:00.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:22:00+00:00, run_after=2024-05-11T02:23:00+00:00 2024-05-11T02:22:00.720693291Z [2024-05-11T02:22:00.720+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:22:00+00:00, run_after=2024-05-11T02:23:00+00:00 2024-05-11T02:22:00.730974713Z [2024-05-11T02:22:00.730+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:22:00.826285218Z [2024-05-11T02:22:00.825+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:22:00.826342189Z 2024-05-11T02:22:00.826377198Z 2024-05-11T02:22:00.826384360Z 2024-05-11T02:22:00.826390771Z 2024-05-11T02:22:00.826739357Z [2024-05-11T02:22:00.826+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:22:00.827030647Z [2024-05-11T02:22:00.826+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:22:00.827397237Z [2024-05-11T02:22:00.827+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:22:00.827718991Z [2024-05-11T02:22:00.827+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:22:00.828935589Z [2024-05-11T02:22:00.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:22:00.828951798Z 2024-05-11T02:22:00.828958065Z 2024-05-11T02:22:00.828962894Z 2024-05-11T02:22:00.828967860Z 2024-05-11T02:22:00.835210782Z [2024-05-11T02:22:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:22:00.835409993Z [2024-05-11T02:22:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:22:00.835662161Z [2024-05-11T02:22:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:22:00.835805965Z [2024-05-11T02:22:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:22:00.836077383Z [2024-05-11T02:22:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:22:00.836098137Z [2024-05-11T02:22:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:22:00.836935441Z [2024-05-11T02:22:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:22:00.836950716Z [2024-05-11T02:22:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:22:01.419378364Z [2024-05-11T02:22:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:22:01.419696620Z [2024-05-11T02:22:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:21:00+00:00 exited with status queued for try_number 1 2024-05-11T02:22:01.419918013Z [2024-05-11T02:22:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:21:00+00:00 exited with status queued for try_number 1 2024-05-11T02:22:01.420139304Z [2024-05-11T02:22:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:21:00+00:00 exited with status queued for try_number 1 2024-05-11T02:22:01.450968523Z [2024-05-11T02:22:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 630863ef-581f-43c1-baf6-fec5c22449f7 2024-05-11T02:22:01.451485306Z [2024-05-11T02:22:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba157071-63c2-4fbc-ade6-5f09426262d5 2024-05-11T02:22:01.451828733Z [2024-05-11T02:22:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27d5bb80-cdaf-47b7-acb6-bcf272109adb 2024-05-11T02:22:01.452120621Z [2024-05-11T02:22:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e48479c-69c5-447f-bfca-cb51d7002cad 2024-05-11T02:22:02.791905115Z [2024-05-11T02:22:02.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:22:02.792509371Z [2024-05-11T02:22:02.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:20:00+00:00, run_id=scheduled__2024-05-11T02:20:00+00:00, run_start_date=2024-05-11 02:22:00.746022+00:00, run_end_date=2024-05-11 02:22:02.792083+00:00, run_duration=2.046061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:20:00+00:00, data_interval_end=2024-05-11 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:22:02.802470968Z [2024-05-11T02:22:02.802+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:22:00+00:00, run_after=2024-05-11T02:24:00+00:00 2024-05-11T02:22:02.811299954Z [2024-05-11T02:22:02.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:22:02.811964572Z [2024-05-11T02:22:02.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:21:00+00:00, run_id=scheduled__2024-05-11T02:21:00+00:00, run_start_date=2024-05-11 02:22:00.747471+00:00, run_end_date=2024-05-11 02:22:02.811451+00:00, run_duration=2.06398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:21:00+00:00, data_interval_end=2024-05-11 02:22:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:22:02.832877367Z [2024-05-11T02:22:02.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:22:00+00:00, run_after=2024-05-11T02:23:00+00:00 2024-05-11T02:22:02.908592646Z [2024-05-11T02:22:02.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:22:02.909289230Z [2024-05-11T02:22:02.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:21:00+00:00 exited with status success for try_number 1 2024-05-11T02:22:02.919703530Z [2024-05-11T02:22:02.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:21:00+00:00, map_index=-1, run_start_date=2024-05-11 02:22:01.772011+00:00, run_end_date=2024-05-11 02:22:02.217749+00:00, run_duration=0.445738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:22:00.830706+00:00, queued_by_job_id=2, pid=15134 2024-05-11T02:22:02.920315182Z [2024-05-11T02:22:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:22:01.661434+00:00, run_end_date=2024-05-11 02:22:02.050328+00:00, run_duration=0.388894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:22:00.830706+00:00, queued_by_job_id=2, pid=15133 2024-05-11T02:22:05.062513373Z [2024-05-11T02:22:05.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:22:05.062728945Z [2024-05-11T02:22:05.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:21:00+00:00, run_id=scheduled__2024-05-11T02:21:00+00:00, run_start_date=2024-05-11 02:22:00.749004+00:00, run_end_date=2024-05-11 02:22:05.062368+00:00, run_duration=4.313364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:21:00+00:00, data_interval_end=2024-05-11 02:22:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:22:05.071375310Z [2024-05-11T02:22:05.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:22:00+00:00, run_after=2024-05-11T02:23:00+00:00 2024-05-11T02:22:05.078160365Z [2024-05-11T02:22:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:22:05.078372127Z [2024-05-11T02:22:05.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:21:00+00:00, run_id=scheduled__2024-05-11T02:21:00+00:00, run_start_date=2024-05-11 02:22:00.750493+00:00, run_end_date=2024-05-11 02:22:05.078040+00:00, run_duration=4.327547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:21:00+00:00, data_interval_end=2024-05-11 02:22:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:22:05.087475467Z [2024-05-11T02:22:05.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:22:00+00:00, run_after=2024-05-11T02:23:00+00:00 2024-05-11T02:22:05.131007245Z [2024-05-11T02:22:05.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:21:00+00:00 exited with status success for try_number 1 2024-05-11T02:22:05.136556980Z [2024-05-11T02:22:05.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:21:00+00:00, map_index=-1, run_start_date=2024-05-11 02:22:02.995464+00:00, run_end_date=2024-05-11 02:22:04.532408+00:00, run_duration=1.536944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:22:00.830706+00:00, queued_by_job_id=2, pid=15158 2024-05-11T02:22:05.905721488Z [2024-05-11T02:22:05.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:21:00+00:00 exited with status success for try_number 1 2024-05-11T02:22:05.915188330Z [2024-05-11T02:22:05.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:21:00+00:00, map_index=-1, run_start_date=2024-05-11 02:22:02.779469+00:00, run_end_date=2024-05-11 02:22:05.008127+00:00, run_duration=2.228658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:22:00.830706+00:00, queued_by_job_id=2, pid=15152 2024-05-11T02:23:00.486796101Z [2024-05-11T02:23:00.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:23:00+00:00, run_after=2024-05-11T02:24:00+00:00 2024-05-11T02:23:00.505456473Z [2024-05-11T02:23:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:23:00+00:00, run_after=2024-05-11T02:24:00+00:00 2024-05-11T02:23:00.512175356Z [2024-05-11T02:23:00.511+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:23:00.612637649Z [2024-05-11T02:23:00.612+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:23:00.612690064Z 2024-05-11T02:23:00.612728511Z 2024-05-11T02:23:00.612738466Z 2024-05-11T02:23:00.613214439Z [2024-05-11T02:23:00.612+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:23:00.613660323Z [2024-05-11T02:23:00.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:23:00.614135237Z [2024-05-11T02:23:00.613+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:23:00.615850512Z [2024-05-11T02:23:00.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:23:00.615862947Z 2024-05-11T02:23:00.615867160Z 2024-05-11T02:23:00.615870752Z 2024-05-11T02:23:00.621963537Z [2024-05-11T02:23:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:23:00.622254481Z [2024-05-11T02:23:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:23:00.622577186Z [2024-05-11T02:23:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:23:00.622739235Z [2024-05-11T02:23:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:23:00.623062263Z [2024-05-11T02:23:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:23:00.623162381Z [2024-05-11T02:23:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:23:00.822300157Z [2024-05-11T02:23:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status queued for try_number 1 2024-05-11T02:23:00.822467571Z [2024-05-11T02:23:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status queued for try_number 1 2024-05-11T02:23:00.822637021Z [2024-05-11T02:23:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status queued for try_number 1 2024-05-11T02:23:00.829555048Z [2024-05-11T02:23:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36fd8856-3681-436c-a037-45c4710d66f1 2024-05-11T02:23:00.829828040Z [2024-05-11T02:23:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6db23f44-e865-44b7-9b81-ff9da686b3cd 2024-05-11T02:23:00.830149395Z [2024-05-11T02:23:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to c449a8a9-28db-4fe9-b505-4e439aa69520 2024-05-11T02:23:01.998193583Z [2024-05-11T02:23:01.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:23:01.999007614Z [2024-05-11T02:23:01.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:22:00+00:00, run_id=scheduled__2024-05-11T02:22:00+00:00, run_start_date=2024-05-11 02:23:00.522850+00:00, run_end_date=2024-05-11 02:23:01.998566+00:00, run_duration=1.475716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:22:00+00:00, data_interval_end=2024-05-11 02:23:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:23:02.009293990Z [2024-05-11T02:23:02.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:23:00+00:00, run_after=2024-05-11T02:24:00+00:00 2024-05-11T02:23:02.058276590Z [2024-05-11T02:23:02.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status success for try_number 1 2024-05-11T02:23:02.065622369Z [2024-05-11T02:23:02.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:22:00+00:00, map_index=-1, run_start_date=2024-05-11 02:23:01.503828+00:00, run_end_date=2024-05-11 02:23:01.874614+00:00, run_duration=0.370786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:23:00.617741+00:00, queued_by_job_id=2, pid=15190 2024-05-11T02:23:04.589631324Z [2024-05-11T02:23:04.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:23:04.589819038Z [2024-05-11T02:23:04.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:22:00+00:00, run_id=scheduled__2024-05-11T02:22:00+00:00, run_start_date=2024-05-11 02:23:00.525625+00:00, run_end_date=2024-05-11 02:23:04.589437+00:00, run_duration=4.063812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:22:00+00:00, data_interval_end=2024-05-11 02:23:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:23:04.599351696Z [2024-05-11T02:23:04.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:23:00+00:00, run_after=2024-05-11T02:24:00+00:00 2024-05-11T02:23:04.655367457Z [2024-05-11T02:23:04.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status success for try_number 1 2024-05-11T02:23:04.666335224Z [2024-05-11T02:23:04.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:22:00+00:00, map_index=-1, run_start_date=2024-05-11 02:23:02.513661+00:00, run_end_date=2024-05-11 02:23:04.355672+00:00, run_duration=1.842011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:23:00.617741+00:00, queued_by_job_id=2, pid=15209 2024-05-11T02:23:05.738812152Z [2024-05-11T02:23:05.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:23:05.739406519Z [2024-05-11T02:23:05.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:22:00+00:00, run_id=scheduled__2024-05-11T02:22:00+00:00, run_start_date=2024-05-11 02:23:00.527883+00:00, run_end_date=2024-05-11 02:23:05.738715+00:00, run_duration=5.210832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:22:00+00:00, data_interval_end=2024-05-11 02:23:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:23:05.753223812Z [2024-05-11T02:23:05.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:23:00+00:00, run_after=2024-05-11T02:24:00+00:00 2024-05-11T02:23:05.782136974Z [2024-05-11T02:23:05.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status success for try_number 1 2024-05-11T02:23:05.786831051Z [2024-05-11T02:23:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:22:00+00:00, map_index=-1, run_start_date=2024-05-11 02:23:02.421692+00:00, run_end_date=2024-05-11 02:23:05.014856+00:00, run_duration=2.593164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:23:00.617741+00:00, queued_by_job_id=2, pid=15208 2024-05-11T02:24:00.343062789Z [2024-05-11T02:24:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:24:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:24:00.351956287Z [2024-05-11T02:24:00.351+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:24:00.359411254Z [2024-05-11T02:24:00.359+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:24:00.371575881Z [2024-05-11T02:24:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:24:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:24:00.437055233Z [2024-05-11T02:24:00.436+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:24:00.437079174Z 2024-05-11T02:24:00.437083758Z 2024-05-11T02:24:00.437087174Z 2024-05-11T02:24:00.437090399Z 2024-05-11T02:24:00.437152661Z [2024-05-11T02:24:00.436+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:24:00.437288144Z [2024-05-11T02:24:00.437+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:24:00.437426343Z [2024-05-11T02:24:00.437+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:24:00.437558168Z [2024-05-11T02:24:00.437+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:24:00.438208393Z [2024-05-11T02:24:00.438+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:24:00.438214839Z 2024-05-11T02:24:00.438218044Z 2024-05-11T02:24:00.438221509Z 2024-05-11T02:24:00.438224588Z 2024-05-11T02:24:00.441526441Z [2024-05-11T02:24:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:24:00.441677739Z [2024-05-11T02:24:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:24:00.441943537Z [2024-05-11T02:24:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:24:00.442081579Z [2024-05-11T02:24:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:24:00.442306769Z [2024-05-11T02:24:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:24:00.442430009Z [2024-05-11T02:24:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:24:00.442660342Z [2024-05-11T02:24:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:24:00.442795779Z [2024-05-11T02:24:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:24:00.939054238Z [2024-05-11T02:24:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status queued for try_number 1 2024-05-11T02:24:00.939162123Z [2024-05-11T02:24:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:23:00+00:00 exited with status queued for try_number 1 2024-05-11T02:24:00.939290804Z [2024-05-11T02:24:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:23:00+00:00 exited with status queued for try_number 1 2024-05-11T02:24:00.939482769Z [2024-05-11T02:24:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:23:00+00:00 exited with status queued for try_number 1 2024-05-11T02:24:00.957672967Z [2024-05-11T02:24:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 605894fe-44c6-4f4f-9bf7-a43b4db8bac6 2024-05-11T02:24:00.961086905Z [2024-05-11T02:24:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to a403b043-ef4a-4fdc-b543-915d63c32034 2024-05-11T02:24:00.961344967Z [2024-05-11T02:24:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd2b8d7-128c-4d14-8b7f-53dd3506f62b 2024-05-11T02:24:00.961572032Z [2024-05-11T02:24:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c16d605-d161-429e-a96a-0191ce0c99c1 2024-05-11T02:24:02.310350845Z [2024-05-11T02:24:02.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:24:02.310922096Z [2024-05-11T02:24:02.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:22:00+00:00, run_id=scheduled__2024-05-11T02:22:00+00:00, run_start_date=2024-05-11 02:24:00.381669+00:00, run_end_date=2024-05-11 02:24:02.310478+00:00, run_duration=1.928809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:22:00+00:00, data_interval_end=2024-05-11 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:24:02.318486349Z [2024-05-11T02:24:02.318+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:24:00+00:00, run_after=2024-05-11T02:26:00+00:00 2024-05-11T02:24:02.324999592Z [2024-05-11T02:24:02.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:24:02.325279475Z [2024-05-11T02:24:02.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:23:00+00:00, run_id=scheduled__2024-05-11T02:23:00+00:00, run_start_date=2024-05-11 02:24:00.382896+00:00, run_end_date=2024-05-11 02:24:02.324913+00:00, run_duration=1.942017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:23:00+00:00, data_interval_end=2024-05-11 02:24:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:24:02.334795602Z [2024-05-11T02:24:02.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:24:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:24:02.377005892Z [2024-05-11T02:24:02.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:22:00+00:00 exited with status success for try_number 1 2024-05-11T02:24:02.379210475Z [2024-05-11T02:24:02.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:23:00+00:00 exited with status success for try_number 1 2024-05-11T02:24:02.385367467Z [2024-05-11T02:24:02.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:22:00+00:00, map_index=-1, run_start_date=2024-05-11 02:24:01.412267+00:00, run_end_date=2024-05-11 02:24:01.869162+00:00, run_duration=0.456895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:24:00.439150+00:00, queued_by_job_id=2, pid=15242 2024-05-11T02:24:02.385765695Z [2024-05-11T02:24:02.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:23:00+00:00, map_index=-1, run_start_date=2024-05-11 02:24:01.636726+00:00, run_end_date=2024-05-11 02:24:02.102573+00:00, run_duration=0.465847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:24:00.439150+00:00, queued_by_job_id=2, pid=15243 2024-05-11T02:24:05.536662753Z [2024-05-11T02:24:05.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:24:05.536935355Z [2024-05-11T02:24:05.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:23:00+00:00, run_id=scheduled__2024-05-11T02:23:00+00:00, run_start_date=2024-05-11 02:24:00.383901+00:00, run_end_date=2024-05-11 02:24:05.536677+00:00, run_duration=5.152776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:23:00+00:00, data_interval_end=2024-05-11 02:24:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:24:05.547289720Z [2024-05-11T02:24:05.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:24:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:24:05.553863000Z [2024-05-11T02:24:05.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:24:05.557998034Z [2024-05-11T02:24:05.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:23:00+00:00, run_id=scheduled__2024-05-11T02:23:00+00:00, run_start_date=2024-05-11 02:24:00.384943+00:00, run_end_date=2024-05-11 02:24:05.553999+00:00, run_duration=5.169056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:23:00+00:00, data_interval_end=2024-05-11 02:24:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:24:05.574018095Z [2024-05-11T02:24:05.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:24:00+00:00, run_after=2024-05-11T02:25:00+00:00 2024-05-11T02:24:05.608617660Z [2024-05-11T02:24:05.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:23:00+00:00 exited with status success for try_number 1 2024-05-11T02:24:05.608653024Z [2024-05-11T02:24:05.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:23:00+00:00 exited with status success for try_number 1 2024-05-11T02:24:05.614864177Z [2024-05-11T02:24:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:23:00+00:00, map_index=-1, run_start_date=2024-05-11 02:24:02.746074+00:00, run_end_date=2024-05-11 02:24:04.440312+00:00, run_duration=1.694238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:24:00.439150+00:00, queued_by_job_id=2, pid=15266 2024-05-11T02:24:05.614939333Z [2024-05-11T02:24:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:23:00+00:00, map_index=-1, run_start_date=2024-05-11 02:24:02.746681+00:00, run_end_date=2024-05-11 02:24:05.133089+00:00, run_duration=2.386408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:24:00.439150+00:00, queued_by_job_id=2, pid=15267 2024-05-11T02:25:00.206373535Z [2024-05-11T02:25:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:26:00+00:00 2024-05-11T02:25:00.220708635Z [2024-05-11T02:25:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:26:00+00:00 2024-05-11T02:25:00.231932900Z [2024-05-11T02:25:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:25:00.237849176Z [2024-05-11T02:25:00.237+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:25:00.317724364Z [2024-05-11T02:25:00.315+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:25:00.317749207Z 2024-05-11T02:25:00.317761412Z 2024-05-11T02:25:00.317765393Z 2024-05-11T02:25:00.317768670Z 2024-05-11T02:25:00.317771921Z [2024-05-11T02:25:00.315+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:25:00.317775005Z [2024-05-11T02:25:00.315+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:25:00.317778105Z [2024-05-11T02:25:00.315+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:25:00.317781139Z [2024-05-11T02:25:00.315+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:25:00.317784910Z [2024-05-11T02:25:00.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:25:00.317787988Z 2024-05-11T02:25:00.317790948Z 2024-05-11T02:25:00.317794103Z 2024-05-11T02:25:00.317797068Z 2024-05-11T02:25:00.328825323Z [2024-05-11T02:25:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:25:00.328846915Z [2024-05-11T02:25:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:25:00.329318722Z [2024-05-11T02:25:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:25:00.329519630Z [2024-05-11T02:25:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:25:00.329793343Z [2024-05-11T02:25:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:25:00.331556093Z [2024-05-11T02:25:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:25:00.332281002Z [2024-05-11T02:25:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:25:00.333518791Z [2024-05-11T02:25:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:25:00.829426571Z [2024-05-11T02:25:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:00.833528562Z [2024-05-11T02:25:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:00.833809512Z [2024-05-11T02:25:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:00.843118533Z [2024-05-11T02:25:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:00.855063192Z [2024-05-11T02:25:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33b3368f-d165-4c3a-96d1-a1e53c6d9342 2024-05-11T02:25:00.857512082Z [2024-05-11T02:25:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 892f1f95-0e29-4560-8f6b-07722b8266d2 2024-05-11T02:25:00.857841532Z [2024-05-11T02:25:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5baef0dd-184c-4479-84d2-2f68723b3f9c 2024-05-11T02:25:00.858139143Z [2024-05-11T02:25:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f175ba5-7119-4ef5-bc5e-8f5fc4ffddd8 2024-05-11T02:25:03.155475063Z [2024-05-11T02:25:03.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:25:03.155720395Z [2024-05-11T02:25:03.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:24:00+00:00, run_id=scheduled__2024-05-11T02:24:00+00:00, run_start_date=2024-05-11 02:25:00.248361+00:00, run_end_date=2024-05-11 02:25:03.155373+00:00, run_duration=2.907012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:24:00+00:00, data_interval_end=2024-05-11 02:25:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:25:03.165947717Z [2024-05-11T02:25:03.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:26:00+00:00 2024-05-11T02:25:03.251377428Z [2024-05-11T02:25:03.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:03.259713299Z [2024-05-11T02:25:03.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:24:00+00:00, map_index=-1, run_start_date=2024-05-11 02:25:01.428650+00:00, run_end_date=2024-05-11 02:25:01.937804+00:00, run_duration=0.509154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:00.317384+00:00, queued_by_job_id=2, pid=15300 2024-05-11T02:25:04.224704368Z [2024-05-11T02:25:04.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:25:04.225322928Z [2024-05-11T02:25:04.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:24:00+00:00, run_id=scheduled__2024-05-11T02:24:00+00:00, run_start_date=2024-05-11 02:25:00.249319+00:00, run_end_date=2024-05-11 02:25:04.224946+00:00, run_duration=3.975627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:24:00+00:00, data_interval_end=2024-05-11 02:25:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:25:04.234971780Z [2024-05-11T02:25:04.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:26:00+00:00 2024-05-11T02:25:04.270446047Z [2024-05-11T02:25:04.270+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:25:04.270464998Z 2024-05-11T02:25:04.270950242Z [2024-05-11T02:25:04.270+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:25:04.271790085Z [2024-05-11T02:25:04.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:25:04.271820139Z 2024-05-11T02:25:04.275903017Z [2024-05-11T02:25:04.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:25:04.276237595Z [2024-05-11T02:25:04.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:25:04.341752193Z [2024-05-11T02:25:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:04.342073669Z [2024-05-11T02:25:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:04.342380695Z [2024-05-11T02:25:04.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:04.349381339Z [2024-05-11T02:25:04.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16feaee9-bba0-472f-bdff-fd21d48c6c08 2024-05-11T02:25:04.350046372Z [2024-05-11T02:25:04.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:25:02.869564+00:00, run_end_date=2024-05-11 02:25:03.331666+00:00, run_duration=0.462102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:00.317384+00:00, queued_by_job_id=2, pid=15330 2024-05-11T02:25:04.350430346Z [2024-05-11T02:25:04.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:24:00+00:00, map_index=-1, run_start_date=2024-05-11 02:25:02.459240+00:00, run_end_date=2024-05-11 02:25:03.905561+00:00, run_duration=1.446321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:00.317384+00:00, queued_by_job_id=2, pid=15319 2024-05-11T02:25:04.412853439Z [2024-05-11T02:25:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:25:04.413229821Z [2024-05-11T02:25:04.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:24:00+00:00, run_id=scheduled__2024-05-11T02:24:00+00:00, run_start_date=2024-05-11 02:25:00.250232+00:00, run_end_date=2024-05-11 02:25:04.412918+00:00, run_duration=4.162686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:24:00+00:00, data_interval_end=2024-05-11 02:25:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:25:04.422315267Z [2024-05-11T02:25:04.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:26:00+00:00 2024-05-11T02:25:04.461280747Z [2024-05-11T02:25:04.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:04.466723936Z [2024-05-11T02:25:04.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:24:00+00:00, map_index=-1, run_start_date=2024-05-11 02:25:02.587987+00:00, run_end_date=2024-05-11 02:25:04.286650+00:00, run_duration=1.698663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:00.317384+00:00, queued_by_job_id=2, pid=15320 2024-05-11T02:25:06.598530598Z [2024-05-11T02:25:06.598+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:25:06.598579592Z 2024-05-11T02:25:06.598881927Z [2024-05-11T02:25:06.598+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:25:06.600183803Z [2024-05-11T02:25:06.599+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:25:06.600191734Z 2024-05-11T02:25:06.602623158Z [2024-05-11T02:25:06.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:25:06.602952789Z [2024-05-11T02:25:06.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:25:06.667944876Z [2024-05-11T02:25:06.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:06.667994446Z [2024-05-11T02:25:06.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:06.677319223Z [2024-05-11T02:25:06.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57683027-6d92-423d-9258-88579728877f 2024-05-11T02:25:06.677572735Z [2024-05-11T02:25:06.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:25:05.898012+00:00, run_end_date=2024-05-11 02:25:06.234149+00:00, run_duration=0.336137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:04.272544+00:00, queued_by_job_id=2, pid=15359 2024-05-11T02:25:09.255755302Z [2024-05-11T02:25:09.255+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:25:09.255817559Z 2024-05-11T02:25:09.256195096Z [2024-05-11T02:25:09.255+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:25:09.257311751Z [2024-05-11T02:25:09.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:25:09.257332220Z 2024-05-11T02:25:09.263989254Z [2024-05-11T02:25:09.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:25:09.264199321Z [2024-05-11T02:25:09.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:25:09.328538387Z [2024-05-11T02:25:09.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status queued for try_number 1 2024-05-11T02:25:09.328572126Z [2024-05-11T02:25:09.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:09.335446725Z [2024-05-11T02:25:09.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50356337-664c-4625-81cf-4af7130fdf4f 2024-05-11T02:25:09.335846436Z [2024-05-11T02:25:09.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=0, run_start_date=2024-05-11 02:25:08.241193+00:00, run_end_date=2024-05-11 02:25:08.557302+00:00, run_duration=0.316109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:06.600671+00:00, queued_by_job_id=2, pid=15370 2024-05-11T02:25:11.557283986Z [2024-05-11T02:25:11.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:25:11.557747176Z [2024-05-11T02:25:11.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:20:00+00:00, run_id=scheduled__2024-05-11T02:20:00+00:00, run_start_date=2024-05-11 02:25:00.247216+00:00, run_end_date=2024-05-11 02:25:11.557148+00:00, run_duration=11.309932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:20:00+00:00, data_interval_end=2024-05-11 02:25:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:25:11.563795641Z [2024-05-11T02:25:11.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:25:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:25:11.596169980Z [2024-05-11T02:25:11.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:20:00+00:00 exited with status success for try_number 1 2024-05-11T02:25:11.601542824Z [2024-05-11T02:25:11.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:20:00+00:00, map_index=-1, run_start_date=2024-05-11 02:25:10.891668+00:00, run_end_date=2024-05-11 02:25:11.318955+00:00, run_duration=0.427287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:25:09.257818+00:00, queued_by_job_id=2, pid=15378 2024-05-11T02:25:36.416538570Z [2024-05-11T02:25:36.415+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:26:00.124491400Z [2024-05-11T02:26:00.124+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:26:00.133387197Z [2024-05-11T02:26:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:26:00.153755522Z [2024-05-11T02:26:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:26:00+00:00, run_after=2024-05-11T02:27:00+00:00 2024-05-11T02:26:00.167824772Z [2024-05-11T02:26:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:26:00+00:00, run_after=2024-05-11T02:27:00+00:00 2024-05-11T02:26:00.254998299Z [2024-05-11T02:26:00.254+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:26:00.255045759Z 2024-05-11T02:26:00.255059213Z 2024-05-11T02:26:00.255065131Z 2024-05-11T02:26:00.255070361Z 2024-05-11T02:26:00.255260522Z [2024-05-11T02:26:00.254+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:26:00.255596923Z [2024-05-11T02:26:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:26:00.255879990Z [2024-05-11T02:26:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:26:00.256471723Z [2024-05-11T02:26:00.256+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:26:00.257377293Z [2024-05-11T02:26:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:26:00.257391261Z 2024-05-11T02:26:00.257396047Z 2024-05-11T02:26:00.257437678Z 2024-05-11T02:26:00.257442447Z 2024-05-11T02:26:00.262147597Z [2024-05-11T02:26:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:26:00.262465068Z [2024-05-11T02:26:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:26:00.263025057Z [2024-05-11T02:26:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:26:00.263311863Z [2024-05-11T02:26:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:26:00.263721361Z [2024-05-11T02:26:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:26:00.264088807Z [2024-05-11T02:26:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:26:00.264592280Z [2024-05-11T02:26:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:26:00.264894303Z [2024-05-11T02:26:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:26:00.901830894Z [2024-05-11T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status queued for try_number 1 2024-05-11T02:26:00.901973613Z [2024-05-11T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:26:00.901982939Z [2024-05-11T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:26:00.902009429Z [2024-05-11T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:26:00.913471964Z [2024-05-11T02:26:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2352182f-c991-43be-9bd4-eaaade0219e2 2024-05-11T02:26:00.913543159Z [2024-05-11T02:26:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to e787d995-e236-470b-a5a8-a14145a5ba9a 2024-05-11T02:26:00.913629888Z [2024-05-11T02:26:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8a80ed3-972d-4321-8fe6-12726af9f8e4 2024-05-11T02:26:00.913724099Z [2024-05-11T02:26:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c49a526-0d92-428a-9abb-5acf58160f0b 2024-05-11T02:26:02.074073121Z [2024-05-11T02:26:02.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:26:02.074637353Z [2024-05-11T02:26:02.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:25:00+00:00, run_id=scheduled__2024-05-11T02:25:00+00:00, run_start_date=2024-05-11 02:26:00.178899+00:00, run_end_date=2024-05-11 02:26:02.074215+00:00, run_duration=1.895316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:25:00+00:00, data_interval_end=2024-05-11 02:26:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:26:02.087915864Z [2024-05-11T02:26:02.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:26:00+00:00, run_after=2024-05-11T02:27:00+00:00 2024-05-11T02:26:02.102615242Z [2024-05-11T02:26:02.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:26:02.103284005Z [2024-05-11T02:26:02.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:24:00+00:00, run_id=scheduled__2024-05-11T02:24:00+00:00, run_start_date=2024-05-11 02:26:00.177593+00:00, run_end_date=2024-05-11 02:26:02.102924+00:00, run_duration=1.925331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:24:00+00:00, data_interval_end=2024-05-11 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:26:02.113329856Z [2024-05-11T02:26:02.113+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:26:00+00:00, run_after=2024-05-11T02:28:00+00:00 2024-05-11T02:26:02.174596405Z [2024-05-11T02:26:02.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:24:00+00:00 exited with status success for try_number 1 2024-05-11T02:26:02.174862052Z [2024-05-11T02:26:02.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:26:02.182701126Z [2024-05-11T02:26:02.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:24:00+00:00, map_index=-1, run_start_date=2024-05-11 02:26:01.229665+00:00, run_end_date=2024-05-11 02:26:01.695441+00:00, run_duration=0.465776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:26:00.258769+00:00, queued_by_job_id=2, pid=15388 2024-05-11T02:26:02.183121284Z [2024-05-11T02:26:02.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=-1, run_start_date=2024-05-11 02:26:01.241754+00:00, run_end_date=2024-05-11 02:26:01.743657+00:00, run_duration=0.501903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:26:00.258769+00:00, queued_by_job_id=2, pid=15389 2024-05-11T02:26:04.355298428Z [2024-05-11T02:26:04.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:26:04.355580611Z [2024-05-11T02:26:04.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:25:00+00:00, run_id=scheduled__2024-05-11T02:25:00+00:00, run_start_date=2024-05-11 02:26:00.182303+00:00, run_end_date=2024-05-11 02:26:04.355142+00:00, run_duration=4.172839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:25:00+00:00, data_interval_end=2024-05-11 02:26:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:26:04.364822941Z [2024-05-11T02:26:04.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:26:00+00:00, run_after=2024-05-11T02:27:00+00:00 2024-05-11T02:26:04.371783117Z [2024-05-11T02:26:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:26:04.371986438Z [2024-05-11T02:26:04.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:25:00+00:00, run_id=scheduled__2024-05-11T02:25:00+00:00, run_start_date=2024-05-11 02:26:00.179928+00:00, run_end_date=2024-05-11 02:26:04.371559+00:00, run_duration=4.191631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:25:00+00:00, data_interval_end=2024-05-11 02:26:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:26:04.380687439Z [2024-05-11T02:26:04.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:26:00+00:00, run_after=2024-05-11T02:27:00+00:00 2024-05-11T02:26:04.423154620Z [2024-05-11T02:26:04.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:26:04.423495699Z [2024-05-11T02:26:04.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:26:04.431041606Z [2024-05-11T02:26:04.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=-1, run_start_date=2024-05-11 02:26:02.584559+00:00, run_end_date=2024-05-11 02:26:03.906758+00:00, run_duration=1.322199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:26:00.258769+00:00, queued_by_job_id=2, pid=15418 2024-05-11T02:26:04.431558834Z [2024-05-11T02:26:04.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=-1, run_start_date=2024-05-11 02:26:02.236001+00:00, run_end_date=2024-05-11 02:26:04.024957+00:00, run_duration=1.788956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:26:00.258769+00:00, queued_by_job_id=2, pid=15407 2024-05-11T02:27:00.031347742Z [2024-05-11T02:27:00.030+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:27:00+00:00, run_after=2024-05-11T02:28:00+00:00 2024-05-11T02:27:00.068469657Z [2024-05-11T02:27:00.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:27:00+00:00, run_after=2024-05-11T02:28:00+00:00 2024-05-11T02:27:00.087454132Z [2024-05-11T02:27:00.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:27:00.187858214Z [2024-05-11T02:27:00.187+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:27:00.187882427Z 2024-05-11T02:27:00.187885970Z 2024-05-11T02:27:00.187889054Z 2024-05-11T02:27:00.187995970Z [2024-05-11T02:27:00.187+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:27:00.188202904Z [2024-05-11T02:27:00.188+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:27:00.188309585Z [2024-05-11T02:27:00.188+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:27:00.189103920Z [2024-05-11T02:27:00.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:27:00.189124071Z 2024-05-11T02:27:00.189128160Z 2024-05-11T02:27:00.189131511Z 2024-05-11T02:27:00.193479907Z [2024-05-11T02:27:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:27:00.193662331Z [2024-05-11T02:27:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:27:00.194064309Z [2024-05-11T02:27:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:27:00.194225002Z [2024-05-11T02:27:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:27:00.194540587Z [2024-05-11T02:27:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:27:00.194725148Z [2024-05-11T02:27:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:27:00.547848530Z [2024-05-11T02:27:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status queued for try_number 1 2024-05-11T02:27:00.547967723Z [2024-05-11T02:27:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status queued for try_number 1 2024-05-11T02:27:00.548255341Z [2024-05-11T02:27:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status queued for try_number 1 2024-05-11T02:27:00.567274380Z [2024-05-11T02:27:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0888185c-7558-4038-8007-dcc41f3b85b4 2024-05-11T02:27:00.570089559Z [2024-05-11T02:27:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9c3fea1-ae78-4843-86e5-6a591c81b116 2024-05-11T02:27:00.570353088Z [2024-05-11T02:27:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3c2bab5-92c1-48c5-abd6-17383eba1f75 2024-05-11T02:27:02.892726631Z [2024-05-11T02:27:02.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:27:02.893146856Z [2024-05-11T02:27:02.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:26:00+00:00, run_id=scheduled__2024-05-11T02:26:00+00:00, run_start_date=2024-05-11 02:27:00.101797+00:00, run_end_date=2024-05-11 02:27:02.892640+00:00, run_duration=2.790843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:26:00+00:00, data_interval_end=2024-05-11 02:27:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:27:02.905855440Z [2024-05-11T02:27:02.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:27:00+00:00, run_after=2024-05-11T02:28:00+00:00 2024-05-11T02:27:02.959723295Z [2024-05-11T02:27:02.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status success for try_number 1 2024-05-11T02:27:02.965094601Z [2024-05-11T02:27:02.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:26:00+00:00, map_index=-1, run_start_date=2024-05-11 02:27:01.613154+00:00, run_end_date=2024-05-11 02:27:01.958838+00:00, run_duration=0.345684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:27:00.190271+00:00, queued_by_job_id=2, pid=15446 2024-05-11T02:27:05.099522543Z [2024-05-11T02:27:05.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:27:05.100350848Z [2024-05-11T02:27:05.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:26:00+00:00, run_id=scheduled__2024-05-11T02:26:00+00:00, run_start_date=2024-05-11 02:27:00.104046+00:00, run_end_date=2024-05-11 02:27:05.099398+00:00, run_duration=4.995352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:26:00+00:00, data_interval_end=2024-05-11 02:27:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:27:05.109546519Z [2024-05-11T02:27:05.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:27:00+00:00, run_after=2024-05-11T02:28:00+00:00 2024-05-11T02:27:05.115725533Z [2024-05-11T02:27:05.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:27:05.115992451Z [2024-05-11T02:27:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:26:00+00:00, run_id=scheduled__2024-05-11T02:26:00+00:00, run_start_date=2024-05-11 02:27:00.103003+00:00, run_end_date=2024-05-11 02:27:05.115601+00:00, run_duration=5.012598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:26:00+00:00, data_interval_end=2024-05-11 02:27:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:27:05.124685127Z [2024-05-11T02:27:05.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:27:00+00:00, run_after=2024-05-11T02:28:00+00:00 2024-05-11T02:27:05.171647975Z [2024-05-11T02:27:05.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status success for try_number 1 2024-05-11T02:27:05.171673178Z [2024-05-11T02:27:05.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status success for try_number 1 2024-05-11T02:27:05.180378218Z [2024-05-11T02:27:05.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:26:00+00:00, map_index=-1, run_start_date=2024-05-11 02:27:02.882852+00:00, run_end_date=2024-05-11 02:27:04.910604+00:00, run_duration=2.027752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:27:00.190271+00:00, queued_by_job_id=2, pid=15470 2024-05-11T02:27:05.180417997Z [2024-05-11T02:27:05.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:26:00+00:00, map_index=-1, run_start_date=2024-05-11 02:27:02.576900+00:00, run_end_date=2024-05-11 02:27:04.997332+00:00, run_duration=2.420432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:27:00.190271+00:00, queued_by_job_id=2, pid=15459 2024-05-11T02:27:34.476970604Z [2024-05-11T02:27:34.476+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:27:34.477014186Z 2024-05-11T02:27:34.477476183Z [2024-05-11T02:27:34.477+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-11T02:27:34.479233547Z [2024-05-11T02:27:34.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:27:34.479271831Z 2024-05-11T02:27:34.484219800Z [2024-05-11T02:27:34.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240511022733_983273', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:27:34.484735292Z [2024-05-11T02:27:34.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240511022733_983273', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-11T02:27:34.557248641Z [2024-05-11T02:27:34.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240511022733_983273 exited with status queued for try_number 1 2024-05-11T02:27:34.563459464Z [2024-05-11T02:27:34.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1615d2e0-ca34-47f8-afee-1cf91926d126 2024-05-11T02:27:35.707419653Z [2024-05-11T02:27:35.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:27:35.707644684Z [2024-05-11T02:27:35.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-11 02:27:33.523686+00:00, run_id=scaleout_vdu_20240511022733_983273, run_start_date=2024-05-11 02:27:34.429180+00:00, run_end_date=2024-05-11 02:27:35.707228+00:00, run_duration=1.278048, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 02:27:33.523686+00:00, data_interval_end=2024-05-11 02:27:33.523686+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-11T02:27:35.711297204Z [2024-05-11T02:27:35.710+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-11T02:27:36.851211465Z [2024-05-11T02:27:36.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240511022733_983273 exited with status success for try_number 1 2024-05-11T02:27:36.858630123Z [2024-05-11T02:27:36.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240511022733_983273, map_index=-1, run_start_date=2024-05-11 02:27:35.219297+00:00, run_end_date=2024-05-11 02:27:35.667927+00:00, run_duration=0.44863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:27:34.480001+00:00, queued_by_job_id=2, pid=15490 2024-05-11T02:28:00.345772486Z [2024-05-11T02:28:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:28:00+00:00, run_after=2024-05-11T02:29:00+00:00 2024-05-11T02:28:00.377440589Z [2024-05-11T02:28:00.377+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:28:00.388353070Z [2024-05-11T02:28:00.387+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:28:00.452816963Z [2024-05-11T02:28:00.452+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:28:00.452849350Z 2024-05-11T02:28:00.452860009Z 2024-05-11T02:28:00.452864300Z 2024-05-11T02:28:00.452870151Z [2024-05-11T02:28:00.452+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:28:00.452883621Z [2024-05-11T02:28:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:28:00.452898810Z [2024-05-11T02:28:00.452+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:28:00.453510689Z [2024-05-11T02:28:00.453+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:28:00.453521164Z 2024-05-11T02:28:00.453525820Z 2024-05-11T02:28:00.453529114Z 2024-05-11T02:28:00.458630781Z [2024-05-11T02:28:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:28:00.458682604Z [2024-05-11T02:28:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:28:00.458831699Z [2024-05-11T02:28:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:28:00.458922263Z [2024-05-11T02:28:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:28:00.459073190Z [2024-05-11T02:28:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:28:00.459170693Z [2024-05-11T02:28:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:28:00.766226739Z [2024-05-11T02:28:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status queued for try_number 1 2024-05-11T02:28:00.766304732Z [2024-05-11T02:28:00.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:27:00+00:00 exited with status queued for try_number 1 2024-05-11T02:28:00.766391785Z [2024-05-11T02:28:00.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:27:00+00:00 exited with status queued for try_number 1 2024-05-11T02:28:00.779492692Z [2024-05-11T02:28:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf1d660a-bbe8-49ea-89a0-1b4218413d37 2024-05-11T02:28:00.779520618Z [2024-05-11T02:28:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0007419-04fd-46ee-ba70-698d14079edc 2024-05-11T02:28:00.779524252Z [2024-05-11T02:28:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8f4872d-fcee-434f-a24b-41b02364120d 2024-05-11T02:28:00.834313901Z [2024-05-11T02:28:00.829+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:28:00+00:00, run_after=2024-05-11T02:29:00+00:00 2024-05-11T02:28:00.975658154Z [2024-05-11T02:28:00.975+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:28:00.975690460Z 2024-05-11T02:28:00.975723366Z [2024-05-11T02:28:00.975+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:28:00.976214757Z [2024-05-11T02:28:00.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:28:00.976248571Z 2024-05-11T02:28:00.979543353Z [2024-05-11T02:28:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:28:00.979626357Z [2024-05-11T02:28:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:28:01.141749127Z [2024-05-11T02:28:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:27:00+00:00 exited with status queued for try_number 1 2024-05-11T02:28:01.197426521Z [2024-05-11T02:28:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00438b82-3e14-4a46-bfa7-4e9a310fce85 2024-05-11T02:28:02.475772681Z [2024-05-11T02:28:02.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:28:02.476089147Z [2024-05-11T02:28:02.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:27:00+00:00, run_id=scheduled__2024-05-11T02:27:00+00:00, run_start_date=2024-05-11 02:28:00.854240+00:00, run_end_date=2024-05-11 02:28:02.475661+00:00, run_duration=1.621421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:27:00+00:00, data_interval_end=2024-05-11 02:28:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:28:02.486791291Z [2024-05-11T02:28:02.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:28:00+00:00, run_after=2024-05-11T02:29:00+00:00 2024-05-11T02:28:02.498688531Z [2024-05-11T02:28:02.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:28:02.498999637Z [2024-05-11T02:28:02.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:26:00+00:00, run_id=scheduled__2024-05-11T02:26:00+00:00, run_start_date=2024-05-11 02:28:00.399445+00:00, run_end_date=2024-05-11 02:28:02.498569+00:00, run_duration=2.099124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:26:00+00:00, data_interval_end=2024-05-11 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:28:02.506689327Z [2024-05-11T02:28:02.506+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:28:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:28:02.577705832Z [2024-05-11T02:28:02.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:26:00+00:00 exited with status success for try_number 1 2024-05-11T02:28:02.585279940Z [2024-05-11T02:28:02.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:26:00+00:00, map_index=-1, run_start_date=2024-05-11 02:28:01.711729+00:00, run_end_date=2024-05-11 02:28:02.219147+00:00, run_duration=0.507418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:28:00.454353+00:00, queued_by_job_id=2, pid=15505 2024-05-11T02:28:02.946948254Z [2024-05-11T02:28:02.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:27:00+00:00 exited with status success for try_number 1 2024-05-11T02:28:02.960232281Z [2024-05-11T02:28:02.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:27:00+00:00, map_index=-1, run_start_date=2024-05-11 02:28:01.985408+00:00, run_end_date=2024-05-11 02:28:02.420181+00:00, run_duration=0.434773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:28:00.976541+00:00, queued_by_job_id=2, pid=15507 2024-05-11T02:28:05.190651345Z [2024-05-11T02:28:05.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:28:05.190804160Z [2024-05-11T02:28:05.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:27:00+00:00, run_id=scheduled__2024-05-11T02:27:00+00:00, run_start_date=2024-05-11 02:28:00.400713+00:00, run_end_date=2024-05-11 02:28:05.190544+00:00, run_duration=4.789831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:27:00+00:00, data_interval_end=2024-05-11 02:28:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:28:05.199198102Z [2024-05-11T02:28:05.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:28:00+00:00, run_after=2024-05-11T02:29:00+00:00 2024-05-11T02:28:05.224261119Z [2024-05-11T02:28:05.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:27:00+00:00 exited with status success for try_number 1 2024-05-11T02:28:05.228965366Z [2024-05-11T02:28:05.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:27:00+00:00, map_index=-1, run_start_date=2024-05-11 02:28:03.045832+00:00, run_end_date=2024-05-11 02:28:05.015966+00:00, run_duration=1.970134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:28:00.454353+00:00, queued_by_job_id=2, pid=15529 2024-05-11T02:28:06.289913578Z [2024-05-11T02:28:06.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:28:06.290111733Z [2024-05-11T02:28:06.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:27:00+00:00, run_id=scheduled__2024-05-11T02:27:00+00:00, run_start_date=2024-05-11 02:28:00.401804+00:00, run_end_date=2024-05-11 02:28:06.289758+00:00, run_duration=5.887954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:27:00+00:00, data_interval_end=2024-05-11 02:28:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:28:06.301703683Z [2024-05-11T02:28:06.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:28:00+00:00, run_after=2024-05-11T02:29:00+00:00 2024-05-11T02:28:06.345308340Z [2024-05-11T02:28:06.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:27:00+00:00 exited with status success for try_number 1 2024-05-11T02:28:06.355289828Z [2024-05-11T02:28:06.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:27:00+00:00, map_index=-1, run_start_date=2024-05-11 02:28:03.117808+00:00, run_end_date=2024-05-11 02:28:05.166568+00:00, run_duration=2.04876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:28:00.454353+00:00, queued_by_job_id=2, pid=15530 2024-05-11T02:29:00.742191609Z [2024-05-11T02:29:00.741+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:29:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:29:00.759645754Z [2024-05-11T02:29:00.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:29:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:29:00.767126087Z [2024-05-11T02:29:00.766+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:29:00.837855206Z [2024-05-11T02:29:00.837+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:29:00.837947386Z 2024-05-11T02:29:00.837957601Z 2024-05-11T02:29:00.837966665Z 2024-05-11T02:29:00.838026317Z [2024-05-11T02:29:00.837+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:29:00.838265299Z [2024-05-11T02:29:00.838+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:29:00.838581472Z [2024-05-11T02:29:00.838+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:29:00.839273968Z [2024-05-11T02:29:00.839+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:29:00.839288939Z 2024-05-11T02:29:00.839312829Z 2024-05-11T02:29:00.839317226Z 2024-05-11T02:29:00.844084021Z [2024-05-11T02:29:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:29:00.844587608Z [2024-05-11T02:29:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:29:00.845228999Z [2024-05-11T02:29:00.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:29:00.845647645Z [2024-05-11T02:29:00.845+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:29:00.846226231Z [2024-05-11T02:29:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:29:00.846589137Z [2024-05-11T02:29:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:29:01.235667907Z [2024-05-11T02:29:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status queued for try_number 1 2024-05-11T02:29:01.237641716Z [2024-05-11T02:29:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status queued for try_number 1 2024-05-11T02:29:01.237803218Z [2024-05-11T02:29:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status queued for try_number 1 2024-05-11T02:29:01.245245638Z [2024-05-11T02:29:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbf21f90-83cb-4be2-a1ba-479f3d12d983 2024-05-11T02:29:01.245411331Z [2024-05-11T02:29:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 662c9ea4-d461-4b40-a704-7d77844ca31a 2024-05-11T02:29:01.245609280Z [2024-05-11T02:29:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28e89337-b864-4710-8cd1-b6c9ed33dafb 2024-05-11T02:29:02.404890659Z [2024-05-11T02:29:02.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:29:02.405199178Z [2024-05-11T02:29:02.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:28:00+00:00, run_id=scheduled__2024-05-11T02:28:00+00:00, run_start_date=2024-05-11 02:29:00.776845+00:00, run_end_date=2024-05-11 02:29:02.404573+00:00, run_duration=1.627728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:28:00+00:00, data_interval_end=2024-05-11 02:29:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:29:02.418815651Z [2024-05-11T02:29:02.418+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:29:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:29:02.484590170Z [2024-05-11T02:29:02.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status success for try_number 1 2024-05-11T02:29:02.490507791Z [2024-05-11T02:29:02.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:28:00+00:00, map_index=-1, run_start_date=2024-05-11 02:29:01.680823+00:00, run_end_date=2024-05-11 02:29:02.095611+00:00, run_duration=0.414788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:29:00.840326+00:00, queued_by_job_id=2, pid=15561 2024-05-11T02:29:04.781061655Z [2024-05-11T02:29:04.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:29:04.781461374Z [2024-05-11T02:29:04.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:28:00+00:00, run_id=scheduled__2024-05-11T02:28:00+00:00, run_start_date=2024-05-11 02:29:00.777994+00:00, run_end_date=2024-05-11 02:29:04.781065+00:00, run_duration=4.003071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:28:00+00:00, data_interval_end=2024-05-11 02:29:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:29:04.790653501Z [2024-05-11T02:29:04.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:29:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:29:04.796587213Z [2024-05-11T02:29:04.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:29:04.796821668Z [2024-05-11T02:29:04.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:28:00+00:00, run_id=scheduled__2024-05-11T02:28:00+00:00, run_start_date=2024-05-11 02:29:00.778999+00:00, run_end_date=2024-05-11 02:29:04.796579+00:00, run_duration=4.01758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:28:00+00:00, data_interval_end=2024-05-11 02:29:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:29:04.808792402Z [2024-05-11T02:29:04.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:29:00+00:00, run_after=2024-05-11T02:30:00+00:00 2024-05-11T02:29:04.841480203Z [2024-05-11T02:29:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status success for try_number 1 2024-05-11T02:29:04.841600809Z [2024-05-11T02:29:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status success for try_number 1 2024-05-11T02:29:04.849123853Z [2024-05-11T02:29:04.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:28:00+00:00, map_index=-1, run_start_date=2024-05-11 02:29:02.753532+00:00, run_end_date=2024-05-11 02:29:04.152221+00:00, run_duration=1.398689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:29:00.840326+00:00, queued_by_job_id=2, pid=15579 2024-05-11T02:29:04.849314062Z [2024-05-11T02:29:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:28:00+00:00, map_index=-1, run_start_date=2024-05-11 02:29:02.787732+00:00, run_end_date=2024-05-11 02:29:04.449762+00:00, run_duration=1.66203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:29:00.840326+00:00, queued_by_job_id=2, pid=15580 2024-05-11T02:29:34.142783414Z [2024-05-11T02:29:34.142+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:29:34.142848665Z 2024-05-11T02:29:34.143071688Z [2024-05-11T02:29:34.142+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-11T02:29:34.143757621Z [2024-05-11T02:29:34.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:29:34.143770325Z 2024-05-11T02:29:34.146751864Z [2024-05-11T02:29:34.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240511022933_088190', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:29:34.147098182Z [2024-05-11T02:29:34.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240511022933_088190', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-11T02:29:34.214929298Z [2024-05-11T02:29:34.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240511022933_088190 exited with status queued for try_number 1 2024-05-11T02:29:34.225578506Z [2024-05-11T02:29:34.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1aabcae0-802f-4131-bb64-21c1921b9b82 2024-05-11T02:29:35.379227231Z [2024-05-11T02:29:35.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:29:35.379569871Z [2024-05-11T02:29:35.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-11 02:29:33.474792+00:00, run_id=scaleout_vdu_20240511022933_088190, run_start_date=2024-05-11 02:29:34.099693+00:00, run_end_date=2024-05-11 02:29:35.379101+00:00, run_duration=1.279408, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 02:29:33.474792+00:00, data_interval_end=2024-05-11 02:29:33.474792+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-11T02:29:35.383353998Z [2024-05-11T02:29:35.383+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-11T02:29:35.421835083Z [2024-05-11T02:29:35.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240511022933_088190 exited with status success for try_number 1 2024-05-11T02:29:35.430137169Z [2024-05-11T02:29:35.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240511022933_088190, map_index=-1, run_start_date=2024-05-11 02:29:34.852240+00:00, run_end_date=2024-05-11 02:29:35.213686+00:00, run_duration=0.361446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:29:34.144191+00:00, queued_by_job_id=2, pid=15605 2024-05-11T02:30:00.632032910Z [2024-05-11T02:30:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:31:00+00:00 2024-05-11T02:30:00.646554275Z [2024-05-11T02:30:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:31:00+00:00 2024-05-11T02:30:00.658035788Z [2024-05-11T02:30:00.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:30:00.664588546Z [2024-05-11T02:30:00.664+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:30:00.670761568Z [2024-05-11T02:30:00.670+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:30:00.783901653Z [2024-05-11T02:30:00.783+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T02:30:00.783929144Z 2024-05-11T02:30:00.783934459Z 2024-05-11T02:30:00.783939206Z 2024-05-11T02:30:00.783943280Z 2024-05-11T02:30:00.783947425Z 2024-05-11T02:30:00.784062642Z [2024-05-11T02:30:00.783+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:30:00.784710365Z [2024-05-11T02:30:00.783+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:30:00.784962556Z [2024-05-11T02:30:00.784+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:30:00.785097838Z [2024-05-11T02:30:00.784+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:30:00.785205344Z [2024-05-11T02:30:00.784+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:30:00.785936326Z [2024-05-11T02:30:00.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:30:00.785946938Z 2024-05-11T02:30:00.785952450Z 2024-05-11T02:30:00.785955938Z 2024-05-11T02:30:00.785958981Z 2024-05-11T02:30:00.785961976Z 2024-05-11T02:30:00.789610669Z [2024-05-11T02:30:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:30:00.789786868Z [2024-05-11T02:30:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:30:00.790129721Z [2024-05-11T02:30:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:30:00.790300821Z [2024-05-11T02:30:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:30:00.790589734Z [2024-05-11T02:30:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:30:00.790756563Z [2024-05-11T02:30:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:30:00.791002891Z [2024-05-11T02:30:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:30:00.791195305Z [2024-05-11T02:30:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:30:00.791436457Z [2024-05-11T02:30:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:30:00.791588898Z [2024-05-11T02:30:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:30:01.720514547Z [2024-05-11T02:30:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:01.720551197Z [2024-05-11T02:30:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:01.720747673Z [2024-05-11T02:30:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:29:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:01.720918742Z [2024-05-11T02:30:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:29:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:01.721023963Z [2024-05-11T02:30:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:29:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:01.730732768Z [2024-05-11T02:30:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73cdefa4-4b7d-4255-bf65-cc39f43446f1 2024-05-11T02:30:01.731007198Z [2024-05-11T02:30:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 205a69f8-f499-4ee2-bf6e-5fb32ea23050 2024-05-11T02:30:01.731201266Z [2024-05-11T02:30:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e750e30-bf1d-4ccc-98e7-e7f41b3be03c 2024-05-11T02:30:01.731375489Z [2024-05-11T02:30:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to abce8d0f-3039-470c-b79d-a82bc7652b02 2024-05-11T02:30:03.028285926Z [2024-05-11T02:30:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:30:03.028761855Z [2024-05-11T02:30:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:29:00+00:00, run_id=scheduled__2024-05-11T02:29:00+00:00, run_start_date=2024-05-11 02:30:00.682220+00:00, run_end_date=2024-05-11 02:30:03.028259+00:00, run_duration=2.346039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:29:00+00:00, data_interval_end=2024-05-11 02:30:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:30:03.037672482Z [2024-05-11T02:30:03.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:31:00+00:00 2024-05-11T02:30:03.060887079Z [2024-05-11T02:30:03.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:30:03.061175541Z [2024-05-11T02:30:03.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:28:00+00:00, run_id=scheduled__2024-05-11T02:28:00+00:00, run_start_date=2024-05-11 02:30:00.681240+00:00, run_end_date=2024-05-11 02:30:03.060807+00:00, run_duration=2.379567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:28:00+00:00, data_interval_end=2024-05-11 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:30:03.074518497Z [2024-05-11T02:30:03.073+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:32:00+00:00 2024-05-11T02:30:03.145082689Z [2024-05-11T02:30:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:28:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:03.145237135Z [2024-05-11T02:30:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:29:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:03.153349468Z [2024-05-11T02:30:03.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:28:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:01.748412+00:00, run_end_date=2024-05-11 02:30:02.211876+00:00, run_duration=0.463464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:00.786964+00:00, queued_by_job_id=2, pid=15621 2024-05-11T02:30:03.154181161Z [2024-05-11T02:30:03.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:29:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:01.963672+00:00, run_end_date=2024-05-11 02:30:02.355529+00:00, run_duration=0.391857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:00.786964+00:00, queued_by_job_id=2, pid=15622 2024-05-11T02:30:04.248630267Z [2024-05-11T02:30:04.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:30:04.248676306Z 2024-05-11T02:30:04.249037316Z [2024-05-11T02:30:04.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:30:04.250429960Z [2024-05-11T02:30:04.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:30:04.250455095Z 2024-05-11T02:30:04.254746782Z [2024-05-11T02:30:04.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:30:04.254889132Z [2024-05-11T02:30:04.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:30:04.338251890Z [2024-05-11T02:30:04.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:04.338367220Z [2024-05-11T02:30:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:04.343375123Z [2024-05-11T02:30:04.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ab0512f-6f67-4155-b989-25ce07318e13 2024-05-11T02:30:04.343611704Z [2024-05-11T02:30:04.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:03.352353+00:00, run_end_date=2024-05-11 02:30:03.725317+00:00, run_duration=0.372964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:00.786964+00:00, queued_by_job_id=2, pid=15658 2024-05-11T02:30:04.386044552Z [2024-05-11T02:30:04.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:30:04.386305321Z [2024-05-11T02:30:04.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:29:00+00:00, run_id=scheduled__2024-05-11T02:29:00+00:00, run_start_date=2024-05-11 02:30:00.683108+00:00, run_end_date=2024-05-11 02:30:04.385974+00:00, run_duration=3.702866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:29:00+00:00, data_interval_end=2024-05-11 02:30:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:30:04.399436898Z [2024-05-11T02:30:04.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:31:00+00:00 2024-05-11T02:30:04.671181758Z [2024-05-11T02:30:04.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:29:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:04.680562602Z [2024-05-11T02:30:04.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:29:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:02.922419+00:00, run_end_date=2024-05-11 02:30:04.323222+00:00, run_duration=1.400803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:00.786964+00:00, queued_by_job_id=2, pid=15641 2024-05-11T02:30:05.775490434Z [2024-05-11T02:30:05.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:30:05.775663767Z [2024-05-11T02:30:05.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:29:00+00:00, run_id=scheduled__2024-05-11T02:29:00+00:00, run_start_date=2024-05-11 02:30:00.684002+00:00, run_end_date=2024-05-11 02:30:05.775425+00:00, run_duration=5.091423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:29:00+00:00, data_interval_end=2024-05-11 02:30:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:30:05.793831630Z [2024-05-11T02:30:05.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:31:00+00:00 2024-05-11T02:30:05.893249855Z [2024-05-11T02:30:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:29:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:05.903642883Z [2024-05-11T02:30:05.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:29:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:03.340810+00:00, run_end_date=2024-05-11 02:30:05.161548+00:00, run_duration=1.820738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:00.786964+00:00, queued_by_job_id=2, pid=15657 2024-05-11T02:30:06.980178913Z [2024-05-11T02:30:06.979+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:30:06.980206828Z 2024-05-11T02:30:06.980212428Z [2024-05-11T02:30:06.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:30:06.980217498Z [2024-05-11T02:30:06.979+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:30:06.980222174Z 2024-05-11T02:30:06.982883291Z [2024-05-11T02:30:06.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:30:06.983162100Z [2024-05-11T02:30:06.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:30:07.049875817Z [2024-05-11T02:30:07.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:07.049901885Z [2024-05-11T02:30:07.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:07.054792675Z [2024-05-11T02:30:07.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44aefa8b-b3b7-41b7-a066-3bdc963aa78f 2024-05-11T02:30:07.054903393Z [2024-05-11T02:30:07.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:05.921608+00:00, run_end_date=2024-05-11 02:30:06.255643+00:00, run_duration=0.334035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:04.250975+00:00, queued_by_job_id=2, pid=15686 2024-05-11T02:30:10.904421451Z [2024-05-11T02:30:10.903+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:30:10.904470076Z 2024-05-11T02:30:10.905189005Z [2024-05-11T02:30:10.904+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:30:10.907249867Z [2024-05-11T02:30:10.906+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:30:10.907275073Z 2024-05-11T02:30:10.912803632Z [2024-05-11T02:30:10.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:30:10.913268006Z [2024-05-11T02:30:10.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:30:10.960209106Z [2024-05-11T02:30:10.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status queued for try_number 1 2024-05-11T02:30:10.960481203Z [2024-05-11T02:30:10.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:10.966582024Z [2024-05-11T02:30:10.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 212bd0f0-dbe0-4d1f-ac5f-ec5e210863b2 2024-05-11T02:30:10.970829239Z [2024-05-11T02:30:10.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=0, run_start_date=2024-05-11 02:30:08.720996+00:00, run_end_date=2024-05-11 02:30:09.859030+00:00, run_duration=1.138034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:06.980323+00:00, queued_by_job_id=2, pid=15697 2024-05-11T02:30:13.219528877Z [2024-05-11T02:30:13.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:30:13.219867383Z [2024-05-11T02:30:13.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:25:00+00:00, run_id=scheduled__2024-05-11T02:25:00+00:00, run_start_date=2024-05-11 02:30:00.680157+00:00, run_end_date=2024-05-11 02:30:13.219466+00:00, run_duration=12.539309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:25:00+00:00, data_interval_end=2024-05-11 02:30:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:30:13.228707796Z [2024-05-11T02:30:13.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:30:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:30:13.274697678Z [2024-05-11T02:30:13.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:25:00+00:00 exited with status success for try_number 1 2024-05-11T02:30:13.282201274Z [2024-05-11T02:30:13.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:25:00+00:00, map_index=-1, run_start_date=2024-05-11 02:30:12.530150+00:00, run_end_date=2024-05-11 02:30:12.891726+00:00, run_duration=0.361576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:30:10.908202+00:00, queued_by_job_id=2, pid=15710 2024-05-11T02:30:36.480529563Z [2024-05-11T02:30:36.480+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:31:00.367928517Z [2024-05-11T02:31:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:31:00.380872010Z [2024-05-11T02:31:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:31:00+00:00, run_after=2024-05-11T02:32:00+00:00 2024-05-11T02:31:00.392538578Z [2024-05-11T02:31:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:31:00+00:00, run_after=2024-05-11T02:32:00+00:00 2024-05-11T02:31:00.477014149Z [2024-05-11T02:31:00.475+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:31:00.477209846Z 2024-05-11T02:31:00.477222651Z 2024-05-11T02:31:00.477231362Z 2024-05-11T02:31:00.477240053Z [2024-05-11T02:31:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:31:00.477343922Z [2024-05-11T02:31:00.476+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:31:00.477397151Z [2024-05-11T02:31:00.476+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:31:00.478632413Z [2024-05-11T02:31:00.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:31:00.478684963Z 2024-05-11T02:31:00.478700679Z 2024-05-11T02:31:00.478713799Z 2024-05-11T02:31:00.485414147Z [2024-05-11T02:31:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:31:00.485519463Z [2024-05-11T02:31:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:31:00.485964722Z [2024-05-11T02:31:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:31:00.486153886Z [2024-05-11T02:31:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:31:00.486616810Z [2024-05-11T02:31:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:31:00.486913996Z [2024-05-11T02:31:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:31:00.712927657Z [2024-05-11T02:31:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:31:00.712992314Z [2024-05-11T02:31:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:31:00.712996676Z [2024-05-11T02:31:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:31:00.722380209Z [2024-05-11T02:31:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to f08a4010-4f58-462b-a752-a89b8fe3c594 2024-05-11T02:31:00.722407626Z [2024-05-11T02:31:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 089ffb77-5e0c-410b-955d-27c5f6129ae3 2024-05-11T02:31:00.722511406Z [2024-05-11T02:31:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 120b4a08-adf5-4764-9efe-9830eace5b9a 2024-05-11T02:31:01.902013754Z [2024-05-11T02:31:01.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:31:01.902255242Z [2024-05-11T02:31:01.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:30:00+00:00, run_id=scheduled__2024-05-11T02:30:00+00:00, run_start_date=2024-05-11 02:31:00.403517+00:00, run_end_date=2024-05-11 02:31:01.901824+00:00, run_duration=1.498307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:30:00+00:00, data_interval_end=2024-05-11 02:31:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:31:01.912561152Z [2024-05-11T02:31:01.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:31:00+00:00, run_after=2024-05-11T02:32:00+00:00 2024-05-11T02:31:01.958494169Z [2024-05-11T02:31:01.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:31:01.966125882Z [2024-05-11T02:31:01.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:31:01.287558+00:00, run_end_date=2024-05-11 02:31:01.645697+00:00, run_duration=0.358139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:31:00.480145+00:00, queued_by_job_id=2, pid=15719 2024-05-11T02:31:04.112379836Z [2024-05-11T02:31:04.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:31:04.112644167Z [2024-05-11T02:31:04.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:30:00+00:00, run_id=scheduled__2024-05-11T02:30:00+00:00, run_start_date=2024-05-11 02:31:00.404620+00:00, run_end_date=2024-05-11 02:31:04.112293+00:00, run_duration=3.707673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:30:00+00:00, data_interval_end=2024-05-11 02:31:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:31:04.120887046Z [2024-05-11T02:31:04.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:31:00+00:00, run_after=2024-05-11T02:32:00+00:00 2024-05-11T02:31:04.126352062Z [2024-05-11T02:31:04.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:31:04.126681821Z [2024-05-11T02:31:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:30:00+00:00, run_id=scheduled__2024-05-11T02:30:00+00:00, run_start_date=2024-05-11 02:31:00.405558+00:00, run_end_date=2024-05-11 02:31:04.126226+00:00, run_duration=3.720668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:30:00+00:00, data_interval_end=2024-05-11 02:31:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:31:04.135181939Z [2024-05-11T02:31:04.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:31:00+00:00, run_after=2024-05-11T02:32:00+00:00 2024-05-11T02:31:04.169765202Z [2024-05-11T02:31:04.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:31:04.169931336Z [2024-05-11T02:31:04.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:31:04.182831835Z [2024-05-11T02:31:04.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:31:02.246342+00:00, run_end_date=2024-05-11 02:31:03.719785+00:00, run_duration=1.473443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:31:00.480145+00:00, queued_by_job_id=2, pid=15737 2024-05-11T02:31:04.183107756Z [2024-05-11T02:31:04.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:31:02.335720+00:00, run_end_date=2024-05-11 02:31:03.551548+00:00, run_duration=1.215828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:31:00.480145+00:00, queued_by_job_id=2, pid=15738 2024-05-11T02:31:55.671317141Z [2024-05-11T02:31:55.670+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:31:55.671356981Z 2024-05-11T02:31:55.671564206Z [2024-05-11T02:31:55.671+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-11T02:31:55.672576258Z [2024-05-11T02:31:55.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:31:55.672610897Z 2024-05-11T02:31:55.674767395Z [2024-05-11T02:31:55.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240511023154_237903', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:31:55.675006376Z [2024-05-11T02:31:55.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240511023154_237903', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-11T02:31:55.717784017Z [2024-05-11T02:31:55.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240511023154_237903 exited with status queued for try_number 1 2024-05-11T02:31:55.725334351Z [2024-05-11T02:31:55.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to aec6936d-b444-4afa-8592-b5651029d488 2024-05-11T02:31:57.571982304Z [2024-05-11T02:31:57.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:31:57.572494174Z [2024-05-11T02:31:57.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-11 02:31:55.275859+00:00, run_id=vdu_alarm_20240511023154_237903, run_start_date=2024-05-11 02:31:55.645227+00:00, run_end_date=2024-05-11 02:31:57.571823+00:00, run_duration=1.926596, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 02:31:55.275859+00:00, data_interval_end=2024-05-11 02:31:55.275859+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-11T02:31:57.576516254Z [2024-05-11T02:31:57.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-11T02:31:57.609348051Z [2024-05-11T02:31:57.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240511023154_237903 exited with status success for try_number 1 2024-05-11T02:31:57.616838022Z [2024-05-11T02:31:57.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240511023154_237903, map_index=-1, run_start_date=2024-05-11 02:31:56.264991+00:00, run_end_date=2024-05-11 02:31:56.586604+00:00, run_duration=0.321613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:31:55.672915+00:00, queued_by_job_id=2, pid=15763 2024-05-11T02:32:00.754927024Z [2024-05-11T02:32:00.754+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:32:00.768863567Z [2024-05-11T02:32:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:32:00+00:00, run_after=2024-05-11T02:33:00+00:00 2024-05-11T02:32:00.776316447Z [2024-05-11T02:32:00.775+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:32:00.788257045Z [2024-05-11T02:32:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:32:00+00:00, run_after=2024-05-11T02:33:00+00:00 2024-05-11T02:32:00.876122236Z [2024-05-11T02:32:00.875+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:32:00.876156439Z 2024-05-11T02:32:00.876162933Z 2024-05-11T02:32:00.876167736Z 2024-05-11T02:32:00.876195908Z 2024-05-11T02:32:00.876334698Z [2024-05-11T02:32:00.876+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:32:00.876557756Z [2024-05-11T02:32:00.876+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:32:00.876807520Z [2024-05-11T02:32:00.876+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:32:00.877148557Z [2024-05-11T02:32:00.876+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:32:00.878133540Z [2024-05-11T02:32:00.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:32:00.878151445Z 2024-05-11T02:32:00.878157013Z 2024-05-11T02:32:00.878161950Z 2024-05-11T02:32:00.878167395Z 2024-05-11T02:32:00.883855872Z [2024-05-11T02:32:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:32:00.884042353Z [2024-05-11T02:32:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:32:00.884474948Z [2024-05-11T02:32:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:32:00.884695587Z [2024-05-11T02:32:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:32:00.885069840Z [2024-05-11T02:32:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:32:00.885359976Z [2024-05-11T02:32:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:32:00.885742969Z [2024-05-11T02:32:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:32:00.886035319Z [2024-05-11T02:32:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:32:01.283380289Z [2024-05-11T02:32:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:32:01.283456612Z [2024-05-11T02:32:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:31:00+00:00 exited with status queued for try_number 1 2024-05-11T02:32:01.283461834Z [2024-05-11T02:32:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:31:00+00:00 exited with status queued for try_number 1 2024-05-11T02:32:01.283507005Z [2024-05-11T02:32:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:31:00+00:00 exited with status queued for try_number 1 2024-05-11T02:32:01.293108321Z [2024-05-11T02:32:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to f41bec22-2de9-4984-8443-9520ff6dfe67 2024-05-11T02:32:01.293196111Z [2024-05-11T02:32:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 515088dc-2cd2-4309-b04a-8678be0af86d 2024-05-11T02:32:01.293275474Z [2024-05-11T02:32:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to e946e63b-9d6a-43c9-8b12-e71386485082 2024-05-11T02:32:01.293377238Z [2024-05-11T02:32:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4228395c-4057-4538-81a4-1aa3274e84d9 2024-05-11T02:32:02.762543833Z [2024-05-11T02:32:02.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:32:02.762855203Z [2024-05-11T02:32:02.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:30:00+00:00, run_id=scheduled__2024-05-11T02:30:00+00:00, run_start_date=2024-05-11 02:32:00.798995+00:00, run_end_date=2024-05-11 02:32:02.762503+00:00, run_duration=1.963508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:30:00+00:00, data_interval_end=2024-05-11 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:32:02.776704206Z [2024-05-11T02:32:02.776+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:32:00+00:00, run_after=2024-05-11T02:34:00+00:00 2024-05-11T02:32:02.795556407Z [2024-05-11T02:32:02.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:32:02.795779525Z [2024-05-11T02:32:02.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:31:00+00:00, run_id=scheduled__2024-05-11T02:31:00+00:00, run_start_date=2024-05-11 02:32:00.800151+00:00, run_end_date=2024-05-11 02:32:02.795453+00:00, run_duration=1.995302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:31:00+00:00, data_interval_end=2024-05-11 02:32:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:32:02.813144646Z [2024-05-11T02:32:02.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:32:00+00:00, run_after=2024-05-11T02:33:00+00:00 2024-05-11T02:32:02.853077950Z [2024-05-11T02:32:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:32:02.853186948Z [2024-05-11T02:32:02.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:31:00+00:00 exited with status success for try_number 1 2024-05-11T02:32:02.861013516Z [2024-05-11T02:32:02.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:31:00+00:00, map_index=-1, run_start_date=2024-05-11 02:32:01.887785+00:00, run_end_date=2024-05-11 02:32:02.345966+00:00, run_duration=0.458181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:32:00.879537+00:00, queued_by_job_id=2, pid=15779 2024-05-11T02:32:02.861227715Z [2024-05-11T02:32:02.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:32:01.861939+00:00, run_end_date=2024-05-11 02:32:02.354391+00:00, run_duration=0.492452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:32:00.879537+00:00, queued_by_job_id=2, pid=15778 2024-05-11T02:32:05.016966311Z [2024-05-11T02:32:05.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:32:05.017388888Z [2024-05-11T02:32:05.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:31:00+00:00, run_id=scheduled__2024-05-11T02:31:00+00:00, run_start_date=2024-05-11 02:32:00.801149+00:00, run_end_date=2024-05-11 02:32:05.016842+00:00, run_duration=4.215693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:31:00+00:00, data_interval_end=2024-05-11 02:32:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:32:05.025953614Z [2024-05-11T02:32:05.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:32:00+00:00, run_after=2024-05-11T02:33:00+00:00 2024-05-11T02:32:05.068924416Z [2024-05-11T02:32:05.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:31:00+00:00 exited with status success for try_number 1 2024-05-11T02:32:05.073380905Z [2024-05-11T02:32:05.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:31:00+00:00, map_index=-1, run_start_date=2024-05-11 02:32:02.917486+00:00, run_end_date=2024-05-11 02:32:04.889172+00:00, run_duration=1.971686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:32:00.879537+00:00, queued_by_job_id=2, pid=15802 2024-05-11T02:32:06.129239219Z [2024-05-11T02:32:06.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:32:06.129618009Z [2024-05-11T02:32:06.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:31:00+00:00, run_id=scheduled__2024-05-11T02:31:00+00:00, run_start_date=2024-05-11 02:32:00.802129+00:00, run_end_date=2024-05-11 02:32:06.129143+00:00, run_duration=5.327014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:31:00+00:00, data_interval_end=2024-05-11 02:32:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:32:06.138206321Z [2024-05-11T02:32:06.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:32:00+00:00, run_after=2024-05-11T02:33:00+00:00 2024-05-11T02:32:06.165104733Z [2024-05-11T02:32:06.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:31:00+00:00 exited with status success for try_number 1 2024-05-11T02:32:06.169647436Z [2024-05-11T02:32:06.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:31:00+00:00, map_index=-1, run_start_date=2024-05-11 02:32:03.045148+00:00, run_end_date=2024-05-11 02:32:05.290121+00:00, run_duration=2.244973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:32:00.879537+00:00, queued_by_job_id=2, pid=15803 2024-05-11T02:33:00.106019408Z [2024-05-11T02:33:00.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:33:00+00:00, run_after=2024-05-11T02:34:00+00:00 2024-05-11T02:33:00.113981051Z [2024-05-11T02:33:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:33:00.126569129Z [2024-05-11T02:33:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:33:00+00:00, run_after=2024-05-11T02:34:00+00:00 2024-05-11T02:33:00.223035378Z [2024-05-11T02:33:00.222+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:33:00.223060725Z 2024-05-11T02:33:00.223065090Z 2024-05-11T02:33:00.223068668Z 2024-05-11T02:33:00.223247011Z [2024-05-11T02:33:00.223+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:33:00.223451063Z [2024-05-11T02:33:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:33:00.223643413Z [2024-05-11T02:33:00.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:33:00.224410026Z [2024-05-11T02:33:00.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:33:00.224418428Z 2024-05-11T02:33:00.224421675Z 2024-05-11T02:33:00.224424806Z 2024-05-11T02:33:00.228486168Z [2024-05-11T02:33:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:33:00.228752979Z [2024-05-11T02:33:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:33:00.229204035Z [2024-05-11T02:33:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:33:00.229415226Z [2024-05-11T02:33:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:33:00.229738869Z [2024-05-11T02:33:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:33:00.229925530Z [2024-05-11T02:33:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:33:00.650925377Z [2024-05-11T02:33:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status queued for try_number 1 2024-05-11T02:33:00.651087709Z [2024-05-11T02:33:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status queued for try_number 1 2024-05-11T02:33:00.651226253Z [2024-05-11T02:33:00.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status queued for try_number 1 2024-05-11T02:33:00.671332182Z [2024-05-11T02:33:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a223f3f-3ae8-4c5c-9f49-29af71ca2970 2024-05-11T02:33:00.671402240Z [2024-05-11T02:33:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2ad05a4-c2bc-4a56-95c5-2619410ce9d2 2024-05-11T02:33:00.671616751Z [2024-05-11T02:33:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f5608ba-c3f1-43ae-b4cf-2287e83c846f 2024-05-11T02:33:01.958288011Z [2024-05-11T02:33:01.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:33:01.958928783Z [2024-05-11T02:33:01.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:32:00+00:00, run_id=scheduled__2024-05-11T02:32:00+00:00, run_start_date=2024-05-11 02:33:00.142598+00:00, run_end_date=2024-05-11 02:33:01.958207+00:00, run_duration=1.815609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:32:00+00:00, data_interval_end=2024-05-11 02:33:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:33:01.973905593Z [2024-05-11T02:33:01.973+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:33:00+00:00, run_after=2024-05-11T02:34:00+00:00 2024-05-11T02:33:02.031940966Z [2024-05-11T02:33:02.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status success for try_number 1 2024-05-11T02:33:02.044342268Z [2024-05-11T02:33:02.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:32:00+00:00, map_index=-1, run_start_date=2024-05-11 02:33:01.186640+00:00, run_end_date=2024-05-11 02:33:01.695516+00:00, run_duration=0.508876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:33:00.225301+00:00, queued_by_job_id=2, pid=15836 2024-05-11T02:33:04.837618523Z [2024-05-11T02:33:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:33:04.838855736Z [2024-05-11T02:33:04.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:32:00+00:00, run_id=scheduled__2024-05-11T02:32:00+00:00, run_start_date=2024-05-11 02:33:00.144886+00:00, run_end_date=2024-05-11 02:33:04.837507+00:00, run_duration=4.692621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:32:00+00:00, data_interval_end=2024-05-11 02:33:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:33:04.848202466Z [2024-05-11T02:33:04.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:33:00+00:00, run_after=2024-05-11T02:34:00+00:00 2024-05-11T02:33:04.855756484Z [2024-05-11T02:33:04.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:33:04.855824912Z [2024-05-11T02:33:04.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:32:00+00:00, run_id=scheduled__2024-05-11T02:32:00+00:00, run_start_date=2024-05-11 02:33:00.146968+00:00, run_end_date=2024-05-11 02:33:04.855503+00:00, run_duration=4.708535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:32:00+00:00, data_interval_end=2024-05-11 02:33:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:33:04.865845945Z [2024-05-11T02:33:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:33:00+00:00, run_after=2024-05-11T02:34:00+00:00 2024-05-11T02:33:04.896900804Z [2024-05-11T02:33:04.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status success for try_number 1 2024-05-11T02:33:04.896932453Z [2024-05-11T02:33:04.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status success for try_number 1 2024-05-11T02:33:04.904201186Z [2024-05-11T02:33:04.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:32:00+00:00, map_index=-1, run_start_date=2024-05-11 02:33:02.310307+00:00, run_end_date=2024-05-11 02:33:03.970699+00:00, run_duration=1.660392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:33:00.225301+00:00, queued_by_job_id=2, pid=15855 2024-05-11T02:33:04.904480071Z [2024-05-11T02:33:04.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:32:00+00:00, map_index=-1, run_start_date=2024-05-11 02:33:02.308435+00:00, run_end_date=2024-05-11 02:33:03.774013+00:00, run_duration=1.465578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:33:00.225301+00:00, queued_by_job_id=2, pid=15854 2024-05-11T02:34:00.720523315Z [2024-05-11T02:34:00.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:34:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:34:00.733233788Z [2024-05-11T02:34:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:34:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:34:00.739375260Z [2024-05-11T02:34:00.738+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:34:00.745036011Z [2024-05-11T02:34:00.744+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:34:00.807152187Z [2024-05-11T02:34:00.806+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:34:00.807205989Z 2024-05-11T02:34:00.807216752Z 2024-05-11T02:34:00.807225431Z 2024-05-11T02:34:00.807233804Z 2024-05-11T02:34:00.807243105Z [2024-05-11T02:34:00.806+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:34:00.807390787Z [2024-05-11T02:34:00.807+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:34:00.807430527Z [2024-05-11T02:34:00.807+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:34:00.807543885Z [2024-05-11T02:34:00.807+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:34:00.808022929Z [2024-05-11T02:34:00.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:34:00.808092294Z 2024-05-11T02:34:00.808105473Z 2024-05-11T02:34:00.808114222Z 2024-05-11T02:34:00.808122627Z 2024-05-11T02:34:00.812179207Z [2024-05-11T02:34:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:34:00.812200583Z [2024-05-11T02:34:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:34:00.812205649Z [2024-05-11T02:34:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:34:00.812209334Z [2024-05-11T02:34:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:34:00.812370804Z [2024-05-11T02:34:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:34:00.812439814Z [2024-05-11T02:34:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:34:00.812609684Z [2024-05-11T02:34:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:34:00.812696203Z [2024-05-11T02:34:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:34:01.180102271Z [2024-05-11T02:34:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status queued for try_number 1 2024-05-11T02:34:01.180444634Z [2024-05-11T02:34:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:33:00+00:00 exited with status queued for try_number 1 2024-05-11T02:34:01.180641477Z [2024-05-11T02:34:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:33:00+00:00 exited with status queued for try_number 1 2024-05-11T02:34:01.180799607Z [2024-05-11T02:34:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:33:00+00:00 exited with status queued for try_number 1 2024-05-11T02:34:01.210724121Z [2024-05-11T02:34:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1df33562-03b8-49de-aa67-61595058b33c 2024-05-11T02:34:01.216450192Z [2024-05-11T02:34:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7fa15be-3072-4737-a873-8164f66f2b6f 2024-05-11T02:34:01.217005049Z [2024-05-11T02:34:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3ce66c7-f081-4c7a-b2a0-d8e473e66436 2024-05-11T02:34:01.217359451Z [2024-05-11T02:34:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to 590abdc3-6976-48c4-b52d-1bb5cde37d0f 2024-05-11T02:34:02.629340008Z [2024-05-11T02:34:02.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:34:02.629572648Z [2024-05-11T02:34:02.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:32:00+00:00, run_id=scheduled__2024-05-11T02:32:00+00:00, run_start_date=2024-05-11 02:34:00.753601+00:00, run_end_date=2024-05-11 02:34:02.629237+00:00, run_duration=1.875636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:32:00+00:00, data_interval_end=2024-05-11 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:34:02.663094303Z [2024-05-11T02:34:02.662+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:34:00+00:00, run_after=2024-05-11T02:36:00+00:00 2024-05-11T02:34:02.804032334Z [2024-05-11T02:34:02.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:32:00+00:00 exited with status success for try_number 1 2024-05-11T02:34:02.826791522Z [2024-05-11T02:34:02.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:32:00+00:00, map_index=-1, run_start_date=2024-05-11 02:34:01.874570+00:00, run_end_date=2024-05-11 02:34:02.262500+00:00, run_duration=0.38793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:34:00.808954+00:00, queued_by_job_id=2, pid=15887 2024-05-11T02:34:03.466690051Z [2024-05-11T02:34:03.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:34:03.467023067Z [2024-05-11T02:34:03.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:33:00+00:00, run_id=scheduled__2024-05-11T02:33:00+00:00, run_start_date=2024-05-11 02:34:00.754828+00:00, run_end_date=2024-05-11 02:34:03.466742+00:00, run_duration=2.711914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:33:00+00:00, data_interval_end=2024-05-11 02:34:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:34:03.493949667Z [2024-05-11T02:34:03.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:34:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:34:03.587208490Z [2024-05-11T02:34:03.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:33:00+00:00 exited with status success for try_number 1 2024-05-11T02:34:03.592308291Z [2024-05-11T02:34:03.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:33:00+00:00, map_index=-1, run_start_date=2024-05-11 02:34:02.315767+00:00, run_end_date=2024-05-11 02:34:02.781100+00:00, run_duration=0.465333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:34:00.808954+00:00, queued_by_job_id=2, pid=15895 2024-05-11T02:34:05.744081756Z [2024-05-11T02:34:05.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:34:05.746924214Z [2024-05-11T02:34:05.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:33:00+00:00, run_id=scheduled__2024-05-11T02:33:00+00:00, run_start_date=2024-05-11 02:34:00.757179+00:00, run_end_date=2024-05-11 02:34:05.744200+00:00, run_duration=4.987021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:33:00+00:00, data_interval_end=2024-05-11 02:34:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:34:05.756026585Z [2024-05-11T02:34:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:34:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:34:05.763036881Z [2024-05-11T02:34:05.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:34:05.763400441Z [2024-05-11T02:34:05.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:33:00+00:00, run_id=scheduled__2024-05-11T02:33:00+00:00, run_start_date=2024-05-11 02:34:00.755856+00:00, run_end_date=2024-05-11 02:34:05.763030+00:00, run_duration=5.007174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:33:00+00:00, data_interval_end=2024-05-11 02:34:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:34:05.773404371Z [2024-05-11T02:34:05.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:34:00+00:00, run_after=2024-05-11T02:35:00+00:00 2024-05-11T02:34:05.803071103Z [2024-05-11T02:34:05.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:33:00+00:00 exited with status success for try_number 1 2024-05-11T02:34:05.803411390Z [2024-05-11T02:34:05.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:33:00+00:00 exited with status success for try_number 1 2024-05-11T02:34:05.817540962Z [2024-05-11T02:34:05.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:33:00+00:00, map_index=-1, run_start_date=2024-05-11 02:34:03.207000+00:00, run_end_date=2024-05-11 02:34:05.631018+00:00, run_duration=2.424018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:34:00.808954+00:00, queued_by_job_id=2, pid=15906 2024-05-11T02:34:05.817987795Z [2024-05-11T02:34:05.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:33:00+00:00, map_index=-1, run_start_date=2024-05-11 02:34:03.963052+00:00, run_end_date=2024-05-11 02:34:05.470465+00:00, run_duration=1.507413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:34:00.808954+00:00, queued_by_job_id=2, pid=15918 2024-05-11T02:35:01.020876996Z [2024-05-11T02:35:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:35:01.031658331Z [2024-05-11T02:35:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:35:01.054970452Z [2024-05-11T02:35:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:36:00+00:00 2024-05-11T02:35:01.082815977Z [2024-05-11T02:35:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:36:00+00:00 2024-05-11T02:35:01.176758507Z [2024-05-11T02:35:01.176+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:35:01.176780716Z 2024-05-11T02:35:01.176785074Z 2024-05-11T02:35:01.176788521Z 2024-05-11T02:35:01.176792233Z 2024-05-11T02:35:01.177052065Z [2024-05-11T02:35:01.176+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:35:01.177255447Z [2024-05-11T02:35:01.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:35:01.177523274Z [2024-05-11T02:35:01.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:35:01.177701800Z [2024-05-11T02:35:01.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:35:01.178368853Z [2024-05-11T02:35:01.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:35:01.178381310Z 2024-05-11T02:35:01.178385407Z 2024-05-11T02:35:01.178388744Z 2024-05-11T02:35:01.178392219Z 2024-05-11T02:35:01.183633981Z [2024-05-11T02:35:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:35:01.183967555Z [2024-05-11T02:35:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:35:01.184367031Z [2024-05-11T02:35:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:35:01.184571409Z [2024-05-11T02:35:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:35:01.184878611Z [2024-05-11T02:35:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:35:01.185072923Z [2024-05-11T02:35:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:35:01.187454776Z [2024-05-11T02:35:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:35:01.188205198Z [2024-05-11T02:35:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:35:01.576150488Z [2024-05-11T02:35:01.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:01.576387812Z [2024-05-11T02:35:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:01.576563697Z [2024-05-11T02:35:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:01.576712040Z [2024-05-11T02:35:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:01.589632202Z [2024-05-11T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96bc7d1d-4e42-4f34-a09e-4cbbaf682dcb 2024-05-11T02:35:01.590055317Z [2024-05-11T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1d5bdb9-a970-4874-88e4-e122a5fad42b 2024-05-11T02:35:01.590197752Z [2024-05-11T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee66bc0b-6dc4-4643-8b12-a2d4c7de993b 2024-05-11T02:35:01.590422645Z [2024-05-11T02:35:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c0053f9-5f14-443d-bd47-b376eaf57e74 2024-05-11T02:35:02.796973558Z [2024-05-11T02:35:02.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:35:02.798279081Z [2024-05-11T02:35:02.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:34:00+00:00, run_id=scheduled__2024-05-11T02:34:00+00:00, run_start_date=2024-05-11 02:35:01.101458+00:00, run_end_date=2024-05-11 02:35:02.797591+00:00, run_duration=1.696133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:34:00+00:00, data_interval_end=2024-05-11 02:35:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:35:02.814096384Z [2024-05-11T02:35:02.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:36:00+00:00 2024-05-11T02:35:02.885778624Z [2024-05-11T02:35:02.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:02.894408662Z [2024-05-11T02:35:02.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:34:00+00:00, map_index=-1, run_start_date=2024-05-11 02:35:01.944413+00:00, run_end_date=2024-05-11 02:35:02.469609+00:00, run_duration=0.525196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:01.179391+00:00, queued_by_job_id=2, pid=15946 2024-05-11T02:35:03.980290545Z [2024-05-11T02:35:03.979+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:35:03.980339460Z 2024-05-11T02:35:03.981338650Z [2024-05-11T02:35:03.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:35:03.981818124Z [2024-05-11T02:35:03.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:35:03.981835124Z 2024-05-11T02:35:03.984577964Z [2024-05-11T02:35:03.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:35:03.984635501Z [2024-05-11T02:35:03.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:35:04.045576970Z [2024-05-11T02:35:04.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:04.051869924Z [2024-05-11T02:35:04.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b3562a0-4a21-45cb-9340-13691f7484c3 2024-05-11T02:35:04.181254653Z [2024-05-11T02:35:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:04.189533575Z [2024-05-11T02:35:04.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:35:03.450373+00:00, run_end_date=2024-05-11 02:35:03.850010+00:00, run_duration=0.399637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:01.179391+00:00, queued_by_job_id=2, pid=15971 2024-05-11T02:35:05.687883345Z [2024-05-11T02:35:05.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:35:05.688191207Z [2024-05-11T02:35:05.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:34:00+00:00, run_id=scheduled__2024-05-11T02:34:00+00:00, run_start_date=2024-05-11 02:35:01.103893+00:00, run_end_date=2024-05-11 02:35:05.687796+00:00, run_duration=4.583903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:34:00+00:00, data_interval_end=2024-05-11 02:35:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:35:05.698386072Z [2024-05-11T02:35:05.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:36:00+00:00 2024-05-11T02:35:05.705753052Z [2024-05-11T02:35:05.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:35:05.705984542Z [2024-05-11T02:35:05.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:34:00+00:00, run_id=scheduled__2024-05-11T02:34:00+00:00, run_start_date=2024-05-11 02:35:01.106011+00:00, run_end_date=2024-05-11 02:35:05.705644+00:00, run_duration=4.599633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:34:00+00:00, data_interval_end=2024-05-11 02:35:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:35:05.715186304Z [2024-05-11T02:35:05.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:36:00+00:00 2024-05-11T02:35:05.769651276Z [2024-05-11T02:35:05.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:05.769917343Z [2024-05-11T02:35:05.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:05.783520427Z [2024-05-11T02:35:05.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:34:00+00:00, map_index=-1, run_start_date=2024-05-11 02:35:03.523295+00:00, run_end_date=2024-05-11 02:35:04.906933+00:00, run_duration=1.383638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:01.179391+00:00, queued_by_job_id=2, pid=15972 2024-05-11T02:35:05.786532928Z [2024-05-11T02:35:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:34:00+00:00, map_index=-1, run_start_date=2024-05-11 02:35:03.300270+00:00, run_end_date=2024-05-11 02:35:04.979659+00:00, run_duration=1.679389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:01.179391+00:00, queued_by_job_id=2, pid=15970 2024-05-11T02:35:06.900903057Z [2024-05-11T02:35:06.900+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:35:06.900927129Z 2024-05-11T02:35:06.901081061Z [2024-05-11T02:35:06.900+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:35:06.901645308Z [2024-05-11T02:35:06.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:35:06.901655465Z 2024-05-11T02:35:06.904402847Z [2024-05-11T02:35:06.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:35:06.904415858Z [2024-05-11T02:35:06.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:35:06.955924515Z [2024-05-11T02:35:06.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:06.956068657Z [2024-05-11T02:35:06.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:06.962513422Z [2024-05-11T02:35:06.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38ec3a05-c1dd-4cec-89e4-c6f6eaae96b9 2024-05-11T02:35:06.962984911Z [2024-05-11T02:35:06.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:35:05.859675+00:00, run_end_date=2024-05-11 02:35:06.326302+00:00, run_duration=0.466627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:03.982145+00:00, queued_by_job_id=2, pid=16005 2024-05-11T02:35:09.222778530Z [2024-05-11T02:35:09.222+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:35:09.222830543Z 2024-05-11T02:35:09.222884015Z [2024-05-11T02:35:09.222+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:35:09.224326310Z [2024-05-11T02:35:09.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:35:09.224343312Z 2024-05-11T02:35:09.229677556Z [2024-05-11T02:35:09.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:35:09.229933876Z [2024-05-11T02:35:09.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:35:09.311046667Z [2024-05-11T02:35:09.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status queued for try_number 1 2024-05-11T02:35:09.311130575Z [2024-05-11T02:35:09.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:09.317666960Z [2024-05-11T02:35:09.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba9a72ea-7eb4-4d39-b888-77a231f1561a 2024-05-11T02:35:09.317786687Z [2024-05-11T02:35:09.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=0, run_start_date=2024-05-11 02:35:08.594410+00:00, run_end_date=2024-05-11 02:35:08.958339+00:00, run_duration=0.363929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:06.902068+00:00, queued_by_job_id=2, pid=16016 2024-05-11T02:35:11.767355993Z [2024-05-11T02:35:11.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:35:11.767815277Z [2024-05-11T02:35:11.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:30:00+00:00, run_id=scheduled__2024-05-11T02:30:00+00:00, run_start_date=2024-05-11 02:35:01.098513+00:00, run_end_date=2024-05-11 02:35:11.767263+00:00, run_duration=10.66875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:30:00+00:00, data_interval_end=2024-05-11 02:35:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:35:11.776006510Z [2024-05-11T02:35:11.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:35:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:35:11.809124628Z [2024-05-11T02:35:11.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:30:00+00:00 exited with status success for try_number 1 2024-05-11T02:35:11.815637169Z [2024-05-11T02:35:11.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:30:00+00:00, map_index=-1, run_start_date=2024-05-11 02:35:10.860040+00:00, run_end_date=2024-05-11 02:35:11.284862+00:00, run_duration=0.424822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:09.225219+00:00, queued_by_job_id=2, pid=16024 2024-05-11T02:35:36.559051453Z [2024-05-11T02:35:36.558+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:35:55.453740267Z [2024-05-11T02:35:55.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:35:55.453769652Z 2024-05-11T02:35:55.453963210Z [2024-05-11T02:35:55.453+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-11T02:35:55.454522747Z [2024-05-11T02:35:55.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:35:55.454533279Z 2024-05-11T02:35:55.456675981Z [2024-05-11T02:35:55.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240511023555_290744', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:35:55.456792346Z [2024-05-11T02:35:55.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240511023555_290744', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-11T02:35:55.521895358Z [2024-05-11T02:35:55.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240511023555_290744 exited with status queued for try_number 1 2024-05-11T02:35:55.528022832Z [2024-05-11T02:35:55.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dd6722f-c4ea-4e7c-b744-c0aa669cda5f 2024-05-11T02:35:56.659694917Z [2024-05-11T02:35:56.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:35:56.660058636Z [2024-05-11T02:35:56.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-11 02:35:55.290410+00:00, run_id=vdu_alarm_20240511023555_290744, run_start_date=2024-05-11 02:35:55.394886+00:00, run_end_date=2024-05-11 02:35:56.659611+00:00, run_duration=1.264725, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-11 02:35:55.290410+00:00, data_interval_end=2024-05-11 02:35:55.290410+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-11T02:35:56.663506959Z [2024-05-11T02:35:56.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-11T02:35:56.691803354Z [2024-05-11T02:35:56.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240511023555_290744 exited with status success for try_number 1 2024-05-11T02:35:56.698457678Z [2024-05-11T02:35:56.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240511023555_290744, map_index=-1, run_start_date=2024-05-11 02:35:56.067270+00:00, run_end_date=2024-05-11 02:35:56.372187+00:00, run_duration=0.304917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:35:55.454854+00:00, queued_by_job_id=2, pid=16026 2024-05-11T02:36:00.231684315Z [2024-05-11T02:36:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:36:00+00:00, run_after=2024-05-11T02:37:00+00:00 2024-05-11T02:36:00.244894411Z [2024-05-11T02:36:00.244+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:36:00.258852725Z [2024-05-11T02:36:00.258+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:36:00+00:00, run_after=2024-05-11T02:37:00+00:00 2024-05-11T02:36:00.266545141Z [2024-05-11T02:36:00.266+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:36:00.361710698Z [2024-05-11T02:36:00.361+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:36:00.361725408Z 2024-05-11T02:36:00.361731030Z 2024-05-11T02:36:00.361734159Z 2024-05-11T02:36:00.361737213Z 2024-05-11T02:36:00.362472374Z [2024-05-11T02:36:00.361+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:36:00.363002178Z [2024-05-11T02:36:00.362+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:36:00.363230425Z [2024-05-11T02:36:00.363+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:36:00.363938320Z [2024-05-11T02:36:00.363+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:36:00.365932761Z [2024-05-11T02:36:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:36:00.365944430Z 2024-05-11T02:36:00.365950087Z 2024-05-11T02:36:00.365953130Z 2024-05-11T02:36:00.365956309Z 2024-05-11T02:36:00.374487107Z [2024-05-11T02:36:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:36:00.374705181Z [2024-05-11T02:36:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:36:00.375208257Z [2024-05-11T02:36:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:36:00.375511517Z [2024-05-11T02:36:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:36:00.375807857Z [2024-05-11T02:36:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:36:00.376157750Z [2024-05-11T02:36:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:36:00.376573740Z [2024-05-11T02:36:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:36:00.376796358Z [2024-05-11T02:36:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:36:00.792547223Z [2024-05-11T02:36:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status queued for try_number 1 2024-05-11T02:36:00.792725433Z [2024-05-11T02:36:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:36:00.792881872Z [2024-05-11T02:36:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:36:00.793064618Z [2024-05-11T02:36:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:36:00.808110337Z [2024-05-11T02:36:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e64cb94-d66a-4a7d-8ce4-cf0378a287ef 2024-05-11T02:36:00.808347682Z [2024-05-11T02:36:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb7d5a7d-a9d8-465b-9ae1-afceef074026 2024-05-11T02:36:00.808648301Z [2024-05-11T02:36:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93487163-4dcb-4643-bcf2-a9dd4303c3dc 2024-05-11T02:36:00.808878025Z [2024-05-11T02:36:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12063f97-4025-44d3-b1e0-a45c2c0266ec 2024-05-11T02:36:03.318970055Z [2024-05-11T02:36:03.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:36:03.319406388Z [2024-05-11T02:36:03.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:35:00+00:00, run_id=scheduled__2024-05-11T02:35:00+00:00, run_start_date=2024-05-11 02:36:00.282491+00:00, run_end_date=2024-05-11 02:36:03.319080+00:00, run_duration=3.036589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:35:00+00:00, data_interval_end=2024-05-11 02:36:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:36:03.331462035Z [2024-05-11T02:36:03.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:36:00+00:00, run_after=2024-05-11T02:37:00+00:00 2024-05-11T02:36:03.342416204Z [2024-05-11T02:36:03.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:36:03.342938876Z [2024-05-11T02:36:03.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:34:00+00:00, run_id=scheduled__2024-05-11T02:34:00+00:00, run_start_date=2024-05-11 02:36:00.281328+00:00, run_end_date=2024-05-11 02:36:03.342543+00:00, run_duration=3.061215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:34:00+00:00, data_interval_end=2024-05-11 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:36:03.354862165Z [2024-05-11T02:36:03.354+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:36:00+00:00, run_after=2024-05-11T02:38:00+00:00 2024-05-11T02:36:03.424913254Z [2024-05-11T02:36:03.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:34:00+00:00 exited with status success for try_number 1 2024-05-11T02:36:03.424936342Z [2024-05-11T02:36:03.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:36:03.433458156Z [2024-05-11T02:36:03.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:34:00+00:00, map_index=-1, run_start_date=2024-05-11 02:36:01.579452+00:00, run_end_date=2024-05-11 02:36:02.139488+00:00, run_duration=0.560036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:36:00.369506+00:00, queued_by_job_id=2, pid=16041 2024-05-11T02:36:03.433477103Z [2024-05-11T02:36:03.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=-1, run_start_date=2024-05-11 02:36:01.804269+00:00, run_end_date=2024-05-11 02:36:02.290021+00:00, run_duration=0.485752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:36:00.369506+00:00, queued_by_job_id=2, pid=16042 2024-05-11T02:36:05.546985685Z [2024-05-11T02:36:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:36:05.547327082Z [2024-05-11T02:36:05.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:35:00+00:00, run_id=scheduled__2024-05-11T02:35:00+00:00, run_start_date=2024-05-11 02:36:00.283382+00:00, run_end_date=2024-05-11 02:36:05.546926+00:00, run_duration=5.263544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:35:00+00:00, data_interval_end=2024-05-11 02:36:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:36:05.555998912Z [2024-05-11T02:36:05.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:36:00+00:00, run_after=2024-05-11T02:37:00+00:00 2024-05-11T02:36:05.598899327Z [2024-05-11T02:36:05.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:36:05.606307606Z [2024-05-11T02:36:05.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=-1, run_start_date=2024-05-11 02:36:02.941171+00:00, run_end_date=2024-05-11 02:36:04.387059+00:00, run_duration=1.445888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:36:00.369506+00:00, queued_by_job_id=2, pid=16065 2024-05-11T02:36:07.031804432Z [2024-05-11T02:36:07.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:36:07.032285839Z [2024-05-11T02:36:07.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:35:00+00:00, run_id=scheduled__2024-05-11T02:35:00+00:00, run_start_date=2024-05-11 02:36:00.284465+00:00, run_end_date=2024-05-11 02:36:07.031708+00:00, run_duration=6.747243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:35:00+00:00, data_interval_end=2024-05-11 02:36:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:36:07.045285788Z [2024-05-11T02:36:07.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:36:00+00:00, run_after=2024-05-11T02:37:00+00:00 2024-05-11T02:36:07.114018494Z [2024-05-11T02:36:07.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:36:07.124225657Z [2024-05-11T02:36:07.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=-1, run_start_date=2024-05-11 02:36:03.058906+00:00, run_end_date=2024-05-11 02:36:06.222450+00:00, run_duration=3.163544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:36:00.369506+00:00, queued_by_job_id=2, pid=16066 2024-05-11T02:37:00.901623813Z [2024-05-11T02:37:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:37:00+00:00, run_after=2024-05-11T02:38:00+00:00 2024-05-11T02:37:00.917976455Z [2024-05-11T02:37:00.917+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:37:00.948630954Z [2024-05-11T02:37:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:37:00+00:00, run_after=2024-05-11T02:38:00+00:00 2024-05-11T02:37:01.056652161Z [2024-05-11T02:37:01.056+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:37:01.056679190Z 2024-05-11T02:37:01.056684108Z 2024-05-11T02:37:01.056688176Z 2024-05-11T02:37:01.056692187Z [2024-05-11T02:37:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:37:01.056773183Z [2024-05-11T02:37:01.056+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:37:01.056779462Z [2024-05-11T02:37:01.056+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:37:01.057245975Z [2024-05-11T02:37:01.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:37:01.057257042Z 2024-05-11T02:37:01.057261528Z 2024-05-11T02:37:01.057265619Z 2024-05-11T02:37:01.061192803Z [2024-05-11T02:37:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:37:01.061221316Z [2024-05-11T02:37:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:37:01.061226168Z [2024-05-11T02:37:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:37:01.061230824Z [2024-05-11T02:37:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:37:01.061248061Z [2024-05-11T02:37:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:37:01.061252054Z [2024-05-11T02:37:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:37:01.395558153Z [2024-05-11T02:37:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status queued for try_number 1 2024-05-11T02:37:01.395597173Z [2024-05-11T02:37:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status queued for try_number 1 2024-05-11T02:37:01.395686965Z [2024-05-11T02:37:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status queued for try_number 1 2024-05-11T02:37:01.406231491Z [2024-05-11T02:37:01.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c554635-e4eb-4aae-b697-53856749d6cc 2024-05-11T02:37:01.406300241Z [2024-05-11T02:37:01.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0c71ae0-fb7c-4efa-8272-8d11077e8bd9 2024-05-11T02:37:01.406402855Z [2024-05-11T02:37:01.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7723585d-d6f0-4f82-8a2d-b5314e12418a 2024-05-11T02:37:02.632729992Z [2024-05-11T02:37:02.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:37:02.632922845Z [2024-05-11T02:37:02.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:36:00+00:00, run_id=scheduled__2024-05-11T02:36:00+00:00, run_start_date=2024-05-11 02:37:00.971384+00:00, run_end_date=2024-05-11 02:37:02.632633+00:00, run_duration=1.661249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:36:00+00:00, data_interval_end=2024-05-11 02:37:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:37:02.642576611Z [2024-05-11T02:37:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:37:00+00:00, run_after=2024-05-11T02:38:00+00:00 2024-05-11T02:37:02.697773282Z [2024-05-11T02:37:02.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status success for try_number 1 2024-05-11T02:37:02.703249447Z [2024-05-11T02:37:02.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:36:00+00:00, map_index=-1, run_start_date=2024-05-11 02:37:01.809773+00:00, run_end_date=2024-05-11 02:37:02.242782+00:00, run_duration=0.433009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:37:01.057833+00:00, queued_by_job_id=2, pid=16097 2024-05-11T02:37:04.893072231Z [2024-05-11T02:37:04.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:37:04.894042197Z [2024-05-11T02:37:04.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:36:00+00:00, run_id=scheduled__2024-05-11T02:36:00+00:00, run_start_date=2024-05-11 02:37:00.974356+00:00, run_end_date=2024-05-11 02:37:04.893283+00:00, run_duration=3.918927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:36:00+00:00, data_interval_end=2024-05-11 02:37:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:37:04.911898427Z [2024-05-11T02:37:04.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:37:00+00:00, run_after=2024-05-11T02:38:00+00:00 2024-05-11T02:37:04.921769745Z [2024-05-11T02:37:04.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:37:04.923143290Z [2024-05-11T02:37:04.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:36:00+00:00, run_id=scheduled__2024-05-11T02:36:00+00:00, run_start_date=2024-05-11 02:37:00.976668+00:00, run_end_date=2024-05-11 02:37:04.921617+00:00, run_duration=3.944949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:36:00+00:00, data_interval_end=2024-05-11 02:37:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:37:04.933236616Z [2024-05-11T02:37:04.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:37:00+00:00, run_after=2024-05-11T02:38:00+00:00 2024-05-11T02:37:04.990482663Z [2024-05-11T02:37:04.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status success for try_number 1 2024-05-11T02:37:04.990529761Z [2024-05-11T02:37:04.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status success for try_number 1 2024-05-11T02:37:05.001149061Z [2024-05-11T02:37:05.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:36:00+00:00, map_index=-1, run_start_date=2024-05-11 02:37:02.867549+00:00, run_end_date=2024-05-11 02:37:04.543002+00:00, run_duration=1.675453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:37:01.057833+00:00, queued_by_job_id=2, pid=16115 2024-05-11T02:37:05.001472525Z [2024-05-11T02:37:05.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:36:00+00:00, map_index=-1, run_start_date=2024-05-11 02:37:03.005390+00:00, run_end_date=2024-05-11 02:37:04.336709+00:00, run_duration=1.331319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:37:01.057833+00:00, queued_by_job_id=2, pid=16116 2024-05-11T02:38:00.704272042Z [2024-05-11T02:38:00.703+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:38:00.723322832Z [2024-05-11T02:38:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:38:00+00:00, run_after=2024-05-11T02:39:00+00:00 2024-05-11T02:38:00.731610777Z [2024-05-11T02:38:00.731+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:38:00.744527040Z [2024-05-11T02:38:00.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:38:00+00:00, run_after=2024-05-11T02:39:00+00:00 2024-05-11T02:38:00.832891176Z [2024-05-11T02:38:00.832+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:38:00.832923521Z 2024-05-11T02:38:00.832929700Z 2024-05-11T02:38:00.832935354Z 2024-05-11T02:38:00.832940260Z 2024-05-11T02:38:00.833169881Z [2024-05-11T02:38:00.832+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:38:00.833469180Z [2024-05-11T02:38:00.833+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:38:00.833763307Z [2024-05-11T02:38:00.833+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:38:00.834012097Z [2024-05-11T02:38:00.833+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:38:00.834867164Z [2024-05-11T02:38:00.834+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:38:00.834883350Z 2024-05-11T02:38:00.834889091Z 2024-05-11T02:38:00.834894196Z 2024-05-11T02:38:00.834898970Z 2024-05-11T02:38:00.842032536Z [2024-05-11T02:38:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:38:00.842079897Z [2024-05-11T02:38:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:38:00.842091309Z [2024-05-11T02:38:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:38:00.842100632Z [2024-05-11T02:38:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:38:00.843523464Z [2024-05-11T02:38:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:38:00.843710192Z [2024-05-11T02:38:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:38:00.844166523Z [2024-05-11T02:38:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:38:00.844490278Z [2024-05-11T02:38:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:38:01.328167714Z [2024-05-11T02:38:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status queued for try_number 1 2024-05-11T02:38:01.329071415Z [2024-05-11T02:38:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:37:00+00:00 exited with status queued for try_number 1 2024-05-11T02:38:01.329364842Z [2024-05-11T02:38:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:37:00+00:00 exited with status queued for try_number 1 2024-05-11T02:38:01.329594113Z [2024-05-11T02:38:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:37:00+00:00 exited with status queued for try_number 1 2024-05-11T02:38:01.362776423Z [2024-05-11T02:38:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to f32fe370-e4af-4626-8c0b-56a569af6b75 2024-05-11T02:38:01.363172055Z [2024-05-11T02:38:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90439c26-9d89-433c-be10-fca029ecb1dc 2024-05-11T02:38:01.363410488Z [2024-05-11T02:38:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdea6675-9180-4ff8-b51d-6a7736e18882 2024-05-11T02:38:01.363574133Z [2024-05-11T02:38:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to e15e9415-1bac-4c6a-a6ab-cc8c8f745da5 2024-05-11T02:38:02.606750578Z [2024-05-11T02:38:02.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:38:02.606904110Z [2024-05-11T02:38:02.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:36:00+00:00, run_id=scheduled__2024-05-11T02:36:00+00:00, run_start_date=2024-05-11 02:38:00.756193+00:00, run_end_date=2024-05-11 02:38:02.606577+00:00, run_duration=1.850384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:36:00+00:00, data_interval_end=2024-05-11 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:38:02.614697670Z [2024-05-11T02:38:02.614+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:38:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:38:02.620967047Z [2024-05-11T02:38:02.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:38:02.621102378Z [2024-05-11T02:38:02.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:37:00+00:00, run_id=scheduled__2024-05-11T02:37:00+00:00, run_start_date=2024-05-11 02:38:00.757664+00:00, run_end_date=2024-05-11 02:38:02.620882+00:00, run_duration=1.863218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:37:00+00:00, data_interval_end=2024-05-11 02:38:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:38:02.630390190Z [2024-05-11T02:38:02.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:38:00+00:00, run_after=2024-05-11T02:39:00+00:00 2024-05-11T02:38:02.676375278Z [2024-05-11T02:38:02.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:36:00+00:00 exited with status success for try_number 1 2024-05-11T02:38:02.676415176Z [2024-05-11T02:38:02.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:37:00+00:00 exited with status success for try_number 1 2024-05-11T02:38:02.682461602Z [2024-05-11T02:38:02.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:36:00+00:00, map_index=-1, run_start_date=2024-05-11 02:38:01.669136+00:00, run_end_date=2024-05-11 02:38:02.065181+00:00, run_duration=0.396045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:38:00.836128+00:00, queued_by_job_id=2, pid=16149 2024-05-11T02:38:02.682571889Z [2024-05-11T02:38:02.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:37:00+00:00, map_index=-1, run_start_date=2024-05-11 02:38:01.880321+00:00, run_end_date=2024-05-11 02:38:02.260396+00:00, run_duration=0.380075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:38:00.836128+00:00, queued_by_job_id=2, pid=16150 2024-05-11T02:38:04.230319296Z [2024-05-11T02:38:04.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:38:04.231029230Z [2024-05-11T02:38:04.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:37:00+00:00, run_id=scheduled__2024-05-11T02:37:00+00:00, run_start_date=2024-05-11 02:38:00.758782+00:00, run_end_date=2024-05-11 02:38:04.230435+00:00, run_duration=3.471653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:37:00+00:00, data_interval_end=2024-05-11 02:38:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:38:04.242307328Z [2024-05-11T02:38:04.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:38:00+00:00, run_after=2024-05-11T02:39:00+00:00 2024-05-11T02:38:04.284620565Z [2024-05-11T02:38:04.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:37:00+00:00 exited with status success for try_number 1 2024-05-11T02:38:04.291066522Z [2024-05-11T02:38:04.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:37:00+00:00, map_index=-1, run_start_date=2024-05-11 02:38:02.842162+00:00, run_end_date=2024-05-11 02:38:04.075622+00:00, run_duration=1.23346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:38:00.836128+00:00, queued_by_job_id=2, pid=16173 2024-05-11T02:38:05.342113161Z [2024-05-11T02:38:05.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:38:05.343297748Z [2024-05-11T02:38:05.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:37:00+00:00, run_id=scheduled__2024-05-11T02:37:00+00:00, run_start_date=2024-05-11 02:38:00.759948+00:00, run_end_date=2024-05-11 02:38:05.342865+00:00, run_duration=4.582917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:37:00+00:00, data_interval_end=2024-05-11 02:38:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:38:05.353528470Z [2024-05-11T02:38:05.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:38:00+00:00, run_after=2024-05-11T02:39:00+00:00 2024-05-11T02:38:05.397651160Z [2024-05-11T02:38:05.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:37:00+00:00 exited with status success for try_number 1 2024-05-11T02:38:05.403275917Z [2024-05-11T02:38:05.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:37:00+00:00, map_index=-1, run_start_date=2024-05-11 02:38:02.867134+00:00, run_end_date=2024-05-11 02:38:04.533184+00:00, run_duration=1.66605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:38:00.836128+00:00, queued_by_job_id=2, pid=16174 2024-05-11T02:39:00.649000728Z [2024-05-11T02:39:00.648+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:39:00.666828357Z [2024-05-11T02:39:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:39:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:39:00.678848886Z [2024-05-11T02:39:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:39:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:39:00.787679525Z [2024-05-11T02:39:00.787+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:39:00.787707344Z 2024-05-11T02:39:00.787712543Z 2024-05-11T02:39:00.787717328Z 2024-05-11T02:39:00.787738200Z [2024-05-11T02:39:00.787+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:39:00.788085577Z [2024-05-11T02:39:00.787+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:39:00.788388774Z [2024-05-11T02:39:00.788+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:39:00.794054074Z [2024-05-11T02:39:00.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:39:00.794093695Z 2024-05-11T02:39:00.794100306Z 2024-05-11T02:39:00.794106059Z 2024-05-11T02:39:00.794112643Z [2024-05-11T02:39:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:39:00.794187100Z [2024-05-11T02:39:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:39:00.794315432Z [2024-05-11T02:39:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:39:00.794425524Z [2024-05-11T02:39:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:39:00.794612177Z [2024-05-11T02:39:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:39:00.794705602Z [2024-05-11T02:39:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:39:01.184142882Z [2024-05-11T02:39:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status queued for try_number 1 2024-05-11T02:39:01.184404524Z [2024-05-11T02:39:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status queued for try_number 1 2024-05-11T02:39:01.184599584Z [2024-05-11T02:39:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status queued for try_number 1 2024-05-11T02:39:01.197476402Z [2024-05-11T02:39:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 975a4072-6fb6-4122-85b8-5a9a3e5d61a0 2024-05-11T02:39:01.197755076Z [2024-05-11T02:39:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23784163-6efe-4838-a5c5-941f76d634da 2024-05-11T02:39:01.198027661Z [2024-05-11T02:39:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to abf0ffd3-3433-4dba-a7a9-54637e42c53d 2024-05-11T02:39:03.193295509Z [2024-05-11T02:39:03.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:39:03.193957130Z [2024-05-11T02:39:03.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:38:00+00:00, run_id=scheduled__2024-05-11T02:38:00+00:00, run_start_date=2024-05-11 02:39:00.693658+00:00, run_end_date=2024-05-11 02:39:03.193132+00:00, run_duration=2.499474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:38:00+00:00, data_interval_end=2024-05-11 02:39:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:39:03.212351953Z [2024-05-11T02:39:03.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:39:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:39:03.275444205Z [2024-05-11T02:39:03.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status success for try_number 1 2024-05-11T02:39:03.282294376Z [2024-05-11T02:39:03.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:38:00+00:00, map_index=-1, run_start_date=2024-05-11 02:39:01.615750+00:00, run_end_date=2024-05-11 02:39:02.100997+00:00, run_duration=0.485247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:39:00.791080+00:00, queued_by_job_id=2, pid=16206 2024-05-11T02:39:05.789850821Z [2024-05-11T02:39:05.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:39:05.790009853Z [2024-05-11T02:39:05.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:38:00+00:00, run_id=scheduled__2024-05-11T02:38:00+00:00, run_start_date=2024-05-11 02:39:00.698776+00:00, run_end_date=2024-05-11 02:39:05.789748+00:00, run_duration=5.090972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:38:00+00:00, data_interval_end=2024-05-11 02:39:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:39:05.799634686Z [2024-05-11T02:39:05.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:39:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:39:05.846283049Z [2024-05-11T02:39:05.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status success for try_number 1 2024-05-11T02:39:05.854112839Z [2024-05-11T02:39:05.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:38:00+00:00, map_index=-1, run_start_date=2024-05-11 02:39:02.636503+00:00, run_end_date=2024-05-11 02:39:05.227462+00:00, run_duration=2.590959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:39:00.791080+00:00, queued_by_job_id=2, pid=16224 2024-05-11T02:39:06.901338316Z [2024-05-11T02:39:06.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:39:06.901707954Z [2024-05-11T02:39:06.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:38:00+00:00, run_id=scheduled__2024-05-11T02:38:00+00:00, run_start_date=2024-05-11 02:39:00.696635+00:00, run_end_date=2024-05-11 02:39:06.901249+00:00, run_duration=6.204614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:38:00+00:00, data_interval_end=2024-05-11 02:39:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:39:06.913639591Z [2024-05-11T02:39:06.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:39:00+00:00, run_after=2024-05-11T02:40:00+00:00 2024-05-11T02:39:06.976521317Z [2024-05-11T02:39:06.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status success for try_number 1 2024-05-11T02:39:06.981447262Z [2024-05-11T02:39:06.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:38:00+00:00, map_index=-1, run_start_date=2024-05-11 02:39:02.704037+00:00, run_end_date=2024-05-11 02:39:06.089192+00:00, run_duration=3.385155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:39:00.791080+00:00, queued_by_job_id=2, pid=16225 2024-05-11T02:40:00.459362335Z [2024-05-11T02:40:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:41:00+00:00 2024-05-11T02:40:00.469564133Z [2024-05-11T02:40:00.469+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:40:00.484452755Z [2024-05-11T02:40:00.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:40:00.492930532Z [2024-05-11T02:40:00.490+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:40:00.501848553Z [2024-05-11T02:40:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:41:00+00:00 2024-05-11T02:40:00.617095737Z [2024-05-11T02:40:00.616+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T02:40:00.617129264Z 2024-05-11T02:40:00.617135977Z 2024-05-11T02:40:00.617163434Z 2024-05-11T02:40:00.617170097Z 2024-05-11T02:40:00.617176024Z 2024-05-11T02:40:00.617525447Z [2024-05-11T02:40:00.617+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:40:00.617808016Z [2024-05-11T02:40:00.617+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:40:00.618222129Z [2024-05-11T02:40:00.617+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:40:00.618612089Z [2024-05-11T02:40:00.618+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:40:00.618910857Z [2024-05-11T02:40:00.618+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:40:00.619858846Z [2024-05-11T02:40:00.619+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:40:00.619873969Z 2024-05-11T02:40:00.619879035Z 2024-05-11T02:40:00.619883534Z 2024-05-11T02:40:00.619887890Z 2024-05-11T02:40:00.619892191Z 2024-05-11T02:40:00.625567250Z [2024-05-11T02:40:00.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:40:00.626065484Z [2024-05-11T02:40:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:40:00.626673901Z [2024-05-11T02:40:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:40:00.627020977Z [2024-05-11T02:40:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:40:00.627445472Z [2024-05-11T02:40:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:40:00.627731441Z [2024-05-11T02:40:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:40:00.628173730Z [2024-05-11T02:40:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:40:00.628489980Z [2024-05-11T02:40:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:40:00.628855315Z [2024-05-11T02:40:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:40:00.629082967Z [2024-05-11T02:40:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:40:01.181143679Z [2024-05-11T02:40:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:01.181265691Z [2024-05-11T02:40:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:01.181407496Z [2024-05-11T02:40:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:39:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:01.181556387Z [2024-05-11T02:40:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:39:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:01.181678392Z [2024-05-11T02:40:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:39:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:01.205652964Z [2024-05-11T02:40:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to c52481c7-ce01-481c-8759-8a8ea0c597c2 2024-05-11T02:40:01.205840766Z [2024-05-11T02:40:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 497543dc-e6a6-4e94-bf44-ea895b1e30cd 2024-05-11T02:40:01.206000436Z [2024-05-11T02:40:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8087892d-c459-4cae-bc1f-520e39806782 2024-05-11T02:40:01.206138776Z [2024-05-11T02:40:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d20b3f5-01d6-4172-ac50-b88903eec265 2024-05-11T02:40:01.206246793Z [2024-05-11T02:40:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa9b40c1-7585-45aa-9c6c-02d4f6be04da 2024-05-11T02:40:02.439698168Z [2024-05-11T02:40:02.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:40:02.440290928Z [2024-05-11T02:40:02.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:38:00+00:00, run_id=scheduled__2024-05-11T02:38:00+00:00, run_start_date=2024-05-11 02:40:00.514926+00:00, run_end_date=2024-05-11 02:40:02.439919+00:00, run_duration=1.924993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:38:00+00:00, data_interval_end=2024-05-11 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:40:02.448118383Z [2024-05-11T02:40:02.447+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:42:00+00:00 2024-05-11T02:40:02.455461062Z [2024-05-11T02:40:02.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:40:02.455915328Z [2024-05-11T02:40:02.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:39:00+00:00, run_id=scheduled__2024-05-11T02:39:00+00:00, run_start_date=2024-05-11 02:40:00.516490+00:00, run_end_date=2024-05-11 02:40:02.455596+00:00, run_duration=1.939106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:39:00+00:00, data_interval_end=2024-05-11 02:40:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:40:02.466108293Z [2024-05-11T02:40:02.465+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:41:00+00:00 2024-05-11T02:40:02.520162873Z [2024-05-11T02:40:02.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:38:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:02.520185599Z [2024-05-11T02:40:02.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:39:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:02.526855670Z [2024-05-11T02:40:02.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:39:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:01.610256+00:00, run_end_date=2024-05-11 02:40:01.999267+00:00, run_duration=0.389011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:00.621339+00:00, queued_by_job_id=2, pid=16259 2024-05-11T02:40:02.526931361Z [2024-05-11T02:40:02.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:38:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:01.690012+00:00, run_end_date=2024-05-11 02:40:02.150591+00:00, run_duration=0.460579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:00.621339+00:00, queued_by_job_id=2, pid=16260 2024-05-11T02:40:03.651292568Z [2024-05-11T02:40:03.650+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:40:03.651321577Z 2024-05-11T02:40:03.651448801Z [2024-05-11T02:40:03.651+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:40:03.652820452Z [2024-05-11T02:40:03.652+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:40:03.652836543Z 2024-05-11T02:40:03.657647526Z [2024-05-11T02:40:03.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:40:03.657917150Z [2024-05-11T02:40:03.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:40:03.715637309Z [2024-05-11T02:40:03.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:03.715945967Z [2024-05-11T02:40:03.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:03.722329165Z [2024-05-11T02:40:03.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15de0cc5-bf42-4169-b682-8a7600e0424f 2024-05-11T02:40:03.722615682Z [2024-05-11T02:40:03.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:03.019566+00:00, run_end_date=2024-05-11 02:40:03.412755+00:00, run_duration=0.393189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:00.621339+00:00, queued_by_job_id=2, pid=16291 2024-05-11T02:40:04.455930510Z [2024-05-11T02:40:04.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:40:04.457165108Z [2024-05-11T02:40:04.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:39:00+00:00, run_id=scheduled__2024-05-11T02:39:00+00:00, run_start_date=2024-05-11 02:40:00.518028+00:00, run_end_date=2024-05-11 02:40:04.455453+00:00, run_duration=3.937425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:39:00+00:00, data_interval_end=2024-05-11 02:40:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:40:04.470484670Z [2024-05-11T02:40:04.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:41:00+00:00 2024-05-11T02:40:04.547000664Z [2024-05-11T02:40:04.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:39:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:04.554205688Z [2024-05-11T02:40:04.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:39:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:02.906264+00:00, run_end_date=2024-05-11 02:40:04.246222+00:00, run_duration=1.339958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:00.621339+00:00, queued_by_job_id=2, pid=16289 2024-05-11T02:40:05.624934536Z [2024-05-11T02:40:05.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:40:05.625584055Z [2024-05-11T02:40:05.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:39:00+00:00, run_id=scheduled__2024-05-11T02:39:00+00:00, run_start_date=2024-05-11 02:40:00.519213+00:00, run_end_date=2024-05-11 02:40:05.625110+00:00, run_duration=5.105897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:39:00+00:00, data_interval_end=2024-05-11 02:40:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:40:05.641721547Z [2024-05-11T02:40:05.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:41:00+00:00 2024-05-11T02:40:05.708418791Z [2024-05-11T02:40:05.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:39:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:05.714597121Z [2024-05-11T02:40:05.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:39:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:02.999615+00:00, run_end_date=2024-05-11 02:40:04.742781+00:00, run_duration=1.743166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:00.621339+00:00, queued_by_job_id=2, pid=16290 2024-05-11T02:40:06.819733794Z [2024-05-11T02:40:06.819+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:40:06.819758794Z 2024-05-11T02:40:06.819991404Z [2024-05-11T02:40:06.819+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:40:06.827399038Z [2024-05-11T02:40:06.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:40:06.827415772Z 2024-05-11T02:40:06.827419603Z [2024-05-11T02:40:06.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:40:06.827423057Z [2024-05-11T02:40:06.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:40:06.886330322Z [2024-05-11T02:40:06.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:06.886656636Z [2024-05-11T02:40:06.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:06.895506496Z [2024-05-11T02:40:06.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d0e6ce3-0af0-4da7-993a-b4f95eb25239 2024-05-11T02:40:06.895739931Z [2024-05-11T02:40:06.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:05.372156+00:00, run_end_date=2024-05-11 02:40:05.753264+00:00, run_duration=0.381108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:03.653627+00:00, queued_by_job_id=2, pid=16325 2024-05-11T02:40:09.184273613Z [2024-05-11T02:40:09.183+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:40:09.184308604Z 2024-05-11T02:40:09.184858607Z [2024-05-11T02:40:09.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:40:09.185808248Z [2024-05-11T02:40:09.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:40:09.185834508Z 2024-05-11T02:40:09.188875453Z [2024-05-11T02:40:09.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:40:09.189032885Z [2024-05-11T02:40:09.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:40:09.256610492Z [2024-05-11T02:40:09.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status queued for try_number 1 2024-05-11T02:40:09.256854182Z [2024-05-11T02:40:09.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:09.265804806Z [2024-05-11T02:40:09.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to 334eca45-fb97-4e95-a422-3cbac69e74d1 2024-05-11T02:40:09.266432445Z [2024-05-11T02:40:09.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=0, run_start_date=2024-05-11 02:40:08.541115+00:00, run_end_date=2024-05-11 02:40:08.924893+00:00, run_duration=0.383778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:06.820718+00:00, queued_by_job_id=2, pid=16336 2024-05-11T02:40:11.839842443Z [2024-05-11T02:40:11.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:40:11.841673758Z [2024-05-11T02:40:11.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:35:00+00:00, run_id=scheduled__2024-05-11T02:35:00+00:00, run_start_date=2024-05-11 02:40:00.513177+00:00, run_end_date=2024-05-11 02:40:11.840802+00:00, run_duration=11.327625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:35:00+00:00, data_interval_end=2024-05-11 02:40:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:40:11.855755718Z [2024-05-11T02:40:11.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:40:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:40:11.898815340Z [2024-05-11T02:40:11.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:35:00+00:00 exited with status success for try_number 1 2024-05-11T02:40:11.910133007Z [2024-05-11T02:40:11.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:35:00+00:00, map_index=-1, run_start_date=2024-05-11 02:40:10.726407+00:00, run_end_date=2024-05-11 02:40:11.163055+00:00, run_duration=0.436648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:40:09.186194+00:00, queued_by_job_id=2, pid=16344 2024-05-11T02:40:36.637714878Z [2024-05-11T02:40:36.637+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:41:00.458878731Z [2024-05-11T02:41:00.458+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:41:00.481066451Z [2024-05-11T02:41:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:41:00+00:00, run_after=2024-05-11T02:42:00+00:00 2024-05-11T02:41:00.497504554Z [2024-05-11T02:41:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:41:00+00:00, run_after=2024-05-11T02:42:00+00:00 2024-05-11T02:41:00.580276468Z [2024-05-11T02:41:00.579+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:41:00.580321409Z 2024-05-11T02:41:00.580333329Z 2024-05-11T02:41:00.580344035Z 2024-05-11T02:41:00.580372660Z [2024-05-11T02:41:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:41:00.580579125Z [2024-05-11T02:41:00.580+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:41:00.580628148Z [2024-05-11T02:41:00.580+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:41:00.581439193Z [2024-05-11T02:41:00.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:41:00.581458626Z 2024-05-11T02:41:00.581466170Z 2024-05-11T02:41:00.581473151Z 2024-05-11T02:41:00.585668262Z [2024-05-11T02:41:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:41:00.585704955Z [2024-05-11T02:41:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:41:00.586072742Z [2024-05-11T02:41:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:41:00.586207065Z [2024-05-11T02:41:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:41:00.586451859Z [2024-05-11T02:41:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:41:00.586588198Z [2024-05-11T02:41:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:41:00.814646335Z [2024-05-11T02:41:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:41:00.814761628Z [2024-05-11T02:41:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:41:00.814916989Z [2024-05-11T02:41:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:41:00.822817491Z [2024-05-11T02:41:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to e74d7bcd-c4be-4307-9f9f-02c1285379db 2024-05-11T02:41:00.823702806Z [2024-05-11T02:41:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72ad4b09-49fe-42f3-bc0c-d3a20c93a118 2024-05-11T02:41:00.824008377Z [2024-05-11T02:41:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to b51210d8-0dc8-4279-8018-ad36aebe1c9e 2024-05-11T02:41:01.979433158Z [2024-05-11T02:41:01.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:41:01.979735870Z [2024-05-11T02:41:01.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:40:00+00:00, run_id=scheduled__2024-05-11T02:40:00+00:00, run_start_date=2024-05-11 02:41:00.511124+00:00, run_end_date=2024-05-11 02:41:01.979424+00:00, run_duration=1.4683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:40:00+00:00, data_interval_end=2024-05-11 02:41:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:41:01.993521475Z [2024-05-11T02:41:01.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:41:00+00:00, run_after=2024-05-11T02:42:00+00:00 2024-05-11T02:41:02.049227186Z [2024-05-11T02:41:02.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:41:02.059166303Z [2024-05-11T02:41:02.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:41:01.432809+00:00, run_end_date=2024-05-11 02:41:01.868920+00:00, run_duration=0.436111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:41:00.582342+00:00, queued_by_job_id=2, pid=16353 2024-05-11T02:41:04.530046264Z [2024-05-11T02:41:04.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:41:04.530466860Z [2024-05-11T02:41:04.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:40:00+00:00, run_id=scheduled__2024-05-11T02:40:00+00:00, run_start_date=2024-05-11 02:41:00.512392+00:00, run_end_date=2024-05-11 02:41:04.529855+00:00, run_duration=4.017463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:40:00+00:00, data_interval_end=2024-05-11 02:41:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:41:04.542526034Z [2024-05-11T02:41:04.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:41:00+00:00, run_after=2024-05-11T02:42:00+00:00 2024-05-11T02:41:04.602382185Z [2024-05-11T02:41:04.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:41:04.610490556Z [2024-05-11T02:41:04.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:41:02.471752+00:00, run_end_date=2024-05-11 02:41:04.344781+00:00, run_duration=1.873029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:41:00.582342+00:00, queued_by_job_id=2, pid=16366 2024-05-11T02:41:05.685646328Z [2024-05-11T02:41:05.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:41:05.686107804Z [2024-05-11T02:41:05.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:40:00+00:00, run_id=scheduled__2024-05-11T02:40:00+00:00, run_start_date=2024-05-11 02:41:00.513545+00:00, run_end_date=2024-05-11 02:41:05.685728+00:00, run_duration=5.172183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:40:00+00:00, data_interval_end=2024-05-11 02:41:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:41:05.696897098Z [2024-05-11T02:41:05.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:41:00+00:00, run_after=2024-05-11T02:42:00+00:00 2024-05-11T02:41:05.728426495Z [2024-05-11T02:41:05.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:41:05.733365531Z [2024-05-11T02:41:05.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:41:02.715605+00:00, run_end_date=2024-05-11 02:41:05.121597+00:00, run_duration=2.405992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:41:00.582342+00:00, queued_by_job_id=2, pid=16372 2024-05-11T02:42:00.922525613Z [2024-05-11T02:42:00.921+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:42:00.933154063Z [2024-05-11T02:42:00.932+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:42:00.949836633Z [2024-05-11T02:42:00.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:42:00+00:00, run_after=2024-05-11T02:43:00+00:00 2024-05-11T02:42:00.976314482Z [2024-05-11T02:42:00.974+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:42:00+00:00, run_after=2024-05-11T02:43:00+00:00 2024-05-11T02:42:01.156946242Z [2024-05-11T02:42:01.156+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:42:01.156975007Z 2024-05-11T02:42:01.156981544Z 2024-05-11T02:42:01.156986424Z 2024-05-11T02:42:01.156991405Z 2024-05-11T02:42:01.157313002Z [2024-05-11T02:42:01.157+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:42:01.157648649Z [2024-05-11T02:42:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:42:01.158018021Z [2024-05-11T02:42:01.157+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:42:01.158397253Z [2024-05-11T02:42:01.158+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:42:01.159632648Z [2024-05-11T02:42:01.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:42:01.159646475Z 2024-05-11T02:42:01.159651783Z 2024-05-11T02:42:01.159656341Z 2024-05-11T02:42:01.159660747Z 2024-05-11T02:42:01.171435089Z [2024-05-11T02:42:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:42:01.172044134Z [2024-05-11T02:42:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:42:01.173133474Z [2024-05-11T02:42:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:42:01.173832172Z [2024-05-11T02:42:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:42:01.175049303Z [2024-05-11T02:42:01.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:42:01.175581845Z [2024-05-11T02:42:01.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:42:01.176560801Z [2024-05-11T02:42:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:42:01.177272655Z [2024-05-11T02:42:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:42:01.515276824Z [2024-05-11T02:42:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:42:01.517374310Z [2024-05-11T02:42:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:41:00+00:00 exited with status queued for try_number 1 2024-05-11T02:42:01.517463587Z [2024-05-11T02:42:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:41:00+00:00 exited with status queued for try_number 1 2024-05-11T02:42:01.517600325Z [2024-05-11T02:42:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:41:00+00:00 exited with status queued for try_number 1 2024-05-11T02:42:01.532343664Z [2024-05-11T02:42:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed4ba6b2-a551-44cb-bb36-914b24cabc56 2024-05-11T02:42:01.539641826Z [2024-05-11T02:42:01.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to a779d310-c9f0-433e-b2ce-881a38d9b1c8 2024-05-11T02:42:01.540868246Z [2024-05-11T02:42:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to d72eef1f-ba70-49ec-a11f-70c4101645e9 2024-05-11T02:42:01.541330758Z [2024-05-11T02:42:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9f1f6bd-edf4-439f-b224-92fbb77027d2 2024-05-11T02:42:02.900888045Z [2024-05-11T02:42:02.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:42:02.901307952Z [2024-05-11T02:42:02.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:40:00+00:00, run_id=scheduled__2024-05-11T02:40:00+00:00, run_start_date=2024-05-11 02:42:00.989269+00:00, run_end_date=2024-05-11 02:42:02.900804+00:00, run_duration=1.911535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:40:00+00:00, data_interval_end=2024-05-11 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:42:02.910994659Z [2024-05-11T02:42:02.910+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:42:00+00:00, run_after=2024-05-11T02:44:00+00:00 2024-05-11T02:42:02.917743089Z [2024-05-11T02:42:02.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:42:02.918239539Z [2024-05-11T02:42:02.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:41:00+00:00, run_id=scheduled__2024-05-11T02:41:00+00:00, run_start_date=2024-05-11 02:42:00.990835+00:00, run_end_date=2024-05-11 02:42:02.917659+00:00, run_duration=1.926824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:41:00+00:00, data_interval_end=2024-05-11 02:42:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:42:02.928859484Z [2024-05-11T02:42:02.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:42:00+00:00, run_after=2024-05-11T02:43:00+00:00 2024-05-11T02:42:02.978722276Z [2024-05-11T02:42:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:42:02.978828667Z [2024-05-11T02:42:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:41:00+00:00 exited with status success for try_number 1 2024-05-11T02:42:02.991368469Z [2024-05-11T02:42:02.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:41:00+00:00, map_index=-1, run_start_date=2024-05-11 02:42:02.342230+00:00, run_end_date=2024-05-11 02:42:02.770134+00:00, run_duration=0.427904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:42:01.166574+00:00, queued_by_job_id=2, pid=16407 2024-05-11T02:42:02.991554472Z [2024-05-11T02:42:02.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:42:02.153023+00:00, run_end_date=2024-05-11 02:42:02.627096+00:00, run_duration=0.474073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:42:01.166574+00:00, queued_by_job_id=2, pid=16406 2024-05-11T02:42:06.172615201Z [2024-05-11T02:42:06.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:42:06.173000387Z [2024-05-11T02:42:06.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:41:00+00:00, run_id=scheduled__2024-05-11T02:41:00+00:00, run_start_date=2024-05-11 02:42:00.992113+00:00, run_end_date=2024-05-11 02:42:06.172467+00:00, run_duration=5.180354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:41:00+00:00, data_interval_end=2024-05-11 02:42:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:42:06.182944384Z [2024-05-11T02:42:06.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:42:00+00:00, run_after=2024-05-11T02:43:00+00:00 2024-05-11T02:42:06.190411710Z [2024-05-11T02:42:06.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:42:06.190689853Z [2024-05-11T02:42:06.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:41:00+00:00, run_id=scheduled__2024-05-11T02:41:00+00:00, run_start_date=2024-05-11 02:42:00.993250+00:00, run_end_date=2024-05-11 02:42:06.190235+00:00, run_duration=5.196985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:41:00+00:00, data_interval_end=2024-05-11 02:42:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:42:06.199830797Z [2024-05-11T02:42:06.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:42:00+00:00, run_after=2024-05-11T02:43:00+00:00 2024-05-11T02:42:06.234394403Z [2024-05-11T02:42:06.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:41:00+00:00 exited with status success for try_number 1 2024-05-11T02:42:06.234919098Z [2024-05-11T02:42:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:41:00+00:00 exited with status success for try_number 1 2024-05-11T02:42:06.249323322Z [2024-05-11T02:42:06.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:41:00+00:00, map_index=-1, run_start_date=2024-05-11 02:42:03.668580+00:00, run_end_date=2024-05-11 02:42:05.983101+00:00, run_duration=2.314521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:42:01.166574+00:00, queued_by_job_id=2, pid=16436 2024-05-11T02:42:06.250335141Z [2024-05-11T02:42:06.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:41:00+00:00, map_index=-1, run_start_date=2024-05-11 02:42:03.298369+00:00, run_end_date=2024-05-11 02:42:05.476985+00:00, run_duration=2.178616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:42:01.166574+00:00, queued_by_job_id=2, pid=16425 2024-05-11T02:43:00.926647796Z [2024-05-11T02:43:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:43:00+00:00, run_after=2024-05-11T02:44:00+00:00 2024-05-11T02:43:00.933828767Z [2024-05-11T02:43:00.933+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:43:00.945580888Z [2024-05-11T02:43:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:43:00+00:00, run_after=2024-05-11T02:44:00+00:00 2024-05-11T02:43:01.017053008Z [2024-05-11T02:43:01.016+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:43:01.017089582Z 2024-05-11T02:43:01.017109696Z 2024-05-11T02:43:01.017115320Z 2024-05-11T02:43:01.017171196Z [2024-05-11T02:43:01.017+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:43:01.017262627Z [2024-05-11T02:43:01.017+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:43:01.017372231Z [2024-05-11T02:43:01.017+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:43:01.018084138Z [2024-05-11T02:43:01.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:43:01.018097947Z 2024-05-11T02:43:01.018102415Z 2024-05-11T02:43:01.018106503Z 2024-05-11T02:43:01.022023836Z [2024-05-11T02:43:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:43:01.022086138Z [2024-05-11T02:43:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:43:01.022338335Z [2024-05-11T02:43:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:43:01.022443330Z [2024-05-11T02:43:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:43:01.023356057Z [2024-05-11T02:43:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:43:01.023366694Z [2024-05-11T02:43:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:43:01.319320434Z [2024-05-11T02:43:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status queued for try_number 1 2024-05-11T02:43:01.319426603Z [2024-05-11T02:43:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status queued for try_number 1 2024-05-11T02:43:01.319466126Z [2024-05-11T02:43:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status queued for try_number 1 2024-05-11T02:43:01.327510221Z [2024-05-11T02:43:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed3bc492-0cdd-46e0-a2fc-df11a6d7f9a5 2024-05-11T02:43:01.327595256Z [2024-05-11T02:43:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e99e667-7500-45b7-bf00-6c67bca09130 2024-05-11T02:43:01.327691675Z [2024-05-11T02:43:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb14b4f8-31fd-4ef8-8198-96d02f18008b 2024-05-11T02:43:02.494643178Z [2024-05-11T02:43:02.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:43:02.495255895Z [2024-05-11T02:43:02.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:42:00+00:00, run_id=scheduled__2024-05-11T02:42:00+00:00, run_start_date=2024-05-11 02:43:00.957305+00:00, run_end_date=2024-05-11 02:43:02.494886+00:00, run_duration=1.537581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:42:00+00:00, data_interval_end=2024-05-11 02:43:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:43:02.505916942Z [2024-05-11T02:43:02.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:43:00+00:00, run_after=2024-05-11T02:44:00+00:00 2024-05-11T02:43:02.574578150Z [2024-05-11T02:43:02.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status success for try_number 1 2024-05-11T02:43:02.584923784Z [2024-05-11T02:43:02.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:42:00+00:00, map_index=-1, run_start_date=2024-05-11 02:43:01.815906+00:00, run_end_date=2024-05-11 02:43:02.186946+00:00, run_duration=0.37104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:43:01.018886+00:00, queued_by_job_id=2, pid=16463 2024-05-11T02:43:04.471455740Z [2024-05-11T02:43:04.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:43:04.471759654Z [2024-05-11T02:43:04.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:42:00+00:00, run_id=scheduled__2024-05-11T02:42:00+00:00, run_start_date=2024-05-11 02:43:00.959618+00:00, run_end_date=2024-05-11 02:43:04.471429+00:00, run_duration=3.511811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:42:00+00:00, data_interval_end=2024-05-11 02:43:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:43:04.481121621Z [2024-05-11T02:43:04.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:43:00+00:00, run_after=2024-05-11T02:44:00+00:00 2024-05-11T02:43:04.536782934Z [2024-05-11T02:43:04.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status success for try_number 1 2024-05-11T02:43:04.543773232Z [2024-05-11T02:43:04.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:42:00+00:00, map_index=-1, run_start_date=2024-05-11 02:43:02.874214+00:00, run_end_date=2024-05-11 02:43:04.128458+00:00, run_duration=1.254244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:43:01.018886+00:00, queued_by_job_id=2, pid=16481 2024-05-11T02:43:06.654760854Z [2024-05-11T02:43:06.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:43:06.655107751Z [2024-05-11T02:43:06.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:42:00+00:00, run_id=scheduled__2024-05-11T02:42:00+00:00, run_start_date=2024-05-11 02:43:00.961573+00:00, run_end_date=2024-05-11 02:43:06.654618+00:00, run_duration=5.693045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:42:00+00:00, data_interval_end=2024-05-11 02:43:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:43:06.667975443Z [2024-05-11T02:43:06.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:43:00+00:00, run_after=2024-05-11T02:44:00+00:00 2024-05-11T02:43:06.697802584Z [2024-05-11T02:43:06.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status success for try_number 1 2024-05-11T02:43:06.704506739Z [2024-05-11T02:43:06.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:42:00+00:00, map_index=-1, run_start_date=2024-05-11 02:43:02.882603+00:00, run_end_date=2024-05-11 02:43:05.835749+00:00, run_duration=2.953146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:43:01.018886+00:00, queued_by_job_id=2, pid=16482 2024-05-11T02:44:00.857976020Z [2024-05-11T02:44:00.857+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:44:00.882045955Z [2024-05-11T02:44:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:44:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:44:00.893047363Z [2024-05-11T02:44:00.892+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:44:00.909124719Z [2024-05-11T02:44:00.908+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:44:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:44:01.034023722Z [2024-05-11T02:44:01.032+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:44:01.034048028Z 2024-05-11T02:44:01.034052310Z 2024-05-11T02:44:01.034055775Z 2024-05-11T02:44:01.034059070Z 2024-05-11T02:44:01.034110232Z [2024-05-11T02:44:01.032+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:44:01.034115470Z [2024-05-11T02:44:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:44:01.034118876Z [2024-05-11T02:44:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:44:01.034125406Z [2024-05-11T02:44:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:44:01.034128937Z [2024-05-11T02:44:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:44:01.034132310Z 2024-05-11T02:44:01.034135528Z 2024-05-11T02:44:01.034138896Z 2024-05-11T02:44:01.034142161Z 2024-05-11T02:44:01.037950365Z [2024-05-11T02:44:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:44:01.037979418Z [2024-05-11T02:44:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:44:01.037984297Z [2024-05-11T02:44:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:44:01.037988166Z [2024-05-11T02:44:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:44:01.038003187Z [2024-05-11T02:44:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:44:01.038279401Z [2024-05-11T02:44:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:44:01.050104566Z [2024-05-11T02:44:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:44:01.050124938Z [2024-05-11T02:44:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:44:01.399152458Z [2024-05-11T02:44:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status queued for try_number 1 2024-05-11T02:44:01.400322349Z [2024-05-11T02:44:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:43:00+00:00 exited with status queued for try_number 1 2024-05-11T02:44:01.400491219Z [2024-05-11T02:44:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:43:00+00:00 exited with status queued for try_number 1 2024-05-11T02:44:01.400636123Z [2024-05-11T02:44:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:43:00+00:00 exited with status queued for try_number 1 2024-05-11T02:44:01.412682904Z [2024-05-11T02:44:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50598136-5d8d-44a6-b4d5-9ad19a685313 2024-05-11T02:44:01.413021794Z [2024-05-11T02:44:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac39e1f1-0ebb-408f-b07b-080ef03954a7 2024-05-11T02:44:01.413311803Z [2024-05-11T02:44:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2df8bd5b-911d-4b72-9a69-9d9c2a2917e4 2024-05-11T02:44:01.413544892Z [2024-05-11T02:44:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 544f418b-c7b7-48c8-9073-5661902e8c79 2024-05-11T02:44:02.586126945Z [2024-05-11T02:44:02.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:44:02.586517836Z [2024-05-11T02:44:02.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:42:00+00:00, run_id=scheduled__2024-05-11T02:42:00+00:00, run_start_date=2024-05-11 02:44:00.924123+00:00, run_end_date=2024-05-11 02:44:02.585812+00:00, run_duration=1.661689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:42:00+00:00, data_interval_end=2024-05-11 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:44:02.599302482Z [2024-05-11T02:44:02.598+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:44:00+00:00, run_after=2024-05-11T02:46:00+00:00 2024-05-11T02:44:02.607906020Z [2024-05-11T02:44:02.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:44:02.608607873Z [2024-05-11T02:44:02.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:43:00+00:00, run_id=scheduled__2024-05-11T02:43:00+00:00, run_start_date=2024-05-11 02:44:00.925540+00:00, run_end_date=2024-05-11 02:44:02.607657+00:00, run_duration=1.682117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:43:00+00:00, data_interval_end=2024-05-11 02:44:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:44:02.623216360Z [2024-05-11T02:44:02.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:44:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:44:02.676099795Z [2024-05-11T02:44:02.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:42:00+00:00 exited with status success for try_number 1 2024-05-11T02:44:02.676153811Z [2024-05-11T02:44:02.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:43:00+00:00 exited with status success for try_number 1 2024-05-11T02:44:02.687647119Z [2024-05-11T02:44:02.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:42:00+00:00, map_index=-1, run_start_date=2024-05-11 02:44:01.916627+00:00, run_end_date=2024-05-11 02:44:02.263532+00:00, run_duration=0.346905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:44:01.034529+00:00, queued_by_job_id=2, pid=16516 2024-05-11T02:44:02.687944301Z [2024-05-11T02:44:02.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:43:00+00:00, map_index=-1, run_start_date=2024-05-11 02:44:01.892001+00:00, run_end_date=2024-05-11 02:44:02.308111+00:00, run_duration=0.41611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:44:01.034529+00:00, queued_by_job_id=2, pid=16515 2024-05-11T02:44:05.985377695Z [2024-05-11T02:44:05.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:44:05.987712836Z [2024-05-11T02:44:05.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:43:00+00:00, run_id=scheduled__2024-05-11T02:43:00+00:00, run_start_date=2024-05-11 02:44:00.926844+00:00, run_end_date=2024-05-11 02:44:05.985472+00:00, run_duration=5.058628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:43:00+00:00, data_interval_end=2024-05-11 02:44:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:44:06.011876476Z [2024-05-11T02:44:06.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:44:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:44:06.026291557Z [2024-05-11T02:44:06.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:44:06.027559413Z [2024-05-11T02:44:06.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:43:00+00:00, run_id=scheduled__2024-05-11T02:43:00+00:00, run_start_date=2024-05-11 02:44:00.928035+00:00, run_end_date=2024-05-11 02:44:06.026493+00:00, run_duration=5.098458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:43:00+00:00, data_interval_end=2024-05-11 02:44:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:44:06.048445468Z [2024-05-11T02:44:06.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:44:00+00:00, run_after=2024-05-11T02:45:00+00:00 2024-05-11T02:44:06.099453461Z [2024-05-11T02:44:06.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:43:00+00:00 exited with status success for try_number 1 2024-05-11T02:44:06.099482143Z [2024-05-11T02:44:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:43:00+00:00 exited with status success for try_number 1 2024-05-11T02:44:06.108582230Z [2024-05-11T02:44:06.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:43:00+00:00, map_index=-1, run_start_date=2024-05-11 02:44:03.170772+00:00, run_end_date=2024-05-11 02:44:05.353889+00:00, run_duration=2.183117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:44:01.034529+00:00, queued_by_job_id=2, pid=16540 2024-05-11T02:44:06.108852116Z [2024-05-11T02:44:06.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:43:00+00:00, map_index=-1, run_start_date=2024-05-11 02:44:03.019056+00:00, run_end_date=2024-05-11 02:44:05.443908+00:00, run_duration=2.424852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:44:01.034529+00:00, queued_by_job_id=2, pid=16539 2024-05-11T02:45:00.856337630Z [2024-05-11T02:45:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:46:00+00:00 2024-05-11T02:45:00.864728018Z [2024-05-11T02:45:00.864+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:45:00.878830889Z [2024-05-11T02:45:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:45:00.892530635Z [2024-05-11T02:45:00.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:46:00+00:00 2024-05-11T02:45:00.993544555Z [2024-05-11T02:45:00.993+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:45:00.993576821Z 2024-05-11T02:45:00.993582453Z 2024-05-11T02:45:00.993587062Z 2024-05-11T02:45:00.993591834Z 2024-05-11T02:45:00.993643610Z [2024-05-11T02:45:00.993+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:45:00.993649273Z [2024-05-11T02:45:00.993+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:45:00.993778822Z [2024-05-11T02:45:00.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:45:00.993837006Z [2024-05-11T02:45:00.993+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:45:00.994669231Z [2024-05-11T02:45:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:45:00.994709247Z 2024-05-11T02:45:00.994721493Z 2024-05-11T02:45:00.994730958Z 2024-05-11T02:45:00.994740109Z 2024-05-11T02:45:00.999487760Z [2024-05-11T02:45:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:45:00.999771024Z [2024-05-11T02:45:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:45:01.000297579Z [2024-05-11T02:45:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:45:01.000671093Z [2024-05-11T02:45:01.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:45:01.001022505Z [2024-05-11T02:45:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:45:01.001182522Z [2024-05-11T02:45:01.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:45:01.001505564Z [2024-05-11T02:45:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:45:01.001620411Z [2024-05-11T02:45:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:45:01.381600835Z [2024-05-11T02:45:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:01.381632677Z [2024-05-11T02:45:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:01.381664119Z [2024-05-11T02:45:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:01.381753869Z [2024-05-11T02:45:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:01.398454814Z [2024-05-11T02:45:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79e25702-50e8-460c-a5ad-039adc84233e 2024-05-11T02:45:01.398492629Z [2024-05-11T02:45:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8def8b94-aa71-4844-9752-9dc2dc710e6f 2024-05-11T02:45:01.398635245Z [2024-05-11T02:45:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49b0b232-38ea-4b2b-91a5-468f0ec66e4a 2024-05-11T02:45:01.398733207Z [2024-05-11T02:45:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3346b8c-61e3-4a3c-a11a-a2b75af70e7e 2024-05-11T02:45:02.617001642Z [2024-05-11T02:45:02.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:45:02.617381404Z [2024-05-11T02:45:02.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:44:00+00:00, run_id=scheduled__2024-05-11T02:44:00+00:00, run_start_date=2024-05-11 02:45:00.908570+00:00, run_end_date=2024-05-11 02:45:02.616938+00:00, run_duration=1.708368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:44:00+00:00, data_interval_end=2024-05-11 02:45:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:45:02.633574117Z [2024-05-11T02:45:02.633+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:46:00+00:00 2024-05-11T02:45:02.693607823Z [2024-05-11T02:45:02.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:02.702876490Z [2024-05-11T02:45:02.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:44:00+00:00, map_index=-1, run_start_date=2024-05-11 02:45:01.922209+00:00, run_end_date=2024-05-11 02:45:02.268389+00:00, run_duration=0.34618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:00.995793+00:00, queued_by_job_id=2, pid=16573 2024-05-11T02:45:03.817554328Z [2024-05-11T02:45:03.817+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:45:03.817615666Z 2024-05-11T02:45:03.817900132Z [2024-05-11T02:45:03.817+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:45:03.818881116Z [2024-05-11T02:45:03.818+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:45:03.818920864Z 2024-05-11T02:45:03.825688659Z [2024-05-11T02:45:03.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:45:03.826306677Z [2024-05-11T02:45:03.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:45:03.898632200Z [2024-05-11T02:45:03.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:03.898935608Z [2024-05-11T02:45:03.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:03.906987084Z [2024-05-11T02:45:03.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdb46d87-f6d6-46c8-9f41-bd255ca35dfd 2024-05-11T02:45:03.907504211Z [2024-05-11T02:45:03.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:45:02.840573+00:00, run_end_date=2024-05-11 02:45:03.174717+00:00, run_duration=0.334144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:00.995793+00:00, queued_by_job_id=2, pid=16592 2024-05-11T02:45:04.855461060Z [2024-05-11T02:45:04.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:45:04.856066155Z [2024-05-11T02:45:04.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:44:00+00:00, run_id=scheduled__2024-05-11T02:44:00+00:00, run_start_date=2024-05-11 02:45:00.909954+00:00, run_end_date=2024-05-11 02:45:04.855433+00:00, run_duration=3.945479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:44:00+00:00, data_interval_end=2024-05-11 02:45:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:45:04.866231537Z [2024-05-11T02:45:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:46:00+00:00 2024-05-11T02:45:04.920376466Z [2024-05-11T02:45:04.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:04.927698590Z [2024-05-11T02:45:04.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:44:00+00:00, map_index=-1, run_start_date=2024-05-11 02:45:02.850878+00:00, run_end_date=2024-05-11 02:45:04.179055+00:00, run_duration=1.328177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:00.995793+00:00, queued_by_job_id=2, pid=16593 2024-05-11T02:45:05.989187086Z [2024-05-11T02:45:05.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:45:05.989301781Z [2024-05-11T02:45:05.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:44:00+00:00, run_id=scheduled__2024-05-11T02:44:00+00:00, run_start_date=2024-05-11 02:45:00.911121+00:00, run_end_date=2024-05-11 02:45:05.988982+00:00, run_duration=5.077861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:44:00+00:00, data_interval_end=2024-05-11 02:45:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:45:05.999833641Z [2024-05-11T02:45:05.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:46:00+00:00 2024-05-11T02:45:06.042218673Z [2024-05-11T02:45:06.041+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:45:06.042245636Z 2024-05-11T02:45:06.042319717Z [2024-05-11T02:45:06.042+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:45:06.042947181Z [2024-05-11T02:45:06.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:45:06.042956721Z 2024-05-11T02:45:06.045427077Z [2024-05-11T02:45:06.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:45:06.045627801Z [2024-05-11T02:45:06.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:45:06.102054604Z [2024-05-11T02:45:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:06.104452539Z [2024-05-11T02:45:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:06.105996047Z [2024-05-11T02:45:06.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:06.119658523Z [2024-05-11T02:45:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:45:05.454752+00:00, run_end_date=2024-05-11 02:45:05.757066+00:00, run_duration=0.302314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:03.820207+00:00, queued_by_job_id=2, pid=16632 2024-05-11T02:45:06.119933414Z [2024-05-11T02:45:06.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 755297df-b316-4c3b-a242-46ca9b43f16b 2024-05-11T02:45:06.120318875Z [2024-05-11T02:45:06.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:44:00+00:00, map_index=-1, run_start_date=2024-05-11 02:45:03.144788+00:00, run_end_date=2024-05-11 02:45:04.909677+00:00, run_duration=1.764889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:00.995793+00:00, queued_by_job_id=2, pid=16606 2024-05-11T02:45:08.754184070Z [2024-05-11T02:45:08.753+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:45:08.754227982Z 2024-05-11T02:45:08.754396254Z [2024-05-11T02:45:08.754+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:45:08.755293096Z [2024-05-11T02:45:08.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:45:08.755311849Z 2024-05-11T02:45:08.758769384Z [2024-05-11T02:45:08.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:45:08.758929009Z [2024-05-11T02:45:08.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:45:08.813788467Z [2024-05-11T02:45:08.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status queued for try_number 1 2024-05-11T02:45:08.814004783Z [2024-05-11T02:45:08.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:08.820505363Z [2024-05-11T02:45:08.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to d31ca596-a1e4-4102-a710-03e78a49cfdf 2024-05-11T02:45:08.820897388Z [2024-05-11T02:45:08.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=0, run_start_date=2024-05-11 02:45:07.741467+00:00, run_end_date=2024-05-11 02:45:08.030572+00:00, run_duration=0.289105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:06.043278+00:00, queued_by_job_id=2, pid=16643 2024-05-11T02:45:11.067399016Z [2024-05-11T02:45:11.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:45:11.067438432Z [2024-05-11T02:45:11.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:40:00+00:00, run_id=scheduled__2024-05-11T02:40:00+00:00, run_start_date=2024-05-11 02:45:00.907141+00:00, run_end_date=2024-05-11 02:45:11.066697+00:00, run_duration=10.159556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:40:00+00:00, data_interval_end=2024-05-11 02:45:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:45:11.076700319Z [2024-05-11T02:45:11.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:45:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:45:11.141982748Z [2024-05-11T02:45:11.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:40:00+00:00 exited with status success for try_number 1 2024-05-11T02:45:11.146015426Z [2024-05-11T02:45:11.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:40:00+00:00, map_index=-1, run_start_date=2024-05-11 02:45:10.506793+00:00, run_end_date=2024-05-11 02:45:10.844274+00:00, run_duration=0.337481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:45:08.755922+00:00, queued_by_job_id=2, pid=16651 2024-05-11T02:45:36.698381998Z [2024-05-11T02:45:36.696+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:46:00.040558727Z [2024-05-11T02:46:00.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:46:00+00:00, run_after=2024-05-11T02:47:00+00:00 2024-05-11T02:46:00.048378345Z [2024-05-11T02:46:00.048+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:46:00.081919682Z [2024-05-11T02:46:00.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:46:00.105412773Z [2024-05-11T02:46:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:46:00+00:00, run_after=2024-05-11T02:47:00+00:00 2024-05-11T02:46:00.190400932Z [2024-05-11T02:46:00.189+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:46:00.190429239Z 2024-05-11T02:46:00.190434982Z 2024-05-11T02:46:00.190438261Z 2024-05-11T02:46:00.190441678Z 2024-05-11T02:46:00.190712499Z [2024-05-11T02:46:00.190+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:46:00.190917162Z [2024-05-11T02:46:00.190+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:46:00.191111986Z [2024-05-11T02:46:00.190+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:46:00.191262359Z [2024-05-11T02:46:00.191+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:46:00.192051063Z [2024-05-11T02:46:00.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:46:00.192064053Z 2024-05-11T02:46:00.192084417Z 2024-05-11T02:46:00.192087834Z 2024-05-11T02:46:00.192090854Z 2024-05-11T02:46:00.196509473Z [2024-05-11T02:46:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:46:00.196885284Z [2024-05-11T02:46:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:46:00.197213382Z [2024-05-11T02:46:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:46:00.197431952Z [2024-05-11T02:46:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:46:00.197726210Z [2024-05-11T02:46:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:46:00.197964517Z [2024-05-11T02:46:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:46:00.198639900Z [2024-05-11T02:46:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:46:00.198996579Z [2024-05-11T02:46:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:46:00.512598550Z [2024-05-11T02:46:00.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status queued for try_number 1 2024-05-11T02:46:00.513004690Z [2024-05-11T02:46:00.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:46:00.513465232Z [2024-05-11T02:46:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:46:00.513875647Z [2024-05-11T02:46:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:46:00.522979217Z [2024-05-11T02:46:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6549ff5b-de3e-4788-b800-f737c114efb4 2024-05-11T02:46:00.523253898Z [2024-05-11T02:46:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to daa80570-5604-490c-a173-c867bee29080 2024-05-11T02:46:00.523473880Z [2024-05-11T02:46:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59a45fee-d529-4715-8cc4-21e58dfd9b24 2024-05-11T02:46:00.523722815Z [2024-05-11T02:46:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7617ccbb-f7d5-40de-9b3a-864efa2a9f4d 2024-05-11T02:46:01.783262207Z [2024-05-11T02:46:01.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:46:01.783617026Z [2024-05-11T02:46:01.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:44:00+00:00, run_id=scheduled__2024-05-11T02:44:00+00:00, run_start_date=2024-05-11 02:46:00.116301+00:00, run_end_date=2024-05-11 02:46:01.783168+00:00, run_duration=1.666867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:44:00+00:00, data_interval_end=2024-05-11 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:46:01.791999646Z [2024-05-11T02:46:01.791+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:46:00+00:00, run_after=2024-05-11T02:48:00+00:00 2024-05-11T02:46:01.855976887Z [2024-05-11T02:46:01.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:44:00+00:00 exited with status success for try_number 1 2024-05-11T02:46:01.862785007Z [2024-05-11T02:46:01.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:44:00+00:00, map_index=-1, run_start_date=2024-05-11 02:46:01.004308+00:00, run_end_date=2024-05-11 02:46:01.457002+00:00, run_duration=0.452694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:46:00.193122+00:00, queued_by_job_id=2, pid=16656 2024-05-11T02:46:02.917125270Z [2024-05-11T02:46:02.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:46:02.917509226Z [2024-05-11T02:46:02.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:45:00+00:00, run_id=scheduled__2024-05-11T02:45:00+00:00, run_start_date=2024-05-11 02:46:00.117430+00:00, run_end_date=2024-05-11 02:46:02.917015+00:00, run_duration=2.799585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:45:00+00:00, data_interval_end=2024-05-11 02:46:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:46:02.930086032Z [2024-05-11T02:46:02.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:46:00+00:00, run_after=2024-05-11T02:47:00+00:00 2024-05-11T02:46:02.982738844Z [2024-05-11T02:46:02.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:46:02.990513689Z [2024-05-11T02:46:02.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=-1, run_start_date=2024-05-11 02:46:01.433165+00:00, run_end_date=2024-05-11 02:46:01.854130+00:00, run_duration=0.420965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:46:00.193122+00:00, queued_by_job_id=2, pid=16668 2024-05-11T02:46:04.043869403Z [2024-05-11T02:46:04.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:46:04.044442808Z [2024-05-11T02:46:04.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:45:00+00:00, run_id=scheduled__2024-05-11T02:45:00+00:00, run_start_date=2024-05-11 02:46:00.118476+00:00, run_end_date=2024-05-11 02:46:04.043866+00:00, run_duration=3.92539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:45:00+00:00, data_interval_end=2024-05-11 02:46:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:46:04.067750941Z [2024-05-11T02:46:04.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:46:00+00:00, run_after=2024-05-11T02:47:00+00:00 2024-05-11T02:46:04.131573091Z [2024-05-11T02:46:04.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:46:04.141811846Z [2024-05-11T02:46:04.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=-1, run_start_date=2024-05-11 02:46:02.243451+00:00, run_end_date=2024-05-11 02:46:03.478042+00:00, run_duration=1.234591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:46:00.193122+00:00, queued_by_job_id=2, pid=16685 2024-05-11T02:46:05.376169469Z [2024-05-11T02:46:05.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:46:05.376537649Z [2024-05-11T02:46:05.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:45:00+00:00, run_id=scheduled__2024-05-11T02:45:00+00:00, run_start_date=2024-05-11 02:46:00.119480+00:00, run_end_date=2024-05-11 02:46:05.376059+00:00, run_duration=5.256579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:45:00+00:00, data_interval_end=2024-05-11 02:46:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:46:05.384759967Z [2024-05-11T02:46:05.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:46:00+00:00, run_after=2024-05-11T02:47:00+00:00 2024-05-11T02:46:05.419378220Z [2024-05-11T02:46:05.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:46:05.425594332Z [2024-05-11T02:46:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=-1, run_start_date=2024-05-11 02:46:02.350723+00:00, run_end_date=2024-05-11 02:46:05.026562+00:00, run_duration=2.675839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:46:00.193122+00:00, queued_by_job_id=2, pid=16686 2024-05-11T02:47:00.452982427Z [2024-05-11T02:47:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:47:00+00:00, run_after=2024-05-11T02:48:00+00:00 2024-05-11T02:47:00.464204716Z [2024-05-11T02:47:00.463+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:47:00.477697609Z [2024-05-11T02:47:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:47:00+00:00, run_after=2024-05-11T02:48:00+00:00 2024-05-11T02:47:00.559574999Z [2024-05-11T02:47:00.559+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:47:00.559617321Z 2024-05-11T02:47:00.559624201Z 2024-05-11T02:47:00.559642211Z 2024-05-11T02:47:00.559812415Z [2024-05-11T02:47:00.559+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:47:00.560036160Z [2024-05-11T02:47:00.559+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:47:00.560287290Z [2024-05-11T02:47:00.560+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:47:00.561600951Z [2024-05-11T02:47:00.561+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:47:00.561614268Z 2024-05-11T02:47:00.561619783Z 2024-05-11T02:47:00.561624774Z 2024-05-11T02:47:00.566946081Z [2024-05-11T02:47:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:47:00.567167120Z [2024-05-11T02:47:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:47:00.567545761Z [2024-05-11T02:47:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:47:00.567815179Z [2024-05-11T02:47:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:47:00.568176291Z [2024-05-11T02:47:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:47:00.568363421Z [2024-05-11T02:47:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:47:00.801177487Z [2024-05-11T02:47:00.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status queued for try_number 1 2024-05-11T02:47:00.801207772Z [2024-05-11T02:47:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status queued for try_number 1 2024-05-11T02:47:00.801336203Z [2024-05-11T02:47:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status queued for try_number 1 2024-05-11T02:47:00.809556805Z [2024-05-11T02:47:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce6d419b-7226-45f4-8273-2d5719a35f4a 2024-05-11T02:47:00.809672911Z [2024-05-11T02:47:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c6d0378-e0ea-4155-87e5-c89a82dedeb3 2024-05-11T02:47:00.809695014Z [2024-05-11T02:47:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ff56d38-c81c-4a17-8403-5e6f5b4a807b 2024-05-11T02:47:02.681051593Z [2024-05-11T02:47:02.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:47:02.681307813Z [2024-05-11T02:47:02.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:46:00+00:00, run_id=scheduled__2024-05-11T02:46:00+00:00, run_start_date=2024-05-11 02:47:00.492501+00:00, run_end_date=2024-05-11 02:47:02.680958+00:00, run_duration=2.188457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:46:00+00:00, data_interval_end=2024-05-11 02:47:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:47:02.691925881Z [2024-05-11T02:47:02.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:47:00+00:00, run_after=2024-05-11T02:48:00+00:00 2024-05-11T02:47:02.738105120Z [2024-05-11T02:47:02.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status success for try_number 1 2024-05-11T02:47:02.746194391Z [2024-05-11T02:47:02.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:46:00+00:00, map_index=-1, run_start_date=2024-05-11 02:47:01.378271+00:00, run_end_date=2024-05-11 02:47:01.713675+00:00, run_duration=0.335404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:47:00.563077+00:00, queued_by_job_id=2, pid=16718 2024-05-11T02:47:04.520501024Z [2024-05-11T02:47:04.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:47:04.521029656Z [2024-05-11T02:47:04.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:46:00+00:00, run_id=scheduled__2024-05-11T02:46:00+00:00, run_start_date=2024-05-11 02:47:00.494073+00:00, run_end_date=2024-05-11 02:47:04.520386+00:00, run_duration=4.026313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:46:00+00:00, data_interval_end=2024-05-11 02:47:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:47:04.537104002Z [2024-05-11T02:47:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:47:00+00:00, run_after=2024-05-11T02:48:00+00:00 2024-05-11T02:47:04.545905853Z [2024-05-11T02:47:04.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:47:04.546310771Z [2024-05-11T02:47:04.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:46:00+00:00, run_id=scheduled__2024-05-11T02:46:00+00:00, run_start_date=2024-05-11 02:47:00.495472+00:00, run_end_date=2024-05-11 02:47:04.545774+00:00, run_duration=4.050302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:46:00+00:00, data_interval_end=2024-05-11 02:47:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:47:04.557191613Z [2024-05-11T02:47:04.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:47:00+00:00, run_after=2024-05-11T02:48:00+00:00 2024-05-11T02:47:04.596288702Z [2024-05-11T02:47:04.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status success for try_number 1 2024-05-11T02:47:04.596564491Z [2024-05-11T02:47:04.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status success for try_number 1 2024-05-11T02:47:04.605652062Z [2024-05-11T02:47:04.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:46:00+00:00, map_index=-1, run_start_date=2024-05-11 02:47:02.269964+00:00, run_end_date=2024-05-11 02:47:03.721708+00:00, run_duration=1.451744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:47:00.563077+00:00, queued_by_job_id=2, pid=16736 2024-05-11T02:47:04.606270505Z [2024-05-11T02:47:04.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:46:00+00:00, map_index=-1, run_start_date=2024-05-11 02:47:02.388728+00:00, run_end_date=2024-05-11 02:47:04.085129+00:00, run_duration=1.696401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:47:00.563077+00:00, queued_by_job_id=2, pid=16737 2024-05-11T02:48:00.888618647Z [2024-05-11T02:48:00.888+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:48:00.895037614Z [2024-05-11T02:48:00.894+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:48:00.906692037Z [2024-05-11T02:48:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:48:00+00:00, run_after=2024-05-11T02:49:00+00:00 2024-05-11T02:48:00.920519152Z [2024-05-11T02:48:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:48:00+00:00, run_after=2024-05-11T02:49:00+00:00 2024-05-11T02:48:00.996083158Z [2024-05-11T02:48:00.995+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:48:00.996119705Z 2024-05-11T02:48:00.996130851Z 2024-05-11T02:48:00.996135056Z 2024-05-11T02:48:00.996138756Z 2024-05-11T02:48:00.996143502Z [2024-05-11T02:48:00.995+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:48:00.996154749Z [2024-05-11T02:48:00.995+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:48:00.996347381Z [2024-05-11T02:48:00.996+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:48:00.996420532Z [2024-05-11T02:48:00.996+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:48:00.997050319Z [2024-05-11T02:48:00.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:48:00.997060802Z 2024-05-11T02:48:00.997064220Z 2024-05-11T02:48:00.997067491Z 2024-05-11T02:48:00.997070776Z 2024-05-11T02:48:01.000388091Z [2024-05-11T02:48:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:48:01.000416072Z [2024-05-11T02:48:01.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:48:01.001740139Z [2024-05-11T02:48:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:48:01.001781082Z [2024-05-11T02:48:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:48:01.002020528Z [2024-05-11T02:48:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:48:01.002095579Z [2024-05-11T02:48:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:48:01.002290523Z [2024-05-11T02:48:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:48:01.002360901Z [2024-05-11T02:48:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:48:01.703093367Z [2024-05-11T02:48:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status queued for try_number 1 2024-05-11T02:48:01.703363922Z [2024-05-11T02:48:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:47:00+00:00 exited with status queued for try_number 1 2024-05-11T02:48:01.703482234Z [2024-05-11T02:48:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:47:00+00:00 exited with status queued for try_number 1 2024-05-11T02:48:01.703576648Z [2024-05-11T02:48:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:47:00+00:00 exited with status queued for try_number 1 2024-05-11T02:48:01.719815618Z [2024-05-11T02:48:01.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d0ac40e-79a8-41c0-abae-0d6b3652143c 2024-05-11T02:48:01.720025947Z [2024-05-11T02:48:01.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6440d4d9-ff0d-48a0-948c-f16c05b8e3f4 2024-05-11T02:48:01.720200146Z [2024-05-11T02:48:01.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4858d34e-64cf-469a-b759-fd41368d6448 2024-05-11T02:48:01.720352501Z [2024-05-11T02:48:01.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29bcd69e-18e3-41fb-b408-4ebb31f559c3 2024-05-11T02:48:02.423444397Z [2024-05-11T02:48:02.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:48:02.423741778Z [2024-05-11T02:48:02.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:46:00+00:00, run_id=scheduled__2024-05-11T02:46:00+00:00, run_start_date=2024-05-11 02:48:00.931930+00:00, run_end_date=2024-05-11 02:48:02.423380+00:00, run_duration=1.49145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:46:00+00:00, data_interval_end=2024-05-11 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:48:02.432058349Z [2024-05-11T02:48:02.431+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:48:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:48:02.510747515Z [2024-05-11T02:48:02.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:46:00+00:00 exited with status success for try_number 1 2024-05-11T02:48:02.527088892Z [2024-05-11T02:48:02.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:46:00+00:00, map_index=-1, run_start_date=2024-05-11 02:48:01.776746+00:00, run_end_date=2024-05-11 02:48:02.272362+00:00, run_duration=0.495616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:48:00.997786+00:00, queued_by_job_id=2, pid=16770 2024-05-11T02:48:03.623003167Z [2024-05-11T02:48:03.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:48:03.623308616Z [2024-05-11T02:48:03.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:47:00+00:00, run_id=scheduled__2024-05-11T02:47:00+00:00, run_start_date=2024-05-11 02:48:00.934775+00:00, run_end_date=2024-05-11 02:48:03.622924+00:00, run_duration=2.688149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:47:00+00:00, data_interval_end=2024-05-11 02:48:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:48:03.632823647Z [2024-05-11T02:48:03.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:48:00+00:00, run_after=2024-05-11T02:49:00+00:00 2024-05-11T02:48:03.678205038Z [2024-05-11T02:48:03.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:47:00+00:00 exited with status success for try_number 1 2024-05-11T02:48:03.682955349Z [2024-05-11T02:48:03.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:47:00+00:00, map_index=-1, run_start_date=2024-05-11 02:48:02.051024+00:00, run_end_date=2024-05-11 02:48:02.561362+00:00, run_duration=0.510338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:48:00.997786+00:00, queued_by_job_id=2, pid=16771 2024-05-11T02:48:05.967926715Z [2024-05-11T02:48:05.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:48:05.968399038Z [2024-05-11T02:48:05.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:47:00+00:00, run_id=scheduled__2024-05-11T02:47:00+00:00, run_start_date=2024-05-11 02:48:00.935958+00:00, run_end_date=2024-05-11 02:48:05.968052+00:00, run_duration=5.032094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:47:00+00:00, data_interval_end=2024-05-11 02:48:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:48:05.977378296Z [2024-05-11T02:48:05.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:48:00+00:00, run_after=2024-05-11T02:49:00+00:00 2024-05-11T02:48:05.985596264Z [2024-05-11T02:48:05.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:48:05.985905035Z [2024-05-11T02:48:05.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:47:00+00:00, run_id=scheduled__2024-05-11T02:47:00+00:00, run_start_date=2024-05-11 02:48:00.936980+00:00, run_end_date=2024-05-11 02:48:05.985568+00:00, run_duration=5.048588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:47:00+00:00, data_interval_end=2024-05-11 02:48:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:48:05.995364408Z [2024-05-11T02:48:05.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:48:00+00:00, run_after=2024-05-11T02:49:00+00:00 2024-05-11T02:48:06.049930745Z [2024-05-11T02:48:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:47:00+00:00 exited with status success for try_number 1 2024-05-11T02:48:06.050074499Z [2024-05-11T02:48:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:47:00+00:00 exited with status success for try_number 1 2024-05-11T02:48:06.056800326Z [2024-05-11T02:48:06.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:47:00+00:00, map_index=-1, run_start_date=2024-05-11 02:48:03.377198+00:00, run_end_date=2024-05-11 02:48:05.410840+00:00, run_duration=2.033642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:48:00.997786+00:00, queued_by_job_id=2, pid=16795 2024-05-11T02:48:06.057084368Z [2024-05-11T02:48:06.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:47:00+00:00, map_index=-1, run_start_date=2024-05-11 02:48:03.183300+00:00, run_end_date=2024-05-11 02:48:05.271199+00:00, run_duration=2.087899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:48:00.997786+00:00, queued_by_job_id=2, pid=16789 2024-05-11T02:49:00.376578369Z [2024-05-11T02:49:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:49:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:49:00.390231999Z [2024-05-11T02:49:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:49:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:49:00.396490940Z [2024-05-11T02:49:00.396+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:49:00.458556235Z [2024-05-11T02:49:00.458+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:49:00.458603819Z 2024-05-11T02:49:00.458625500Z 2024-05-11T02:49:00.458639504Z 2024-05-11T02:49:00.458671327Z [2024-05-11T02:49:00.458+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:49:00.458696194Z [2024-05-11T02:49:00.458+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:49:00.458936770Z [2024-05-11T02:49:00.458+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:49:00.459798423Z [2024-05-11T02:49:00.459+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:49:00.459824479Z 2024-05-11T02:49:00.459838259Z 2024-05-11T02:49:00.459849871Z 2024-05-11T02:49:00.464511373Z [2024-05-11T02:49:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:49:00.464556705Z [2024-05-11T02:49:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:49:00.464871951Z [2024-05-11T02:49:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:49:00.464906628Z [2024-05-11T02:49:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:49:00.465172705Z [2024-05-11T02:49:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:49:00.465218549Z [2024-05-11T02:49:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:49:00.720560984Z [2024-05-11T02:49:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status queued for try_number 1 2024-05-11T02:49:00.720620702Z [2024-05-11T02:49:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status queued for try_number 1 2024-05-11T02:49:00.720688399Z [2024-05-11T02:49:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status queued for try_number 1 2024-05-11T02:49:00.730863051Z [2024-05-11T02:49:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38166401-2c38-4d0d-adeb-1f713c7e6806 2024-05-11T02:49:00.730912447Z [2024-05-11T02:49:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2fac9a9-22db-44ba-ba06-0d81a7c86e2d 2024-05-11T02:49:00.731041545Z [2024-05-11T02:49:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to d04eefe1-a35b-431d-a3f4-69b94655ca4d 2024-05-11T02:49:01.910197967Z [2024-05-11T02:49:01.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:49:01.910675040Z [2024-05-11T02:49:01.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:48:00+00:00, run_id=scheduled__2024-05-11T02:48:00+00:00, run_start_date=2024-05-11 02:49:00.405339+00:00, run_end_date=2024-05-11 02:49:01.910120+00:00, run_duration=1.504781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:48:00+00:00, data_interval_end=2024-05-11 02:49:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:49:01.921114088Z [2024-05-11T02:49:01.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:49:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:49:01.976958321Z [2024-05-11T02:49:01.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status success for try_number 1 2024-05-11T02:49:01.986633248Z [2024-05-11T02:49:01.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:48:00+00:00, map_index=-1, run_start_date=2024-05-11 02:49:01.354581+00:00, run_end_date=2024-05-11 02:49:01.694411+00:00, run_duration=0.33983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:49:00.460912+00:00, queued_by_job_id=2, pid=16828 2024-05-11T02:49:04.398814881Z [2024-05-11T02:49:04.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:49:04.399097371Z [2024-05-11T02:49:04.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:48:00+00:00, run_id=scheduled__2024-05-11T02:48:00+00:00, run_start_date=2024-05-11 02:49:00.406867+00:00, run_end_date=2024-05-11 02:49:04.398745+00:00, run_duration=3.991878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:48:00+00:00, data_interval_end=2024-05-11 02:49:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:49:04.409518490Z [2024-05-11T02:49:04.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:49:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:49:04.465339589Z [2024-05-11T02:49:04.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status success for try_number 1 2024-05-11T02:49:04.473926779Z [2024-05-11T02:49:04.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:48:00+00:00, map_index=-1, run_start_date=2024-05-11 02:49:02.582957+00:00, run_end_date=2024-05-11 02:49:04.125297+00:00, run_duration=1.54234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:49:00.460912+00:00, queued_by_job_id=2, pid=16847 2024-05-11T02:49:05.156418995Z [2024-05-11T02:49:05.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:49:05.156818283Z [2024-05-11T02:49:05.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:48:00+00:00, run_id=scheduled__2024-05-11T02:48:00+00:00, run_start_date=2024-05-11 02:49:00.407905+00:00, run_end_date=2024-05-11 02:49:05.156288+00:00, run_duration=4.748383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:48:00+00:00, data_interval_end=2024-05-11 02:49:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:49:05.169993567Z [2024-05-11T02:49:05.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:49:00+00:00, run_after=2024-05-11T02:50:00+00:00 2024-05-11T02:49:05.215837329Z [2024-05-11T02:49:05.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status success for try_number 1 2024-05-11T02:49:05.221313870Z [2024-05-11T02:49:05.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:48:00+00:00, map_index=-1, run_start_date=2024-05-11 02:49:02.388852+00:00, run_end_date=2024-05-11 02:49:04.539477+00:00, run_duration=2.150625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:49:00.460912+00:00, queued_by_job_id=2, pid=16846 2024-05-11T02:50:00.169193547Z [2024-05-11T02:50:00.168+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:50:00.177408644Z [2024-05-11T02:50:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:50:00.196798793Z [2024-05-11T02:50:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:51:00+00:00 2024-05-11T02:50:00.216831352Z [2024-05-11T02:50:00.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:51:00+00:00 2024-05-11T02:50:00.229006271Z [2024-05-11T02:50:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:55:00+00:00 2024-05-11T02:50:00.345416930Z [2024-05-11T02:50:00.344+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-11T02:50:00.345455657Z 2024-05-11T02:50:00.345459578Z 2024-05-11T02:50:00.345463988Z 2024-05-11T02:50:00.345467026Z 2024-05-11T02:50:00.345470017Z 2024-05-11T02:50:00.345473031Z [2024-05-11T02:50:00.345+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:50:00.345476532Z [2024-05-11T02:50:00.345+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:50:00.345939356Z [2024-05-11T02:50:00.345+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:50:00.345948521Z [2024-05-11T02:50:00.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:50:00.345951839Z [2024-05-11T02:50:00.345+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:50:00.347574146Z [2024-05-11T02:50:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:50:00.347590245Z 2024-05-11T02:50:00.347594108Z 2024-05-11T02:50:00.347597535Z 2024-05-11T02:50:00.347608546Z 2024-05-11T02:50:00.347611823Z 2024-05-11T02:50:00.350563271Z [2024-05-11T02:50:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-11T02:50:00.350738226Z [2024-05-11T02:50:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:50:00.350915818Z [2024-05-11T02:50:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:50:00.350989941Z [2024-05-11T02:50:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:50:00.351179728Z [2024-05-11T02:50:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:50:00.351291098Z [2024-05-11T02:50:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:50:00.351528145Z [2024-05-11T02:50:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:50:00.351535372Z [2024-05-11T02:50:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:50:00.351800831Z [2024-05-11T02:50:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:50:00.351964536Z [2024-05-11T02:50:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:50:00.803132686Z [2024-05-11T02:50:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:00.803281571Z [2024-05-11T02:50:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:00.803424691Z [2024-05-11T02:50:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:49:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:00.803518421Z [2024-05-11T02:50:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:49:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:00.803645202Z [2024-05-11T02:50:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:49:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:00.820097799Z [2024-05-11T02:50:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5249a21-598f-4a35-8dbd-997a3086b126 2024-05-11T02:50:00.820198920Z [2024-05-11T02:50:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 601018cb-75f7-46da-add9-b748ff980fd8 2024-05-11T02:50:00.820381339Z [2024-05-11T02:50:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3939e867-b486-4fb9-86bc-94fda9598cfe 2024-05-11T02:50:00.820536410Z [2024-05-11T02:50:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 151bbd6e-b0cc-48eb-a688-317053f8f2fd 2024-05-11T02:50:00.820688731Z [2024-05-11T02:50:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47c48e97-44cb-49d6-b335-b014b5c8fff0 2024-05-11T02:50:02.066732699Z [2024-05-11T02:50:02.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:50:02.067172790Z [2024-05-11T02:50:02.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:48:00+00:00, run_id=scheduled__2024-05-11T02:48:00+00:00, run_start_date=2024-05-11 02:50:00.241403+00:00, run_end_date=2024-05-11 02:50:02.066636+00:00, run_duration=1.825233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:48:00+00:00, data_interval_end=2024-05-11 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:50:02.082156899Z [2024-05-11T02:50:02.081+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:52:00+00:00 2024-05-11T02:50:02.408159221Z [2024-05-11T02:50:02.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:48:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:02.413804833Z [2024-05-11T02:50:02.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:48:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:01.246798+00:00, run_end_date=2024-05-11 02:50:01.678251+00:00, run_duration=0.431453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:00.347560+00:00, queued_by_job_id=2, pid=16876 2024-05-11T02:50:03.471225234Z [2024-05-11T02:50:03.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:50:03.472610369Z [2024-05-11T02:50:03.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:49:00+00:00, run_id=scheduled__2024-05-11T02:49:00+00:00, run_start_date=2024-05-11 02:50:00.242474+00:00, run_end_date=2024-05-11 02:50:03.470990+00:00, run_duration=3.228516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:49:00+00:00, data_interval_end=2024-05-11 02:50:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:50:03.495789488Z [2024-05-11T02:50:03.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:51:00+00:00 2024-05-11T02:50:03.592654430Z [2024-05-11T02:50:03.592+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:50:03.592688665Z 2024-05-11T02:50:03.592720914Z [2024-05-11T02:50:03.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:50:03.593146596Z [2024-05-11T02:50:03.592+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:50:03.593164288Z 2024-05-11T02:50:03.595530920Z [2024-05-11T02:50:03.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='split_metrics', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-11T02:50:03.595576127Z [2024-05-11T02:50:03.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:50:03.700832904Z [2024-05-11T02:50:03.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:03.701137608Z [2024-05-11T02:50:03.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.extract_metrics_from_vnfrs run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:03.701343013Z [2024-05-11T02:50:03.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:49:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:03.711355487Z [2024-05-11T02:50:03.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:03.034785+00:00, run_end_date=2024-05-11 02:50:03.492857+00:00, run_duration=0.458072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1157, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:00.347560+00:00, queued_by_job_id=2, pid=16901 2024-05-11T02:50:03.711614856Z [2024-05-11T02:50:03.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95537a7e-adea-41eb-886c-ceaffcd4d8e4 2024-05-11T02:50:03.711886919Z [2024-05-11T02:50:03.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:49:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:02.201061+00:00, run_end_date=2024-05-11 02:50:02.588863+00:00, run_duration=0.387802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:00.347560+00:00, queued_by_job_id=2, pid=16888 2024-05-11T02:50:05.325108221Z [2024-05-11T02:50:05.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:50:05.325707485Z [2024-05-11T02:50:05.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:49:00+00:00, run_id=scheduled__2024-05-11T02:49:00+00:00, run_start_date=2024-05-11 02:50:00.243450+00:00, run_end_date=2024-05-11 02:50:05.325083+00:00, run_duration=5.081633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:49:00+00:00, data_interval_end=2024-05-11 02:50:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:50:05.353814764Z [2024-05-11T02:50:05.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:51:00+00:00 2024-05-11T02:50:05.375455333Z [2024-05-11T02:50:05.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:50:05.378516633Z [2024-05-11T02:50:05.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:49:00+00:00, run_id=scheduled__2024-05-11T02:49:00+00:00, run_start_date=2024-05-11 02:50:00.244418+00:00, run_end_date=2024-05-11 02:50:05.378059+00:00, run_duration=5.133641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:49:00+00:00, data_interval_end=2024-05-11 02:50:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:50:05.391514628Z [2024-05-11T02:50:05.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:51:00+00:00 2024-05-11T02:50:05.478822431Z [2024-05-11T02:50:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:49:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:05.483682165Z [2024-05-11T02:50:05.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:49:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:03.438500+00:00, run_end_date=2024-05-11 02:50:04.674799+00:00, run_duration=1.236299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:00.347560+00:00, queued_by_job_id=2, pid=16918 2024-05-11T02:50:06.545760226Z [2024-05-11T02:50:06.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:50:06.545793250Z 2024-05-11T02:50:06.546166817Z [2024-05-11T02:50:06.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:50:06.546780256Z [2024-05-11T02:50:06.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:50:06.546791505Z 2024-05-11T02:50:06.549002860Z [2024-05-11T02:50:06.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='collect_metrics', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-11T02:50:06.549224729Z [2024-05-11T02:50:06.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:50:06.601755176Z [2024-05-11T02:50:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:06.601828823Z [2024-05-11T02:50:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:49:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:06.601875049Z [2024-05-11T02:50:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.split_metrics run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:06.617263817Z [2024-05-11T02:50:06.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:49:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:03.384616+00:00, run_end_date=2024-05-11 02:50:05.245046+00:00, run_duration=1.86043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:00.347560+00:00, queued_by_job_id=2, pid=16916 2024-05-11T02:50:06.617499662Z [2024-05-11T02:50:06.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=split_metrics, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:05.228436+00:00, run_end_date=2024-05-11 02:50:05.695250+00:00, run_duration=0.466814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1160, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:03.593429+00:00, queued_by_job_id=2, pid=16947 2024-05-11T02:50:06.618045933Z [2024-05-11T02:50:06.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc965282-2505-4236-a89f-d127e1e3e023 2024-05-11T02:50:10.426595634Z [2024-05-11T02:50:10.426+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-11T02:50:10.426627903Z 2024-05-11T02:50:10.426642541Z [2024-05-11T02:50:10.426+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:50:10.427163317Z [2024-05-11T02:50:10.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:50:10.427176732Z 2024-05-11T02:50:10.430984296Z [2024-05-11T02:50:10.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='send_prometheus', run_id='scheduled__2024-05-11T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:50:10.431109723Z [2024-05-11T02:50:10.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:50:10.491470610Z [2024-05-11T02:50:10.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status queued for try_number 1 2024-05-11T02:50:10.493952993Z [2024-05-11T02:50:10.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.collect_metrics run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:10.501302498Z [2024-05-11T02:50:10.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f2f49fc-5050-48bf-a930-2914d07b009d 2024-05-11T02:50:10.501690860Z [2024-05-11T02:50:10.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=collect_metrics, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=0, run_start_date=2024-05-11 02:50:08.174510+00:00, run_end_date=2024-05-11 02:50:09.757185+00:00, run_duration=1.582675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1161, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:06.547194+00:00, queued_by_job_id=2, pid=16958 2024-05-11T02:50:12.744901081Z [2024-05-11T02:50:12.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:50:12.745330292Z [2024-05-11T02:50:12.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:45:00+00:00, run_id=scheduled__2024-05-11T02:45:00+00:00, run_start_date=2024-05-11 02:50:00.239869+00:00, run_end_date=2024-05-11 02:50:12.744991+00:00, run_duration=12.505122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:45:00+00:00, data_interval_end=2024-05-11 02:50:00+00:00, dag_hash=66132f263d365478e55dac7ab9fc7520 2024-05-11T02:50:12.752454205Z [2024-05-11T02:50:12.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:50:00+00:00, run_after=2024-05-11T02:55:00+00:00 2024-05-11T02:50:12.786381253Z [2024-05-11T02:50:12.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.send_prometheus run_id=scheduled__2024-05-11T02:45:00+00:00 exited with status success for try_number 1 2024-05-11T02:50:12.792642696Z [2024-05-11T02:50:12.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=send_prometheus, run_id=scheduled__2024-05-11T02:45:00+00:00, map_index=-1, run_start_date=2024-05-11 02:50:11.981602+00:00, run_end_date=2024-05-11 02:50:12.369571+00:00, run_duration=0.387969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:50:10.427416+00:00, queued_by_job_id=2, pid=16971 2024-05-11T02:50:36.757978579Z [2024-05-11T02:50:36.755+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-11T02:51:00.043461682Z [2024-05-11T02:51:00.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:51:00+00:00, run_after=2024-05-11T02:52:00+00:00 2024-05-11T02:51:00.050928857Z [2024-05-11T02:51:00.050+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:51:00.062631004Z [2024-05-11T02:51:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:51:00+00:00, run_after=2024-05-11T02:52:00+00:00 2024-05-11T02:51:00.128218037Z [2024-05-11T02:51:00.127+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:51:00.128243531Z 2024-05-11T02:51:00.128247592Z 2024-05-11T02:51:00.128250889Z 2024-05-11T02:51:00.128254023Z [2024-05-11T02:51:00.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:51:00.128257129Z [2024-05-11T02:51:00.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:51:00.128260107Z [2024-05-11T02:51:00.127+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:51:00.128264585Z [2024-05-11T02:51:00.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:51:00.128267564Z 2024-05-11T02:51:00.128270383Z 2024-05-11T02:51:00.128273338Z 2024-05-11T02:51:00.133226759Z [2024-05-11T02:51:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:51:00.133243297Z [2024-05-11T02:51:00.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:51:00.133246834Z [2024-05-11T02:51:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:51:00.133249911Z [2024-05-11T02:51:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:51:00.133253001Z [2024-05-11T02:51:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:51:00.133270055Z [2024-05-11T02:51:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:51:00.529944491Z [2024-05-11T02:51:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status queued for try_number 1 2024-05-11T02:51:00.530161956Z [2024-05-11T02:51:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status queued for try_number 1 2024-05-11T02:51:00.530366446Z [2024-05-11T02:51:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status queued for try_number 1 2024-05-11T02:51:00.541627849Z [2024-05-11T02:51:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to eef1941c-80da-4d0e-b60d-f5ed6f6dc332 2024-05-11T02:51:00.541838346Z [2024-05-11T02:51:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1eddcc99-c32a-4f86-ae57-a63408e2a107 2024-05-11T02:51:00.542043850Z [2024-05-11T02:51:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee16ce7a-91b4-4961-9584-ae94ee0f5d30 2024-05-11T02:51:01.715753025Z [2024-05-11T02:51:01.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:51:01.716230848Z [2024-05-11T02:51:01.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:50:00+00:00, run_id=scheduled__2024-05-11T02:50:00+00:00, run_start_date=2024-05-11 02:51:00.072164+00:00, run_end_date=2024-05-11 02:51:01.715650+00:00, run_duration=1.643486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:50:00+00:00, data_interval_end=2024-05-11 02:51:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:51:01.727440181Z [2024-05-11T02:51:01.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:51:00+00:00, run_after=2024-05-11T02:52:00+00:00 2024-05-11T02:51:01.788617147Z [2024-05-11T02:51:01.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status success for try_number 1 2024-05-11T02:51:01.798462188Z [2024-05-11T02:51:01.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:50:00+00:00, map_index=-1, run_start_date=2024-05-11 02:51:00.960197+00:00, run_end_date=2024-05-11 02:51:01.354989+00:00, run_duration=0.394792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:51:00.128929+00:00, queued_by_job_id=2, pid=16980 2024-05-11T02:51:03.942155143Z [2024-05-11T02:51:03.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:51:03.942424206Z [2024-05-11T02:51:03.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:50:00+00:00, run_id=scheduled__2024-05-11T02:50:00+00:00, run_start_date=2024-05-11 02:51:00.073420+00:00, run_end_date=2024-05-11 02:51:03.942030+00:00, run_duration=3.86861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:50:00+00:00, data_interval_end=2024-05-11 02:51:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:51:03.964010223Z [2024-05-11T02:51:03.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:51:00+00:00, run_after=2024-05-11T02:52:00+00:00 2024-05-11T02:51:03.971513327Z [2024-05-11T02:51:03.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:51:03.971636153Z [2024-05-11T02:51:03.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:50:00+00:00, run_id=scheduled__2024-05-11T02:50:00+00:00, run_start_date=2024-05-11 02:51:00.074598+00:00, run_end_date=2024-05-11 02:51:03.971408+00:00, run_duration=3.89681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:50:00+00:00, data_interval_end=2024-05-11 02:51:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:51:03.980450360Z [2024-05-11T02:51:03.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:51:00+00:00, run_after=2024-05-11T02:52:00+00:00 2024-05-11T02:51:04.024045834Z [2024-05-11T02:51:04.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status success for try_number 1 2024-05-11T02:51:04.024225294Z [2024-05-11T02:51:04.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status success for try_number 1 2024-05-11T02:51:04.050036059Z [2024-05-11T02:51:04.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:50:00+00:00, map_index=-1, run_start_date=2024-05-11 02:51:02.223189+00:00, run_end_date=2024-05-11 02:51:03.599658+00:00, run_duration=1.376469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:51:00.128929+00:00, queued_by_job_id=2, pid=16999 2024-05-11T02:51:04.050063280Z [2024-05-11T02:51:04.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:50:00+00:00, map_index=-1, run_start_date=2024-05-11 02:51:01.963011+00:00, run_end_date=2024-05-11 02:51:03.717198+00:00, run_duration=1.754187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:51:00.128929+00:00, queued_by_job_id=2, pid=16993 2024-05-11T02:52:00.434157937Z [2024-05-11T02:52:00.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:52:00+00:00, run_after=2024-05-11T02:53:00+00:00 2024-05-11T02:52:00.444427374Z [2024-05-11T02:52:00.444+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:52:00.456301714Z [2024-05-11T02:52:00.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:52:00+00:00, run_after=2024-05-11T02:53:00+00:00 2024-05-11T02:52:00.464989924Z [2024-05-11T02:52:00.464+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:52:00.569246754Z [2024-05-11T02:52:00.568+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:52:00.569282890Z 2024-05-11T02:52:00.569297252Z 2024-05-11T02:52:00.569302554Z 2024-05-11T02:52:00.569307283Z 2024-05-11T02:52:00.569843527Z [2024-05-11T02:52:00.569+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:52:00.570268652Z [2024-05-11T02:52:00.570+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:52:00.570638140Z [2024-05-11T02:52:00.570+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:52:00.571001568Z [2024-05-11T02:52:00.570+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:52:00.572161938Z [2024-05-11T02:52:00.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:52:00.572175724Z 2024-05-11T02:52:00.572181506Z 2024-05-11T02:52:00.572197435Z 2024-05-11T02:52:00.572202669Z 2024-05-11T02:52:00.579097370Z [2024-05-11T02:52:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:52:00.579344780Z [2024-05-11T02:52:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:52:00.579880058Z [2024-05-11T02:52:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:52:00.580114613Z [2024-05-11T02:52:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:52:00.580539062Z [2024-05-11T02:52:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:52:00.580817079Z [2024-05-11T02:52:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:52:00.581263115Z [2024-05-11T02:52:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:52:00.581501170Z [2024-05-11T02:52:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:52:01.015396598Z [2024-05-11T02:52:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status queued for try_number 1 2024-05-11T02:52:01.024301745Z [2024-05-11T02:52:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:51:00+00:00 exited with status queued for try_number 1 2024-05-11T02:52:01.024319841Z [2024-05-11T02:52:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:51:00+00:00 exited with status queued for try_number 1 2024-05-11T02:52:01.024323592Z [2024-05-11T02:52:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:51:00+00:00 exited with status queued for try_number 1 2024-05-11T02:52:01.087375312Z [2024-05-11T02:52:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76ce123d-3591-412a-804d-426ec01b19b7 2024-05-11T02:52:01.087401968Z [2024-05-11T02:52:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c2f1183-fc64-4111-8920-45d21427592b 2024-05-11T02:52:01.087405680Z [2024-05-11T02:52:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to d14b38d6-2fb9-41b7-91b6-32e481949dde 2024-05-11T02:52:01.087421475Z [2024-05-11T02:52:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 813072cd-7621-4fd4-96bc-9793b08cee8b 2024-05-11T02:52:02.610775040Z [2024-05-11T02:52:02.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:52:02.611268471Z [2024-05-11T02:52:02.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-11 02:50:00+00:00, run_id=scheduled__2024-05-11T02:50:00+00:00, run_start_date=2024-05-11 02:52:00.478990+00:00, run_end_date=2024-05-11 02:52:02.610921+00:00, run_duration=2.131931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:50:00+00:00, data_interval_end=2024-05-11 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-11T02:52:02.624015460Z [2024-05-11T02:52:02.623+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-11T02:52:00+00:00, run_after=2024-05-11T02:54:00+00:00 2024-05-11T02:52:02.640828943Z [2024-05-11T02:52:02.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:52:02.641272599Z [2024-05-11T02:52:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:51:00+00:00, run_id=scheduled__2024-05-11T02:51:00+00:00, run_start_date=2024-05-11 02:52:00.480390+00:00, run_end_date=2024-05-11 02:52:02.640980+00:00, run_duration=2.16059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:51:00+00:00, data_interval_end=2024-05-11 02:52:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:52:02.657953185Z [2024-05-11T02:52:02.657+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:52:00+00:00, run_after=2024-05-11T02:53:00+00:00 2024-05-11T02:52:02.737717419Z [2024-05-11T02:52:02.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:50:00+00:00 exited with status success for try_number 1 2024-05-11T02:52:02.742201813Z [2024-05-11T02:52:02.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:51:00+00:00 exited with status success for try_number 1 2024-05-11T02:52:02.753796642Z [2024-05-11T02:52:02.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:51:00+00:00, map_index=-1, run_start_date=2024-05-11 02:52:01.540364+00:00, run_end_date=2024-05-11 02:52:01.989636+00:00, run_duration=0.449272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:52:00.573812+00:00, queued_by_job_id=2, pid=17032 2024-05-11T02:52:02.754300427Z [2024-05-11T02:52:02.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-11T02:50:00+00:00, map_index=-1, run_start_date=2024-05-11 02:52:01.503478+00:00, run_end_date=2024-05-11 02:52:01.898697+00:00, run_duration=0.395219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:52:00.573812+00:00, queued_by_job_id=2, pid=17031 2024-05-11T02:52:04.931056307Z [2024-05-11T02:52:04.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:52:04.931294779Z [2024-05-11T02:52:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:51:00+00:00, run_id=scheduled__2024-05-11T02:51:00+00:00, run_start_date=2024-05-11 02:52:00.481503+00:00, run_end_date=2024-05-11 02:52:04.930805+00:00, run_duration=4.449302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:51:00+00:00, data_interval_end=2024-05-11 02:52:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:52:04.944924978Z [2024-05-11T02:52:04.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:52:00+00:00, run_after=2024-05-11T02:53:00+00:00 2024-05-11T02:52:04.953312629Z [2024-05-11T02:52:04.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:52:04.953346004Z [2024-05-11T02:52:04.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:51:00+00:00, run_id=scheduled__2024-05-11T02:51:00+00:00, run_start_date=2024-05-11 02:52:00.482653+00:00, run_end_date=2024-05-11 02:52:04.953107+00:00, run_duration=4.470454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:51:00+00:00, data_interval_end=2024-05-11 02:52:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:52:04.962491912Z [2024-05-11T02:52:04.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:52:00+00:00, run_after=2024-05-11T02:53:00+00:00 2024-05-11T02:52:05.007881729Z [2024-05-11T02:52:05.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:51:00+00:00 exited with status success for try_number 1 2024-05-11T02:52:05.008420660Z [2024-05-11T02:52:05.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:51:00+00:00 exited with status success for try_number 1 2024-05-11T02:52:05.022184272Z [2024-05-11T02:52:05.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:51:00+00:00, map_index=-1, run_start_date=2024-05-11 02:52:02.943335+00:00, run_end_date=2024-05-11 02:52:04.246255+00:00, run_duration=1.30292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:52:00.573812+00:00, queued_by_job_id=2, pid=17056 2024-05-11T02:52:05.022744407Z [2024-05-11T02:52:05.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:51:00+00:00, map_index=-1, run_start_date=2024-05-11 02:52:02.646701+00:00, run_end_date=2024-05-11 02:52:04.374651+00:00, run_duration=1.72795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:52:00.573812+00:00, queued_by_job_id=2, pid=17050 2024-05-11T02:53:00.761530944Z [2024-05-11T02:53:00.760+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:53:00.778440480Z [2024-05-11T02:53:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:53:00+00:00, run_after=2024-05-11T02:54:00+00:00 2024-05-11T02:53:00.792509980Z [2024-05-11T02:53:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:53:00+00:00, run_after=2024-05-11T02:54:00+00:00 2024-05-11T02:53:00.882453444Z [2024-05-11T02:53:00.881+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-11T02:53:00.882499240Z 2024-05-11T02:53:00.882511240Z 2024-05-11T02:53:00.882521655Z 2024-05-11T02:53:00.882548912Z [2024-05-11T02:53:00.882+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:53:00.882645775Z [2024-05-11T02:53:00.882+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:53:00.882743618Z [2024-05-11T02:53:00.882+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:53:00.883659878Z [2024-05-11T02:53:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:53:00.883671798Z 2024-05-11T02:53:00.883679392Z 2024-05-11T02:53:00.883686630Z 2024-05-11T02:53:00.890480154Z [2024-05-11T02:53:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:53:00.890535077Z [2024-05-11T02:53:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:53:00.890951575Z [2024-05-11T02:53:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:53:00.891033850Z [2024-05-11T02:53:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:53:00.891413964Z [2024-05-11T02:53:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:53:00.891528118Z [2024-05-11T02:53:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:53:01.301088819Z [2024-05-11T02:53:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status queued for try_number 1 2024-05-11T02:53:01.301240366Z [2024-05-11T02:53:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status queued for try_number 1 2024-05-11T02:53:01.301431334Z [2024-05-11T02:53:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status queued for try_number 1 2024-05-11T02:53:01.313509373Z [2024-05-11T02:53:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceabf1f1-0454-47c6-b604-7bad915aedf4 2024-05-11T02:53:01.313820961Z [2024-05-11T02:53:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to c05e55b2-9f04-4de8-be7e-1d3f7b389efd 2024-05-11T02:53:01.314105241Z [2024-05-11T02:53:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77e2cf39-089a-45c6-9860-609f5005b158 2024-05-11T02:53:02.392638992Z [2024-05-11T02:53:02.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:53:02.393080535Z [2024-05-11T02:53:02.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, execution_date=2024-05-11 02:52:00+00:00, run_id=scheduled__2024-05-11T02:52:00+00:00, run_start_date=2024-05-11 02:53:00.803372+00:00, run_end_date=2024-05-11 02:53:02.392547+00:00, run_duration=1.589175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:52:00+00:00, data_interval_end=2024-05-11 02:53:00+00:00, dag_hash=b6ff24d2c480186da308677b4e44f190 2024-05-11T02:53:02.403019310Z [2024-05-11T02:53:02.402+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:53:00+00:00, run_after=2024-05-11T02:54:00+00:00 2024-05-11T02:53:02.448369572Z [2024-05-11T02:53:02.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status success for try_number 1 2024-05-11T02:53:02.453074444Z [2024-05-11T02:53:02.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:52:00+00:00, map_index=-1, run_start_date=2024-05-11 02:53:01.708909+00:00, run_end_date=2024-05-11 02:53:02.102761+00:00, run_duration=0.393852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:53:00.884713+00:00, queued_by_job_id=2, pid=17088 2024-05-11T02:53:05.709021914Z [2024-05-11T02:53:05.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:53:05.709243565Z [2024-05-11T02:53:05.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:52:00+00:00, run_id=scheduled__2024-05-11T02:52:00+00:00, run_start_date=2024-05-11 02:53:00.804561+00:00, run_end_date=2024-05-11 02:53:05.708826+00:00, run_duration=4.904265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:52:00+00:00, data_interval_end=2024-05-11 02:53:00+00:00, dag_hash=8bbbb60a6363ab2ad6e1aea5e1ed46f1 2024-05-11T02:53:05.718390710Z [2024-05-11T02:53:05.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:53:00+00:00, run_after=2024-05-11T02:54:00+00:00 2024-05-11T02:53:05.727383083Z [2024-05-11T02:53:05.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-11T02:53:05.727804520Z [2024-05-11T02:53:05.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, execution_date=2024-05-11 02:52:00+00:00, run_id=scheduled__2024-05-11T02:52:00+00:00, run_start_date=2024-05-11 02:53:00.805587+00:00, run_end_date=2024-05-11 02:53:05.727233+00:00, run_duration=4.921646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-11 02:52:00+00:00, data_interval_end=2024-05-11 02:53:00+00:00, dag_hash=356d326e4e3525bb2ef12086809d8e2f 2024-05-11T02:53:05.738925575Z [2024-05-11T02:53:05.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:53:00+00:00, run_after=2024-05-11T02:54:00+00:00 2024-05-11T02:53:05.774890338Z [2024-05-11T02:53:05.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status success for try_number 1 2024-05-11T02:53:05.775257452Z [2024-05-11T02:53:05.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status success for try_number 1 2024-05-11T02:53:05.789563371Z [2024-05-11T02:53:05.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:52:00+00:00, map_index=-1, run_start_date=2024-05-11 02:53:02.822125+00:00, run_end_date=2024-05-11 02:53:04.613661+00:00, run_duration=1.791536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:53:00.884713+00:00, queued_by_job_id=2, pid=17107 2024-05-11T02:53:05.790060144Z [2024-05-11T02:53:05.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-11T02:52:00+00:00, map_index=-1, run_start_date=2024-05-11 02:53:02.751705+00:00, run_end_date=2024-05-11 02:53:05.256902+00:00, run_duration=2.505197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-11 02:53:00.884713+00:00, queued_by_job_id=2, pid=17106 2024-05-11T02:54:00.060145983Z [2024-05-11T02:54:00.059+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:54:00.074017632Z [2024-05-11T02:54:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 to 2024-05-11T02:54:00+00:00, run_after=2024-05-11T02:55:00+00:00 2024-05-11T02:54:00.084058395Z [2024-05-11T02:54:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f to 2024-05-11T02:54:00+00:00, run_after=2024-05-11T02:55:00+00:00 2024-05-11T02:54:00.088588114Z [2024-05-11T02:54:00.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-11T02:54:00.167744124Z [2024-05-11T02:54:00.167+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-11T02:54:00.167769121Z 2024-05-11T02:54:00.167773223Z 2024-05-11T02:54:00.167776869Z 2024-05-11T02:54:00.167780129Z 2024-05-11T02:54:00.167883698Z [2024-05-11T02:54:00.167+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-11T02:54:00.168235665Z [2024-05-11T02:54:00.168+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:54:00.168459376Z [2024-05-11T02:54:00.168+0000] {scheduler_job.py:425} INFO - DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f has 0/16 running and queued tasks 2024-05-11T02:54:00.168666512Z [2024-05-11T02:54:00.168+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 has 0/16 running and queued tasks 2024-05-11T02:54:00.169471240Z [2024-05-11T02:54:00.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-11T02:54:00.169482580Z 2024-05-11T02:54:00.169486332Z 2024-05-11T02:54:00.169489812Z 2024-05-11T02:54:00.169521778Z 2024-05-11T02:54:00.173430324Z [2024-05-11T02:54:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-11T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:54:00.173661119Z [2024-05-11T02:54:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:54:00.174271011Z [2024-05-11T02:54:00.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:54:00.178654232Z [2024-05-11T02:54:00.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:54:00.178704465Z [2024-05-11T02:54:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:54:00.178709135Z [2024-05-11T02:54:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:54:00.178845690Z [2024-05-11T02:54:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-11T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-11T02:54:00.179065729Z [2024-05-11T02:54:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:54:00.820209889Z [2024-05-11T02:54:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-11T02:52:00+00:00 exited with status queued for try_number 1 2024-05-11T02:54:00.820235136Z [2024-05-11T02:54:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:53:00+00:00 exited with status queued for try_number 1 2024-05-11T02:54:00.828021137Z [2024-05-11T02:54:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:53:00+00:00 exited with status queued for try_number 1 2024-05-11T02:54:00.829889258Z [2024-05-11T02:54:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-11T02:53:00+00:00 exited with status queued for try_number 1 2024-05-11T02:54:00.879922526Z [2024-05-11T02:54:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06ef39b2-f54e-4f18-8a4b-f3b2e42cae3d 2024-05-11T02:54:00.882702421Z [2024-05-11T02:54:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7d0ffe9-9dc3-4ec2-8974-38d6b5871865 2024-05-11T02:54:00.882894421Z [2024-05-11T02:54:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc1b42b6-559f-49ab-a609-87159cfdff6f 2024-05-11T02:54:00.883461377Z [2024-05-11T02:54:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23248ed7-8df2-4071-a93d-fb35a6bc70ca 2024-05-10T22:25:27.460958644Z 2024-05-10T22:25:27.464934572Z Cleaning logs every 900 seconds 2024-05-10T22:25:27.464961212Z Trimming airflow logs to 15 days. 2024-05-10T22:30:00.530179912Z Trimming airflow logs to 15 days. 2024-05-10T22:30:01.571774850Z Trimming airflow logs to 15 days. 2024-05-10T22:45:00.597405206Z Trimming airflow logs to 15 days. 2024-05-10T22:45:01.630435261Z Trimming airflow logs to 15 days. 2024-05-10T23:00:00.663921852Z Trimming airflow logs to 15 days. 2024-05-10T23:00:01.689716663Z Trimming airflow logs to 15 days. 2024-05-10T23:15:00.731344335Z Trimming airflow logs to 15 days. 2024-05-10T23:15:01.761249075Z Trimming airflow logs to 15 days. 2024-05-10T23:30:00.785545938Z Trimming airflow logs to 15 days. 2024-05-10T23:30:01.810099984Z Trimming airflow logs to 15 days. 2024-05-10T23:45:00.838394074Z Trimming airflow logs to 15 days. 2024-05-10T23:45:01.883693319Z Trimming airflow logs to 15 days. 2024-05-11T00:00:00.912523391Z Trimming airflow logs to 15 days. 2024-05-11T00:00:01.931269125Z Trimming airflow logs to 15 days. 2024-05-11T00:15:00.965901558Z Trimming airflow logs to 15 days. 2024-05-11T00:15:01.995978713Z Trimming airflow logs to 15 days. 2024-05-11T00:30:00.044185781Z Trimming airflow logs to 15 days. 2024-05-11T00:30:01.076016333Z Trimming airflow logs to 15 days. 2024-05-11T00:45:00.122399416Z Trimming airflow logs to 15 days. 2024-05-11T00:45:01.151329995Z Trimming airflow logs to 15 days. 2024-05-11T01:00:00.243720752Z Trimming airflow logs to 15 days. 2024-05-11T01:00:01.274216037Z Trimming airflow logs to 15 days. 2024-05-11T01:15:00.308995894Z Trimming airflow logs to 15 days. 2024-05-11T01:15:01.360536472Z Trimming airflow logs to 15 days. 2024-05-11T01:30:00.405955265Z Trimming airflow logs to 15 days. 2024-05-11T01:30:01.425240282Z Trimming airflow logs to 15 days. 2024-05-11T01:45:00.455024587Z Trimming airflow logs to 15 days. 2024-05-11T01:45:01.495842942Z Trimming airflow logs to 15 days. 2024-05-11T02:00:00.562252814Z Trimming airflow logs to 15 days. 2024-05-11T02:00:01.599668318Z Trimming airflow logs to 15 days. 2024-05-11T02:15:00.649673203Z Trimming airflow logs to 15 days. 2024-05-11T02:15:01.682153152Z Trimming airflow logs to 15 days. 2024-05-11T02:30:00.739746889Z Trimming airflow logs to 15 days. 2024-05-11T02:30:01.766198314Z Trimming airflow logs to 15 days. 2024-05-11T02:45:00.824819536Z Trimming airflow logs to 15 days. 2024-05-11T02:45:01.849101139Z Trimming airflow logs to 15 days. 2024-05-10T22:25:10.466113695Z ... 2024-05-10T22:25:11.088615543Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-10T22:25:12.213390083Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-10T22:25:16.407119640Z [2024-05-10T22:25:16.405+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s)